In GeoDMS, how can I read large shape files?
up vote
0
down vote
favorite
I have problems reading a large shape file in GeoDMS GUI version 7.177.
I'm trying to read the BAG (basisadministratie gemeenten, Dutch municipality administration, a giant geo file) into GeoDMS directly from the Kadaster. It's first been converted from .xml into .csv, then from .csv to .shp (using Python 'shapefile' library). When I make a selection of 10 000 buildings, everything goes well. When I want to read the whole BAG (some 16 000 000 building), however, GeoDMS can't seem to read the entire shape file, after a while the CPU usage is close to 0% and no further progress seems to be made.
Code:
/*
This program reads the BAG in .shp format and writes it to .dmsdata format for speedy processing in Minta
*/
container root
{
unit<dpoint> rdc_base; // RDC stands for Rijksdriehoekscoordinaten, Dutch state coordinate system
unit<dpoint> rdc := range(rdc_base,point(300000.0,0.0),point(625000.0,280000.0)); // default rdc: built on doubles
unit<uint32> bagRead:
storageName = 'c:/zandbak/intermediate/bagPND.dbf'
, dialogData = 'geometry'
, dialogType = 'map'
, storageReadOnly = 'true'
, isHidden = 'true'
{
attribute<rdc> geometry(polygon):
storageName = 'c:/zandbak/intermediate/bagPND.shp'
, storageReadOnly = 'true';
attribute<string>buildingId;
attribute<string>status;
attribute<string>year;
}
unit<uint32> bagWrite := subset(bagRead/buildingId==bagRead/buildingId)
, storageName = 'c:/zandbak/output/bagPND.fss'
, storageReadOnly = 'false'
, dialogData = 'geometry'
, dialogType = 'map'
{
attribute<uint32> nr_OrgEntity;
attribute<rdc> geometry(polygon) := bagRead/geometry[nr_OrgEntity];
attribute<string> buildingId := bagRead/buildingId[nr_OrgEntity];
attribute<string> status := bagRead/status[nr_OrgEntity];
attribute<string> year := bagRead/year[nr_OrgEntity];
}
}
I run this code using the batch mode:
"C:Program FilesObjectVisionGeoDms7177GeoDmsRun.exe" "C:repositoryvestabagpreprocessingroot.dms" /bagWrite
As said, this code functions well for 10 000 buildings. However, not for 16M buildings. Is there a way to read large shape files in GeoDMS?
geospatial geo
add a comment |
up vote
0
down vote
favorite
I have problems reading a large shape file in GeoDMS GUI version 7.177.
I'm trying to read the BAG (basisadministratie gemeenten, Dutch municipality administration, a giant geo file) into GeoDMS directly from the Kadaster. It's first been converted from .xml into .csv, then from .csv to .shp (using Python 'shapefile' library). When I make a selection of 10 000 buildings, everything goes well. When I want to read the whole BAG (some 16 000 000 building), however, GeoDMS can't seem to read the entire shape file, after a while the CPU usage is close to 0% and no further progress seems to be made.
Code:
/*
This program reads the BAG in .shp format and writes it to .dmsdata format for speedy processing in Minta
*/
container root
{
unit<dpoint> rdc_base; // RDC stands for Rijksdriehoekscoordinaten, Dutch state coordinate system
unit<dpoint> rdc := range(rdc_base,point(300000.0,0.0),point(625000.0,280000.0)); // default rdc: built on doubles
unit<uint32> bagRead:
storageName = 'c:/zandbak/intermediate/bagPND.dbf'
, dialogData = 'geometry'
, dialogType = 'map'
, storageReadOnly = 'true'
, isHidden = 'true'
{
attribute<rdc> geometry(polygon):
storageName = 'c:/zandbak/intermediate/bagPND.shp'
, storageReadOnly = 'true';
attribute<string>buildingId;
attribute<string>status;
attribute<string>year;
}
unit<uint32> bagWrite := subset(bagRead/buildingId==bagRead/buildingId)
, storageName = 'c:/zandbak/output/bagPND.fss'
, storageReadOnly = 'false'
, dialogData = 'geometry'
, dialogType = 'map'
{
attribute<uint32> nr_OrgEntity;
attribute<rdc> geometry(polygon) := bagRead/geometry[nr_OrgEntity];
attribute<string> buildingId := bagRead/buildingId[nr_OrgEntity];
attribute<string> status := bagRead/status[nr_OrgEntity];
attribute<string> year := bagRead/year[nr_OrgEntity];
}
}
I run this code using the batch mode:
"C:Program FilesObjectVisionGeoDms7177GeoDmsRun.exe" "C:repositoryvestabagpreprocessingroot.dms" /bagWrite
As said, this code functions well for 10 000 buildings. However, not for 16M buildings. Is there a way to read large shape files in GeoDMS?
geospatial geo
add a comment |
up vote
0
down vote
favorite
up vote
0
down vote
favorite
I have problems reading a large shape file in GeoDMS GUI version 7.177.
I'm trying to read the BAG (basisadministratie gemeenten, Dutch municipality administration, a giant geo file) into GeoDMS directly from the Kadaster. It's first been converted from .xml into .csv, then from .csv to .shp (using Python 'shapefile' library). When I make a selection of 10 000 buildings, everything goes well. When I want to read the whole BAG (some 16 000 000 building), however, GeoDMS can't seem to read the entire shape file, after a while the CPU usage is close to 0% and no further progress seems to be made.
Code:
/*
This program reads the BAG in .shp format and writes it to .dmsdata format for speedy processing in Minta
*/
container root
{
unit<dpoint> rdc_base; // RDC stands for Rijksdriehoekscoordinaten, Dutch state coordinate system
unit<dpoint> rdc := range(rdc_base,point(300000.0,0.0),point(625000.0,280000.0)); // default rdc: built on doubles
unit<uint32> bagRead:
storageName = 'c:/zandbak/intermediate/bagPND.dbf'
, dialogData = 'geometry'
, dialogType = 'map'
, storageReadOnly = 'true'
, isHidden = 'true'
{
attribute<rdc> geometry(polygon):
storageName = 'c:/zandbak/intermediate/bagPND.shp'
, storageReadOnly = 'true';
attribute<string>buildingId;
attribute<string>status;
attribute<string>year;
}
unit<uint32> bagWrite := subset(bagRead/buildingId==bagRead/buildingId)
, storageName = 'c:/zandbak/output/bagPND.fss'
, storageReadOnly = 'false'
, dialogData = 'geometry'
, dialogType = 'map'
{
attribute<uint32> nr_OrgEntity;
attribute<rdc> geometry(polygon) := bagRead/geometry[nr_OrgEntity];
attribute<string> buildingId := bagRead/buildingId[nr_OrgEntity];
attribute<string> status := bagRead/status[nr_OrgEntity];
attribute<string> year := bagRead/year[nr_OrgEntity];
}
}
I run this code using the batch mode:
"C:Program FilesObjectVisionGeoDms7177GeoDmsRun.exe" "C:repositoryvestabagpreprocessingroot.dms" /bagWrite
As said, this code functions well for 10 000 buildings. However, not for 16M buildings. Is there a way to read large shape files in GeoDMS?
geospatial geo
I have problems reading a large shape file in GeoDMS GUI version 7.177.
I'm trying to read the BAG (basisadministratie gemeenten, Dutch municipality administration, a giant geo file) into GeoDMS directly from the Kadaster. It's first been converted from .xml into .csv, then from .csv to .shp (using Python 'shapefile' library). When I make a selection of 10 000 buildings, everything goes well. When I want to read the whole BAG (some 16 000 000 building), however, GeoDMS can't seem to read the entire shape file, after a while the CPU usage is close to 0% and no further progress seems to be made.
Code:
/*
This program reads the BAG in .shp format and writes it to .dmsdata format for speedy processing in Minta
*/
container root
{
unit<dpoint> rdc_base; // RDC stands for Rijksdriehoekscoordinaten, Dutch state coordinate system
unit<dpoint> rdc := range(rdc_base,point(300000.0,0.0),point(625000.0,280000.0)); // default rdc: built on doubles
unit<uint32> bagRead:
storageName = 'c:/zandbak/intermediate/bagPND.dbf'
, dialogData = 'geometry'
, dialogType = 'map'
, storageReadOnly = 'true'
, isHidden = 'true'
{
attribute<rdc> geometry(polygon):
storageName = 'c:/zandbak/intermediate/bagPND.shp'
, storageReadOnly = 'true';
attribute<string>buildingId;
attribute<string>status;
attribute<string>year;
}
unit<uint32> bagWrite := subset(bagRead/buildingId==bagRead/buildingId)
, storageName = 'c:/zandbak/output/bagPND.fss'
, storageReadOnly = 'false'
, dialogData = 'geometry'
, dialogType = 'map'
{
attribute<uint32> nr_OrgEntity;
attribute<rdc> geometry(polygon) := bagRead/geometry[nr_OrgEntity];
attribute<string> buildingId := bagRead/buildingId[nr_OrgEntity];
attribute<string> status := bagRead/status[nr_OrgEntity];
attribute<string> year := bagRead/year[nr_OrgEntity];
}
}
I run this code using the batch mode:
"C:Program FilesObjectVisionGeoDms7177GeoDmsRun.exe" "C:repositoryvestabagpreprocessingroot.dms" /bagWrite
As said, this code functions well for 10 000 buildings. However, not for 16M buildings. Is there a way to read large shape files in GeoDMS?
geospatial geo
geospatial geo
asked Nov 19 at 13:13
Otto
113
113
add a comment |
add a comment |
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
active
oldest
votes
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Some of your past answers have not been well-received, and you're in danger of being blocked from answering.
Please pay close attention to the following guidance:
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53375427%2fin-geodms-how-can-i-read-large-shape-files%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown