{"action":"created","issue":{"url":"https://api.github.com/repos/tudelft3d/pprepair/issues/25","labels_url":"https://api.github.com/repos/tudelft3d/pprepair/issues/25/labels{/name}","comments_url":"https://api.github.com/repos/tudelft3d/pprepair/issues/25/comments","events_url":"https://api.github.com/repos/tudelft3d/pprepair/issues/25/events","html_url":"https://github.com/tudelft3d/pprepair/issues/25","id":103762485,"number":25,"title":"\"segmentation fault (core dumped)\" when repairing a 57mb shapefile","user":{"login":"lucasmation","id":1426312,"avatar_url":"https://avatars.githubusercontent.com/u/1426312?v=3","gravatar_id":"","url":"https://api.github.com/users/lucasmation","html_url":"https://github.com/lucasmation","followers_url":"https://api.github.com/users/lucasmation/followers","following_url":"https://api.github.com/users/lucasmation/following{/other_user}","gists_url":"https://api.github.com/users/lucasmation/gists{/gist_id}","starred_url":"https://api.github.com/users/lucasmation/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lucasmation/subscriptions","organizations_url":"https://api.github.com/users/lucasmation/orgs","repos_url":"https://api.github.com/users/lucasmation/repos","events_url":"https://api.github.com/users/lucasmation/events{/privacy}","received_events_url":"https://api.github.com/users/lucasmation/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2015-08-28T17:36:47Z","updated_at":"2015-09-14T18:10:32Z","closed_at":null,"body":"First, thanks for this amazing program! We were pulling our hair out trying to solve the topological probems in PostGis. \r\n\r\nI'm trying to correct the shape files of the enumeration districts of the Brazilian 2010 Census, about 318k polygons in total, which has lots of topological problems, overlays, gaps, etc. The data is divided by state shapefiles and available from: ftp://geoftp.ibge.gov.br/malhas_digitais/censo_2010/setores_censitarios/ \r\n\r\npprepair works great in 19 of the 27 states. However for the remaining 8 states, which have the largest shapefiles, ppreair issues the following error and stops : \r\n\r\n\"segmentation fault (core dumped)\"\r\n\r\nThis error ocurr after much of the fixes have been completed, at the last step, just when the shapefiles are about to be saved. \r\n\r\nFor instance, pprepair crashes with the Bahia(BA) data, which has a 57mb shapefile and 24k polygons. The shapefile is available from:\r\n\r\nftp://geoftp.ibge.gov.br/malhas_digitais/censo_2010/setores_censitarios/ba/ba_setores_censitarios.zip\r\n\r\npprepair keeps using more and more RAM. At the time it crasses, in the Bahia case, ppreair is using 3gb of RAM (which is still bellow the available 16gb of ram)\r\n\r\n\r\nAdditionally, a different error ocurrs for the state o Pará (PA) (ftp://geoftp.ibge.gov.br/malhas_digitais/censo_2010/setores_censitarios/pa/pa_setores_censitarios.zip). pprepair seems to never end the computation. Keeps runing indefinetivelly. This is weird as the PA file is only 17mb, not particularly large relative to other states. \r\n\r\nWe are using: \r\n\r\nUnuntu 12.04 LTS, 64bits\r\nRAM: 16GB\r\n\r\nLibrary versions: \r\n\"gdal 1.9.0, release 2011/12/29\"\r\n\"cmake version 2.8.7\"\r\ncgal: 3.9-1bulild1\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/tudelft3d/pprepair/issues/comments/140163316","html_url":"https://github.com/tudelft3d/pprepair/issues/25#issuecomment-140163316","issue_url":"https://api.github.com/repos/tudelft3d/pprepair/issues/25","id":140163316,"user":{"login":"lucasmation","id":1426312,"avatar_url":"https://avatars.githubusercontent.com/u/1426312?v=3","gravatar_id":"","url":"https://api.github.com/users/lucasmation","html_url":"https://github.com/lucasmation","followers_url":"https://api.github.com/users/lucasmation/followers","following_url":"https://api.github.com/users/lucasmation/following{/other_user}","gists_url":"https://api.github.com/users/lucasmation/gists{/gist_id}","starred_url":"https://api.github.com/users/lucasmation/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lucasmation/subscriptions","organizations_url":"https://api.github.com/users/lucasmation/orgs","repos_url":"https://api.github.com/users/lucasmation/repos","events_url":"https://api.github.com/users/lucasmation/events{/privacy}","received_events_url":"https://api.github.com/users/lucasmation/received_events","type":"User","site_admin":false},"created_at":"2015-09-14T18:10:32Z","updated_at":"2015-09-14T18:10:32Z","body":"I work for the Instituto de Pesquisa Economica Aplicada (IPEA, institute of applyed economic research, http://ipea.gov.br/portal/) in Brasíila, Brazil. We will publish a tecnhincal note on how we fixed the Census Enumeration District, along with the corrected data. That will be based on pprepair (giving due credit off course) and some other fixes in Postgis and a \"fringe\" of manual corrections. \r\n\r\nit is weird that, having run prepair before the --skipvalideach option makes the data for BA state work. \r\n\r\nI'll send the polygon+point bugs tomorrow. In general, the shapefile outputed from pprepair still has invalid polygons according to PostGis. But at least now these errors can be fixed with \"makeValid()\" , which did not work on the original data (or to be more precised, ran but did not solve the non noded intersections for instance) . \r\n\r\nWe are now working on code to detect \"drastic changes\" made by pprepair, to have them checked by a human\r\n"}}