{"action":"created","issue":{"url":"https://api.github.com/repos/OCHA-DAP/hdx-ckan/issues/2631","labels_url":"https://api.github.com/repos/OCHA-DAP/hdx-ckan/issues/2631/labels{/name}","comments_url":"https://api.github.com/repos/OCHA-DAP/hdx-ckan/issues/2631/comments","events_url":"https://api.github.com/repos/OCHA-DAP/hdx-ckan/issues/2631/events","html_url":"https://github.com/OCHA-DAP/hdx-ckan/issues/2631","id":67162271,"number":2631,"title":"Epic: Supporting geo preview of large files","user":{"login":"cjhendrix","id":1654485,"avatar_url":"https://avatars.githubusercontent.com/u/1654485?v=3","gravatar_id":"","url":"https://api.github.com/users/cjhendrix","html_url":"https://github.com/cjhendrix","followers_url":"https://api.github.com/users/cjhendrix/followers","following_url":"https://api.github.com/users/cjhendrix/following{/other_user}","gists_url":"https://api.github.com/users/cjhendrix/gists{/gist_id}","starred_url":"https://api.github.com/users/cjhendrix/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cjhendrix/subscriptions","organizations_url":"https://api.github.com/users/cjhendrix/orgs","repos_url":"https://api.github.com/users/cjhendrix/repos","events_url":"https://api.github.com/users/cjhendrix/events{/privacy}","received_events_url":"https://api.github.com/users/cjhendrix/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/OCHA-DAP/hdx-ckan/labels/GisPreview","name":"GisPreview","color":"bfe5bf"},{"url":"https://api.github.com/repos/OCHA-DAP/hdx-ckan/labels/Priority-Low","name":"Priority-Low","color":"fbca04"}],"state":"open","locked":false,"assignee":{"login":"alexandru-m-g","id":6586348,"avatar_url":"https://avatars.githubusercontent.com/u/6586348?v=3","gravatar_id":"","url":"https://api.github.com/users/alexandru-m-g","html_url":"https://github.com/alexandru-m-g","followers_url":"https://api.github.com/users/alexandru-m-g/followers","following_url":"https://api.github.com/users/alexandru-m-g/following{/other_user}","gists_url":"https://api.github.com/users/alexandru-m-g/gists{/gist_id}","starred_url":"https://api.github.com/users/alexandru-m-g/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexandru-m-g/subscriptions","organizations_url":"https://api.github.com/users/alexandru-m-g/orgs","repos_url":"https://api.github.com/users/alexandru-m-g/repos","events_url":"https://api.github.com/users/alexandru-m-g/events{/privacy}","received_events_url":"https://api.github.com/users/alexandru-m-g/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/OCHA-DAP/hdx-ckan/milestones/52","html_url":"https://github.com/OCHA-DAP/hdx-ckan/milestones/Sprint%20Candidates","labels_url":"https://api.github.com/repos/OCHA-DAP/hdx-ckan/milestones/52/labels","id":1034479,"number":52,"title":"Sprint Candidates","description":"","creator":{"login":"cjhendrix","id":1654485,"avatar_url":"https://avatars.githubusercontent.com/u/1654485?v=3","gravatar_id":"","url":"https://api.github.com/users/cjhendrix","html_url":"https://github.com/cjhendrix","followers_url":"https://api.github.com/users/cjhendrix/followers","following_url":"https://api.github.com/users/cjhendrix/following{/other_user}","gists_url":"https://api.github.com/users/cjhendrix/gists{/gist_id}","starred_url":"https://api.github.com/users/cjhendrix/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cjhendrix/subscriptions","organizations_url":"https://api.github.com/users/cjhendrix/orgs","repos_url":"https://api.github.com/users/cjhendrix/repos","events_url":"https://api.github.com/users/cjhendrix/events{/privacy}","received_events_url":"https://api.github.com/users/cjhendrix/received_events","type":"User","site_admin":false},"open_issues":13,"closed_issues":7,"state":"open","created_at":"2015-03-23T16:52:25Z","updated_at":"2015-05-13T12:45:12Z","due_on":null,"closed_at":null},"comments":4,"created_at":"2015-04-08T15:59:40Z","updated_at":"2015-05-19T13:02:26Z","closed_at":null,"body":"This epic is intended to provide the ability for us to reliably preview large shp resources.  Test cases are:\r\n\r\nhttps://data.hdx.rwlabs.org/dataset/openstreetmap-shapefiles-for-gis-softwares-daily-updates (3MB zipped)\r\nhttps://data.hdx.rwlabs.org/dataset/lsib-lines-global-simplified (15MB zipped). \r\nhttp://redirect.state.sbu/?url=https://data.hdx.rwlabs.org/dataset/lsib-polygons-africa-and-americas-simplified \r\nhttp://redirect.state.sbu/?url=https://data.hdx.rwlabs.org/dataset/lsib-polygons-eurasia-and-oceania-simplified \r\nhttp://redirect.state.sbu/?url=https://data.hdx.rwlabs.org/dataset/lsib-simplified-shoreline\r\n\r\nThose resources are not currently previewing and the goal of this epic is to preview them, even on CJ's crappy internet connection at home. \r\n\r\nAlthough other ideas are welcome, on the recommendation of experts it seems the recommended approach looks something like this (likely easiest approach in blue):\r\n\r\n![image](https://cloud.githubusercontent.com/assets/1654485/7049305/d5baf98e-de18-11e4-9a5b-8045e3d388a3.png)\r\n\r\nThis approach rests fundamentally on the vector tiles specification.  Here are some good resources, most of them from March 2015, so this is quite recent stuff. \r\n\r\nhttp://geothought.blogspot.ch/\r\nhttps://www.mapbox.com/developers/vector-tiles/\r\nhttps://2015.foss4g-na.org/session/state-vector-tiles\r\nhttps://speakerdeck.com/hallahan/leaflet-vector-tiles\r\n  "},"comment":{"url":"https://api.github.com/repos/OCHA-DAP/hdx-ckan/issues/comments/103477159","html_url":"https://github.com/OCHA-DAP/hdx-ckan/issues/2631#issuecomment-103477159","issue_url":"https://api.github.com/repos/OCHA-DAP/hdx-ckan/issues/2631","id":103477159,"user":{"login":"alexandru-m-g","id":6586348,"avatar_url":"https://avatars.githubusercontent.com/u/6586348?v=3","gravatar_id":"","url":"https://api.github.com/users/alexandru-m-g","html_url":"https://github.com/alexandru-m-g","followers_url":"https://api.github.com/users/alexandru-m-g/followers","following_url":"https://api.github.com/users/alexandru-m-g/following{/other_user}","gists_url":"https://api.github.com/users/alexandru-m-g/gists{/gist_id}","starred_url":"https://api.github.com/users/alexandru-m-g/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexandru-m-g/subscriptions","organizations_url":"https://api.github.com/users/alexandru-m-g/orgs","repos_url":"https://api.github.com/users/alexandru-m-g/repos","events_url":"https://api.github.com/users/alexandru-m-g/events{/privacy}","received_events_url":"https://api.github.com/users/alexandru-m-g/received_events","type":"User","site_admin":false},"created_at":"2015-05-19T13:02:26Z","updated_at":"2015-05-19T13:02:26Z","body":"1. Mali buildings:\r\n  *  55 MB unzipped, 350k polygons\r\n  *  pushing to PostGIS 1m 10s\r\n  *  browser response on default zoom level 3s\r\n  *  notes: zipped file has several layers\r\n\r\n2. Global Simplified LSIB Lines\r\n  * 5.8 MB unzipped, 401 lines, multi-lines \r\n  * pushing to PostGIS 2s\r\n  *  browser response on default zoom level 400 ms\r\n  * notes: problem at import because `ERROR:  Geometry type (MultiLineString) does not match column type (LineString)`\r\n\r\n3. Africa America Simplified LSIB Lines\r\n  *  30 MB unzipped, 125 lines, polygon, multi-polygonss\r\n  *  pushing to PostGIS 5s\r\n  *  browser response on default zoom level 1s\r\n  *  notes: problem at import because `ERROR:  Geometry type (MultiPolygon) does not match column type (Polygon)`\r\n\r\n\r\n"}}