{"action":"created","issue":{"url":"https://api.github.com/repos/LoveMyData/auburn/issues/1","labels_url":"https://api.github.com/repos/LoveMyData/auburn/issues/1/labels{/name}","comments_url":"https://api.github.com/repos/LoveMyData/auburn/issues/1/comments","events_url":"https://api.github.com/repos/LoveMyData/auburn/issues/1/events","html_url":"https://github.com/LoveMyData/auburn/issues/1","id":120296506,"number":1,"title":"info_url should not return error in new browser session","user":{"login":"equivalentideas","id":1239550,"avatar_url":"https://avatars.githubusercontent.com/u/1239550?v=3","gravatar_id":"","url":"https://api.github.com/users/equivalentideas","html_url":"https://github.com/equivalentideas","followers_url":"https://api.github.com/users/equivalentideas/followers","following_url":"https://api.github.com/users/equivalentideas/following{/other_user}","gists_url":"https://api.github.com/users/equivalentideas/gists{/gist_id}","starred_url":"https://api.github.com/users/equivalentideas/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/equivalentideas/subscriptions","organizations_url":"https://api.github.com/users/equivalentideas/orgs","repos_url":"https://api.github.com/users/equivalentideas/repos","events_url":"https://api.github.com/users/equivalentideas/events{/privacy}","received_events_url":"https://api.github.com/users/equivalentideas/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/LoveMyData/auburn/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"closed","locked":false,"assignee":{"login":"LoveMyData","id":15683093,"avatar_url":"https://avatars.githubusercontent.com/u/15683093?v=3","gravatar_id":"","url":"https://api.github.com/users/LoveMyData","html_url":"https://github.com/LoveMyData","followers_url":"https://api.github.com/users/LoveMyData/followers","following_url":"https://api.github.com/users/LoveMyData/following{/other_user}","gists_url":"https://api.github.com/users/LoveMyData/gists{/gist_id}","starred_url":"https://api.github.com/users/LoveMyData/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/LoveMyData/subscriptions","organizations_url":"https://api.github.com/users/LoveMyData/orgs","repos_url":"https://api.github.com/users/LoveMyData/repos","events_url":"https://api.github.com/users/LoveMyData/events{/privacy}","received_events_url":"https://api.github.com/users/LoveMyData/received_events","type":"User","site_admin":false},"milestone":null,"comments":2,"created_at":"2015-12-03T23:30:36Z","updated_at":"2015-12-07T01:36:32Z","closed_at":"2015-12-04T10:13:24Z","body":"Currently the urls collected by the scraper can't be opened in a new browser session. Try copying the url into the address bar of a new incognito/private browser window to see this in action:\r\n\r\n![screen shot 2015-12-04 at 10 26 59 am](https://cloud.githubusercontent.com/assets/1239550/11577416/99bf408c-9a71-11e5-8b35-f34f81862924.png)\r\n\r\nIn PlanningAlerts, the info_url data collected by scrapers get used for the 'Read more information' link.\r\n\r\n![screen shot 2015-12-04 at 10 24 12 am](https://cloud.githubusercontent.com/assets/1239550/11577361/3cb56704-9a71-11e5-87dd-b37ef42d29a1.png)\r\n\r\nIt’s really confusing for people if they get an error when they click this link. While it would be lovely if the council had a website with urls that worked properly, I think in this instance it's best to take people to a page that they can use to find the application they're interested in. Unfortunately the closest page I can find on their site is https://secure.auburn.nsw.gov.au/ePathway/Production/Web/GeneralEnquiry/EnquiryLists.aspx?js=-753296884 :( But I think that's better than an error.\r\n\r\nAccording to the [PlanningAlerts scraping guide](https://www.planningalerts.org.au/how_to_write_a_scraper):\r\n\r\n>  In many cases councils force users to click through a license to access planning application. In this case be careful about what URL you provide. Test clicking the link in a browser that hasn't established a session with the council's site to ensure users of PlanningAlerts will be able to click the link and not be presented with an error."},"comment":{"url":"https://api.github.com/repos/LoveMyData/auburn/issues/comments/162386388","html_url":"https://github.com/LoveMyData/auburn/issues/1#issuecomment-162386388","issue_url":"https://api.github.com/repos/LoveMyData/auburn/issues/1","id":162386388,"user":{"login":"equivalentideas","id":1239550,"avatar_url":"https://avatars.githubusercontent.com/u/1239550?v=3","gravatar_id":"","url":"https://api.github.com/users/equivalentideas","html_url":"https://github.com/equivalentideas","followers_url":"https://api.github.com/users/equivalentideas/followers","following_url":"https://api.github.com/users/equivalentideas/following{/other_user}","gists_url":"https://api.github.com/users/equivalentideas/gists{/gist_id}","starred_url":"https://api.github.com/users/equivalentideas/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/equivalentideas/subscriptions","organizations_url":"https://api.github.com/users/equivalentideas/orgs","repos_url":"https://api.github.com/users/equivalentideas/repos","events_url":"https://api.github.com/users/equivalentideas/events{/privacy}","received_events_url":"https://api.github.com/users/equivalentideas/received_events","type":"User","site_admin":false},"created_at":"2015-12-07T01:36:32Z","updated_at":"2015-12-07T01:36:32Z","body":"Nice one @LoveMyData :+1: \r\n\r\n> However, I don't seems able to delete my database from 'Settings' and test it, may need to wait for a new DA submitted and see.\r\n\r\nThe issue was that the data.sqlite file was committed into the github repo, so morph would look at this file with the old data instead of creating and update it's own file.\r\n\r\nWhile you added that file to the .gitignore here https://github.com/LoveMyData/auburn/commit/3e4ae1875995b4cceb08f7496895f3d193bef7ab you also need to remove the file that had been committed, which I did with 'git rm', https://github.com/planningalerts-scrapers/auburn/commit/699b753484642d10cfe0f77d060ee4aecba0fdee .\r\n\r\nNow the scraper can collect new data, and the database can be managed in the morph.io interface. I made an issue to provide some help in this scenario here: https://github.com/openaustralia/morph/issues/942 Any insights to how you could have been assisted it that situation would be useful here.\r\n"}}