{"action":"opened","issue":{"url":"https://api.github.com/repos/mikedevita/node-reddit-scraper/issues/4","labels_url":"https://api.github.com/repos/mikedevita/node-reddit-scraper/issues/4/labels{/name}","comments_url":"https://api.github.com/repos/mikedevita/node-reddit-scraper/issues/4/comments","events_url":"https://api.github.com/repos/mikedevita/node-reddit-scraper/issues/4/events","html_url":"https://github.com/mikedevita/node-reddit-scraper/issues/4","id":119564032,"number":4,"title":"the app should check if file exists before querying imgur api","user":{"login":"mikedevita","id":2991640,"avatar_url":"https://avatars.githubusercontent.com/u/2991640?v=3","gravatar_id":"","url":"https://api.github.com/users/mikedevita","html_url":"https://github.com/mikedevita","followers_url":"https://api.github.com/users/mikedevita/followers","following_url":"https://api.github.com/users/mikedevita/following{/other_user}","gists_url":"https://api.github.com/users/mikedevita/gists{/gist_id}","starred_url":"https://api.github.com/users/mikedevita/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mikedevita/subscriptions","organizations_url":"https://api.github.com/users/mikedevita/orgs","repos_url":"https://api.github.com/users/mikedevita/repos","events_url":"https://api.github.com/users/mikedevita/events{/privacy}","received_events_url":"https://api.github.com/users/mikedevita/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/mikedevita/node-reddit-scraper/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"open","locked":false,"assignee":{"login":"mikedevita","id":2991640,"avatar_url":"https://avatars.githubusercontent.com/u/2991640?v=3","gravatar_id":"","url":"https://api.github.com/users/mikedevita","html_url":"https://github.com/mikedevita","followers_url":"https://api.github.com/users/mikedevita/followers","following_url":"https://api.github.com/users/mikedevita/following{/other_user}","gists_url":"https://api.github.com/users/mikedevita/gists{/gist_id}","starred_url":"https://api.github.com/users/mikedevita/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mikedevita/subscriptions","organizations_url":"https://api.github.com/users/mikedevita/orgs","repos_url":"https://api.github.com/users/mikedevita/repos","events_url":"https://api.github.com/users/mikedevita/events{/privacy}","received_events_url":"https://api.github.com/users/mikedevita/received_events","type":"User","site_admin":false},"milestone":null,"comments":0,"created_at":"2015-11-30T19:36:38Z","updated_at":"2015-11-30T19:36:38Z","closed_at":null,"body":"right now the scraper queries reddit for the topics, then for each topic that has an imgur link it queries imgur for the right URL to the image, **then** it checks if the file exists.\r\n\r\nSince imgur has a ratelimit of 12.5k requests a month the app should have some way of determining if a file exists even before querying the imgur API.. \r\n\r\nmaybe by hashing the image and using that as all or part of the filename, or by hashing the URL."}}