{"action":"closed","issue":{"url":"https://api.github.com/repos/mysociety/popit/issues/766","labels_url":"https://api.github.com/repos/mysociety/popit/issues/766/labels{/name}","comments_url":"https://api.github.com/repos/mysociety/popit/issues/766/comments","events_url":"https://api.github.com/repos/mysociety/popit/issues/766/events","html_url":"https://github.com/mysociety/popit/issues/766","id":58214950,"number":766,"title":"\"do not spider\" option doesn't seem to be working","user":{"login":"mhl","id":7907,"avatar_url":"https://avatars.githubusercontent.com/u/7907?v=3","gravatar_id":"","url":"https://api.github.com/users/mhl","html_url":"https://github.com/mhl","followers_url":"https://api.github.com/users/mhl/followers","following_url":"https://api.github.com/users/mhl/following{/other_user}","gists_url":"https://api.github.com/users/mhl/gists{/gist_id}","starred_url":"https://api.github.com/users/mhl/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mhl/subscriptions","organizations_url":"https://api.github.com/users/mhl/orgs","repos_url":"https://api.github.com/users/mhl/repos","events_url":"https://api.github.com/users/mhl/events{/privacy}","received_events_url":"https://api.github.com/users/mhl/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-02-19T14:30:32Z","updated_at":"2015-03-04T14:40:17Z","closed_at":"2015-03-04T14:40:17Z","body":"For example, http://yournextmp-staging.popit.staging.mysociety.org/about says \"Do not spider: Yes\" but http://yournextmp-staging.popit.staging.mysociety.org/robots.txt is not found (404)."}}