{"action":"created","issue":{"url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/3950","labels_url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/3950/labels{/name}","comments_url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/3950/comments","events_url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/3950/events","html_url":"https://github.com/rethinkdb/rethinkdb/issues/3950","id":63063816,"number":3950,"title":"Consider making web UI serve a robots.txt to avoid indexing","user":{"login":"danielmewes","id":505365,"avatar_url":"https://avatars.githubusercontent.com/u/505365?v=3","gravatar_id":"","url":"https://api.github.com/users/danielmewes","html_url":"https://github.com/danielmewes","followers_url":"https://api.github.com/users/danielmewes/followers","following_url":"https://api.github.com/users/danielmewes/following{/other_user}","gists_url":"https://api.github.com/users/danielmewes/gists{/gist_id}","starred_url":"https://api.github.com/users/danielmewes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/danielmewes/subscriptions","organizations_url":"https://api.github.com/users/danielmewes/orgs","repos_url":"https://api.github.com/users/danielmewes/repos","events_url":"https://api.github.com/users/danielmewes/events{/privacy}","received_events_url":"https://api.github.com/users/danielmewes/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/rethinkdb/rethinkdb/milestones/41","html_url":"https://github.com/rethinkdb/rethinkdb/milestones/subsequent","labels_url":"https://api.github.com/repos/rethinkdb/rethinkdb/milestones/41/labels","id":367201,"number":41,"title":"subsequent","description":"","creator":{"login":"coffeemug","id":48436,"avatar_url":"https://avatars.githubusercontent.com/u/48436?v=3","gravatar_id":"","url":"https://api.github.com/users/coffeemug","html_url":"https://github.com/coffeemug","followers_url":"https://api.github.com/users/coffeemug/followers","following_url":"https://api.github.com/users/coffeemug/following{/other_user}","gists_url":"https://api.github.com/users/coffeemug/gists{/gist_id}","starred_url":"https://api.github.com/users/coffeemug/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/coffeemug/subscriptions","organizations_url":"https://api.github.com/users/coffeemug/orgs","repos_url":"https://api.github.com/users/coffeemug/repos","events_url":"https://api.github.com/users/coffeemug/events{/privacy}","received_events_url":"https://api.github.com/users/coffeemug/received_events","type":"User","site_admin":false},"open_issues":369,"closed_issues":0,"state":"open","created_at":"2013-06-30T07:32:52Z","updated_at":"2015-03-19T18:49:35Z","due_on":null,"closed_at":null},"comments":1,"created_at":"2015-03-19T18:49:35Z","updated_at":"2015-03-19T18:54:58Z","closed_at":null,"body":"It is currently pretty easy to find unsecure RethinkDB servers on Google / Bing etc. if they for some reason have got hold of the URL.\r\n\r\nWe could serve a robots.txt file to disable that kind of indexing.\r\nOptionally we could make the server generate a log message if robots.txt gets accessed. Something like \"It appears that your server has been accessed from the Internet. See http://rethinkdb.com/docs/security/ for information on how to secure it.\"\r\n\r\nOne argument against it is that it's an extremely incomplete protection. Specialized search engines like http://www.shodanhq.com/ (the one used in http://cispa.saarland/wp-content/uploads/2015/02/MongoDB_documentation.pdf) likely won't care for a robots.txt."},"comment":{"url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/comments/83717047","html_url":"https://github.com/rethinkdb/rethinkdb/issues/3950#issuecomment-83717047","issue_url":"https://api.github.com/repos/rethinkdb/rethinkdb/issues/3950","id":83717047,"user":{"login":"danielmewes","id":505365,"avatar_url":"https://avatars.githubusercontent.com/u/505365?v=3","gravatar_id":"","url":"https://api.github.com/users/danielmewes","html_url":"https://github.com/danielmewes","followers_url":"https://api.github.com/users/danielmewes/followers","following_url":"https://api.github.com/users/danielmewes/following{/other_user}","gists_url":"https://api.github.com/users/danielmewes/gists{/gist_id}","starred_url":"https://api.github.com/users/danielmewes/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/danielmewes/subscriptions","organizations_url":"https://api.github.com/users/danielmewes/orgs","repos_url":"https://api.github.com/users/danielmewes/repos","events_url":"https://api.github.com/users/danielmewes/events{/privacy}","received_events_url":"https://api.github.com/users/danielmewes/received_events","type":"User","site_admin":false},"created_at":"2015-03-19T18:54:58Z","updated_at":"2015-03-19T18:54:58Z","body":"Note that this only applies to instances that have been explicitly started with `--bind all`. RethinkDB is secure by default."}}