{"action":"created","issue":{"url":"https://api.github.com/repos/memex-explorer/memex-explorer/issues/720","labels_url":"https://api.github.com/repos/memex-explorer/memex-explorer/issues/720/labels{/name}","comments_url":"https://api.github.com/repos/memex-explorer/memex-explorer/issues/720/comments","events_url":"https://api.github.com/repos/memex-explorer/memex-explorer/issues/720/events","html_url":"https://github.com/memex-explorer/memex-explorer/pull/720","id":112664538,"number":720,"title":"WIP - Nutch REST Refactor","user":{"login":"ahmadia","id":512293,"avatar_url":"https://avatars.githubusercontent.com/u/512293?v=3","gravatar_id":"","url":"https://api.github.com/users/ahmadia","html_url":"https://github.com/ahmadia","followers_url":"https://api.github.com/users/ahmadia/followers","following_url":"https://api.github.com/users/ahmadia/following{/other_user}","gists_url":"https://api.github.com/users/ahmadia/gists{/gist_id}","starred_url":"https://api.github.com/users/ahmadia/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ahmadia/subscriptions","organizations_url":"https://api.github.com/users/ahmadia/orgs","repos_url":"https://api.github.com/users/ahmadia/repos","events_url":"https://api.github.com/users/ahmadia/events{/privacy}","received_events_url":"https://api.github.com/users/ahmadia/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-10-21T19:42:35Z","updated_at":"2015-10-21T19:44:12Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/memex-explorer/memex-explorer/pulls/720","html_url":"https://github.com/memex-explorer/memex-explorer/pull/720","diff_url":"https://github.com/memex-explorer/memex-explorer/pull/720.diff","patch_url":"https://github.com/memex-explorer/memex-explorer/pull/720.patch"},"body":"Quite a few todos here.  Off the top of my head:\r\n\r\n* [ ] - Handle multiple crawls simultaneously (needs to user the crawl name to manage crawl contexts/configurations as well as Bokeh documents)\r\n* [ ] - Restore the stuff I had to disable in crawl.js (chat with Brittain about this)\r\n* [ ] - Programmatically extract seeds instead of using writing to file (chat with Brittain about this)\r\n* [ ] - Defensive programming for situations when Bokeh server and RMQ are not available\r\n* [ ] - Packaging of new Nutch + RESTful interface"},"comment":{"url":"https://api.github.com/repos/memex-explorer/memex-explorer/issues/comments/150004911","html_url":"https://github.com/memex-explorer/memex-explorer/pull/720#issuecomment-150004911","issue_url":"https://api.github.com/repos/memex-explorer/memex-explorer/issues/720","id":150004911,"user":{"login":"ahmadia","id":512293,"avatar_url":"https://avatars.githubusercontent.com/u/512293?v=3","gravatar_id":"","url":"https://api.github.com/users/ahmadia","html_url":"https://github.com/ahmadia","followers_url":"https://api.github.com/users/ahmadia/followers","following_url":"https://api.github.com/users/ahmadia/following{/other_user}","gists_url":"https://api.github.com/users/ahmadia/gists{/gist_id}","starred_url":"https://api.github.com/users/ahmadia/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ahmadia/subscriptions","organizations_url":"https://api.github.com/users/ahmadia/orgs","repos_url":"https://api.github.com/users/ahmadia/repos","events_url":"https://api.github.com/users/ahmadia/events{/privacy}","received_events_url":"https://api.github.com/users/ahmadia/received_events","type":"User","site_admin":false},"created_at":"2015-10-21T19:44:12Z","updated_at":"2015-10-21T19:44:12Z","body":"@sujen1412 @chrismattmann @brittainhard - this is probably of interest.  To try this locally, you'll need a normal memex explorer install, check out this branch, then make sure a RESTful Nutch is installed and on the path and that you've installed the latest version of `nutch-python` into the current environment.\r\n\r\nAfter that, kick off services with `supervisord` and start a Nutch crawl:\r\n\r\n![ezgif com-gif-maker 1](https://cloud.githubusercontent.com/assets/512293/10648088/8be387d6-780a-11e5-8ef8-9f7d064c5a57.gif)\r\n"}}