{"action":"created","issue":{"url":"https://api.github.com/repos/fergiemcdowall/norch/issues/32","labels_url":"https://api.github.com/repos/fergiemcdowall/norch/issues/32/labels{/name}","comments_url":"https://api.github.com/repos/fergiemcdowall/norch/issues/32/comments","events_url":"https://api.github.com/repos/fergiemcdowall/norch/issues/32/events","html_url":"https://github.com/fergiemcdowall/norch/issues/32","id":31924923,"number":32,"title":"Forage running inside browser, added with bookmarklet","user":{"login":"eklem","id":236656,"avatar_url":"https://avatars.githubusercontent.com/u/236656?v=3","gravatar_id":"","url":"https://api.github.com/users/eklem","html_url":"https://github.com/eklem","followers_url":"https://api.github.com/users/eklem/followers","following_url":"https://api.github.com/users/eklem/following{/other_user}","gists_url":"https://api.github.com/users/eklem/gists{/gist_id}","starred_url":"https://api.github.com/users/eklem/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/eklem/subscriptions","organizations_url":"https://api.github.com/users/eklem/orgs","repos_url":"https://api.github.com/users/eklem/repos","events_url":"https://api.github.com/users/eklem/events{/privacy}","received_events_url":"https://api.github.com/users/eklem/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/fergiemcdowall/norch/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":13,"created_at":"2014-04-21T21:01:55Z","updated_at":"2015-01-15T14:14:03Z","closed_at":"2015-01-15T13:54:07Z","body":"Got an idea last week to use the browser as a virtual machine for Forage. Forage could then be added with a bookmarklet to any page. With some simple UI-stuff you could define the Forage Document Processor Adapter, set up rules for Forage Crawler, crawl (and process) and then possibly test-search with HTML5 local storage instead of levelDB. When the user is satisfied she or he could download the JSON-file with processed items + scripts for adding a search box, search result and navigators to a page.\r\n\r\nThe real benefit would be that the user would not need any server to test Forage and actually crawl a site. When page crawled the user can download JSON + setup-stuff or add it to a cloud service.\r\n\r\n![foraging-01-page](https://cloud.githubusercontent.com/assets/236656/2758898/7a58d20a-c997-11e3-86bf-b365306b401a.png)\r\nThe user finds a page to crawl ...\r\n\r\n![foraging-02-bookmarklet](https://cloud.githubusercontent.com/assets/236656/2758901/7d5fc896-c997-11e3-831e-836398903c8a.png)\r\n... clicks the bookmarklet ...\r\n\r\n![foraging-03-bookmarklet](https://cloud.githubusercontent.com/assets/236656/2758902/8038dae4-c997-11e3-87ee-4d7664b15600.png)\r\n... that adds Forage JavaScript-stuff to the page ...\r\n\r\n![foraging-04-foragin-pristine](https://cloud.githubusercontent.com/assets/236656/2758907/8356af6c-c997-11e3-8541-bb2d4b9f2dff.png)\r\n... much like a browser plugin ...\r\n\r\n![foraging-05-jquery-selector-test](https://cloud.githubusercontent.com/assets/236656/2758908/857e9570-c997-11e3-99f9-acd8eb6f34be.png)\r\n... tests a jQuery selector satement ...\r\n\r\n![foraging-06-jquery-selector-added](https://cloud.githubusercontent.com/assets/236656/2758909/880b8f28-c997-11e3-93f2-f91041c13982.png)\r\n... and adds the field to the item when satisfied. This process is repeated until a full item is defined.\r\n\r\nMore to come on the crawl rule setup, test-search and downloading of data + adapter + crawl-rules\r\n"},"comment":{"url":"https://api.github.com/repos/fergiemcdowall/norch/issues/comments/70090576","html_url":"https://github.com/fergiemcdowall/norch/issues/32#issuecomment-70090576","issue_url":"https://api.github.com/repos/fergiemcdowall/norch/issues/32","id":70090576,"user":{"login":"eklem","id":236656,"avatar_url":"https://avatars.githubusercontent.com/u/236656?v=3","gravatar_id":"","url":"https://api.github.com/users/eklem","html_url":"https://github.com/eklem","followers_url":"https://api.github.com/users/eklem/followers","following_url":"https://api.github.com/users/eklem/following{/other_user}","gists_url":"https://api.github.com/users/eklem/gists{/gist_id}","starred_url":"https://api.github.com/users/eklem/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/eklem/subscriptions","organizations_url":"https://api.github.com/users/eklem/orgs","repos_url":"https://api.github.com/users/eklem/repos","events_url":"https://api.github.com/users/eklem/events{/privacy}","received_events_url":"https://api.github.com/users/eklem/received_events","type":"User","site_admin":false},"created_at":"2015-01-15T14:14:03Z","updated_at":"2015-01-15T14:14:03Z","body":"No problem Fergus. Really happy search-index was browserifiable so fast, and that it actually happened! Nice to mock up the idea to make it better. Also, [Kimono](http://www.kimonolabs.com/) does the scraping part very well (partly by bookmarklet), so that fixes one step. "}}