{"action":"created","comment":{"url":"https://api.github.com/repos/fabianvf/scrapi/pulls/comments/38200675","id":38200675,"diff_hunk":"@@ -202,12 +202,14 @@ For local development, running the ```mit``` harvester is recommended.\n \n Note: harvester-name is the same as the defined harvester \"short name\".\n \n-Invove a harvester a certain number of days back with the ```--days``` argument. For example, to run a harvester 5 days in the past, run:\n+Invoke a harvester a certain number of days back with the ```--days``` argument. For example, to run a harvester 5 days in the past, run:\n \n ```bash\n $ invoke harvester harvester-name --days=5\n ```\n \n+Writing a harvester for inclusion with scrAPI?  [autooai](https://github.com/erinspace/autooai) is a utility that makes this easy for most cases.","path":"README.md","position":11,"original_position":11,"commit_id":"2eaa7d99ccc5bc16d131d41386ec0807bc762ad3","original_commit_id":"2eaa7d99ccc5bc16d131d41386ec0807bc762ad3","user":{"login":"erinspace","id":801594,"avatar_url":"https://avatars.githubusercontent.com/u/801594?v=3","gravatar_id":"","url":"https://api.github.com/users/erinspace","html_url":"https://github.com/erinspace","followers_url":"https://api.github.com/users/erinspace/followers","following_url":"https://api.github.com/users/erinspace/following{/other_user}","gists_url":"https://api.github.com/users/erinspace/gists{/gist_id}","starred_url":"https://api.github.com/users/erinspace/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/erinspace/subscriptions","organizations_url":"https://api.github.com/users/erinspace/orgs","repos_url":"https://api.github.com/users/erinspace/repos","events_url":"https://api.github.com/users/erinspace/events{/privacy}","received_events_url":"https://api.github.com/users/erinspace/received_events","type":"User","site_admin":false},"body":"Hi @felliott! A great addition! One suggestion, can you specify that this is for writing a harvester for sources that have their metadata in OAI-PMH format? ","created_at":"2015-08-28T13:47:26Z","updated_at":"2015-08-28T13:47:26Z","html_url":"https://github.com/fabianvf/scrapi/pull/340#discussion_r38200675","pull_request_url":"https://api.github.com/repos/fabianvf/scrapi/pulls/340","_links":{"self":{"href":"https://api.github.com/repos/fabianvf/scrapi/pulls/comments/38200675"},"html":{"href":"https://github.com/fabianvf/scrapi/pull/340#discussion_r38200675"},"pull_request":{"href":"https://api.github.com/repos/fabianvf/scrapi/pulls/340"}}},"pull_request":{"url":"https://api.github.com/repos/fabianvf/scrapi/pulls/340","id":43628205,"html_url":"https://github.com/fabianvf/scrapi/pull/340","diff_url":"https://github.com/fabianvf/scrapi/pull/340.diff","patch_url":"https://github.com/fabianvf/scrapi/pull/340.patch","issue_url":"https://api.github.com/repos/fabianvf/scrapi/issues/340","number":340,"state":"open","locked":false,"title":"mention autooai utility for writing harvesters","user":{"login":"felliott","id":86835,"avatar_url":"https://avatars.githubusercontent.com/u/86835?v=3","gravatar_id":"","url":"https://api.github.com/users/felliott","html_url":"https://github.com/felliott","followers_url":"https://api.github.com/users/felliott/followers","following_url":"https://api.github.com/users/felliott/following{/other_user}","gists_url":"https://api.github.com/users/felliott/gists{/gist_id}","starred_url":"https://api.github.com/users/felliott/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/felliott/subscriptions","organizations_url":"https://api.github.com/users/felliott/orgs","repos_url":"https://api.github.com/users/felliott/repos","events_url":"https://api.github.com/users/felliott/events{/privacy}","received_events_url":"https://api.github.com/users/felliott/received_events","type":"User","site_admin":false},"body":"@erinspace's autooai tool is mentioned on the SHARE site, and I think it would be helpful to mention it here, too.  I may or may not have spent the better part of yesterday building the NOAA harvester manually because I didn't know about it.  ^_^  D'oh!\r\n\r\nCheers,\r\nFitz","created_at":"2015-08-28T13:36:01Z","updated_at":"2015-08-28T13:47:26Z","closed_at":null,"merged_at":null,"merge_commit_sha":"4af16fb342b14de4142f4aefbdf8f08245106e5e","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/fabianvf/scrapi/pulls/340/commits","review_comments_url":"https://api.github.com/repos/fabianvf/scrapi/pulls/340/comments","review_comment_url":"https://api.github.com/repos/fabianvf/scrapi/pulls/comments{/number}","comments_url":"https://api.github.com/repos/fabianvf/scrapi/issues/340/comments","statuses_url":"https://api.github.com/repos/fabianvf/scrapi/statuses/2eaa7d99ccc5bc16d131d41386ec0807bc762ad3","head":{"label":"felliott:feature/mention_autooai","ref":"feature/mention_autooai","sha":"2eaa7d99ccc5bc16d131d41386ec0807bc762ad3","user":{"login":"felliott","id":86835,"avatar_url":"https://avatars.githubusercontent.com/u/86835?v=3","gravatar_id":"","url":"https://api.github.com/users/felliott","html_url":"https://github.com/felliott","followers_url":"https://api.github.com/users/felliott/followers","following_url":"https://api.github.com/users/felliott/following{/other_user}","gists_url":"https://api.github.com/users/felliott/gists{/gist_id}","starred_url":"https://api.github.com/users/felliott/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/felliott/subscriptions","organizations_url":"https://api.github.com/users/felliott/orgs","repos_url":"https://api.github.com/users/felliott/repos","events_url":"https://api.github.com/users/felliott/events{/privacy}","received_events_url":"https://api.github.com/users/felliott/received_events","type":"User","site_admin":false},"repo":{"id":41548815,"name":"scrapi","full_name":"felliott/scrapi","owner":{"login":"felliott","id":86835,"avatar_url":"https://avatars.githubusercontent.com/u/86835?v=3","gravatar_id":"","url":"https://api.github.com/users/felliott","html_url":"https://github.com/felliott","followers_url":"https://api.github.com/users/felliott/followers","following_url":"https://api.github.com/users/felliott/following{/other_user}","gists_url":"https://api.github.com/users/felliott/gists{/gist_id}","starred_url":"https://api.github.com/users/felliott/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/felliott/subscriptions","organizations_url":"https://api.github.com/users/felliott/orgs","repos_url":"https://api.github.com/users/felliott/repos","events_url":"https://api.github.com/users/felliott/events{/privacy}","received_events_url":"https://api.github.com/users/felliott/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/felliott/scrapi","description":"A data processing pipeline that schedules and runs content harvesters, normalizes their data, and outputs that normalized data to a variety of output streams. This is part of the SHARE project, and will be used to create a free and open dataset of research (meta)data. Data collected can be explored at https://osf.io/share/, and viewed at https://osf.io/api/v1/share/search/. Developer docs can be viewed at https://osf.io/wur56/wiki","fork":true,"url":"https://api.github.com/repos/felliott/scrapi","forks_url":"https://api.github.com/repos/felliott/scrapi/forks","keys_url":"https://api.github.com/repos/felliott/scrapi/keys{/key_id}","collaborators_url":"https://api.github.com/repos/felliott/scrapi/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/felliott/scrapi/teams","hooks_url":"https://api.github.com/repos/felliott/scrapi/hooks","issue_events_url":"https://api.github.com/repos/felliott/scrapi/issues/events{/number}","events_url":"https://api.github.com/repos/felliott/scrapi/events","assignees_url":"https://api.github.com/repos/felliott/scrapi/assignees{/user}","branches_url":"https://api.github.com/repos/felliott/scrapi/branches{/branch}","tags_url":"https://api.github.com/repos/felliott/scrapi/tags","blobs_url":"https://api.github.com/repos/felliott/scrapi/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/felliott/scrapi/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/felliott/scrapi/git/refs{/sha}","trees_url":"https://api.github.com/repos/felliott/scrapi/git/trees{/sha}","statuses_url":"https://api.github.com/repos/felliott/scrapi/statuses/{sha}","languages_url":"https://api.github.com/repos/felliott/scrapi/languages","stargazers_url":"https://api.github.com/repos/felliott/scrapi/stargazers","contributors_url":"https://api.github.com/repos/felliott/scrapi/contributors","subscribers_url":"https://api.github.com/repos/felliott/scrapi/subscribers","subscription_url":"https://api.github.com/repos/felliott/scrapi/subscription","commits_url":"https://api.github.com/repos/felliott/scrapi/commits{/sha}","git_commits_url":"https://api.github.com/repos/felliott/scrapi/git/commits{/sha}","comments_url":"https://api.github.com/repos/felliott/scrapi/comments{/number}","issue_comment_url":"https://api.github.com/repos/felliott/scrapi/issues/comments{/number}","contents_url":"https://api.github.com/repos/felliott/scrapi/contents/{+path}","compare_url":"https://api.github.com/repos/felliott/scrapi/compare/{base}...{head}","merges_url":"https://api.github.com/repos/felliott/scrapi/merges","archive_url":"https://api.github.com/repos/felliott/scrapi/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/felliott/scrapi/downloads","issues_url":"https://api.github.com/repos/felliott/scrapi/issues{/number}","pulls_url":"https://api.github.com/repos/felliott/scrapi/pulls{/number}","milestones_url":"https://api.github.com/repos/felliott/scrapi/milestones{/number}","notifications_url":"https://api.github.com/repos/felliott/scrapi/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/felliott/scrapi/labels{/name}","releases_url":"https://api.github.com/repos/felliott/scrapi/releases{/id}","created_at":"2015-08-28T13:31:46Z","updated_at":"2015-08-28T13:31:47Z","pushed_at":"2015-08-28T13:32:15Z","git_url":"git://github.com/felliott/scrapi.git","ssh_url":"git@github.com:felliott/scrapi.git","clone_url":"https://github.com/felliott/scrapi.git","svn_url":"https://github.com/felliott/scrapi","homepage":"","size":33677,"stargazers_count":0,"watchers_count":0,"language":"Python","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"develop"}},"base":{"label":"fabianvf:develop","ref":"develop","sha":"a1745a07da222a5e42ff7ece7b93e71990c20700","user":{"login":"fabianvf","id":2431974,"avatar_url":"https://avatars.githubusercontent.com/u/2431974?v=3","gravatar_id":"","url":"https://api.github.com/users/fabianvf","html_url":"https://github.com/fabianvf","followers_url":"https://api.github.com/users/fabianvf/followers","following_url":"https://api.github.com/users/fabianvf/following{/other_user}","gists_url":"https://api.github.com/users/fabianvf/gists{/gist_id}","starred_url":"https://api.github.com/users/fabianvf/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fabianvf/subscriptions","organizations_url":"https://api.github.com/users/fabianvf/orgs","repos_url":"https://api.github.com/users/fabianvf/repos","events_url":"https://api.github.com/users/fabianvf/events{/privacy}","received_events_url":"https://api.github.com/users/fabianvf/received_events","type":"User","site_admin":false},"repo":{"id":21210102,"name":"scrapi","full_name":"fabianvf/scrapi","owner":{"login":"fabianvf","id":2431974,"avatar_url":"https://avatars.githubusercontent.com/u/2431974?v=3","gravatar_id":"","url":"https://api.github.com/users/fabianvf","html_url":"https://github.com/fabianvf","followers_url":"https://api.github.com/users/fabianvf/followers","following_url":"https://api.github.com/users/fabianvf/following{/other_user}","gists_url":"https://api.github.com/users/fabianvf/gists{/gist_id}","starred_url":"https://api.github.com/users/fabianvf/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fabianvf/subscriptions","organizations_url":"https://api.github.com/users/fabianvf/orgs","repos_url":"https://api.github.com/users/fabianvf/repos","events_url":"https://api.github.com/users/fabianvf/events{/privacy}","received_events_url":"https://api.github.com/users/fabianvf/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/fabianvf/scrapi","description":"A data processing pipeline that schedules and runs content harvesters, normalizes their data, and outputs that normalized data to a variety of output streams. This is part of the SHARE project, and will be used to create a free and open dataset of research (meta)data. Data collected can be explored at https://osf.io/share/, and viewed at https://osf.io/api/v1/share/search/. Developer docs can be viewed at https://osf.io/wur56/wiki","fork":false,"url":"https://api.github.com/repos/fabianvf/scrapi","forks_url":"https://api.github.com/repos/fabianvf/scrapi/forks","keys_url":"https://api.github.com/repos/fabianvf/scrapi/keys{/key_id}","collaborators_url":"https://api.github.com/repos/fabianvf/scrapi/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/fabianvf/scrapi/teams","hooks_url":"https://api.github.com/repos/fabianvf/scrapi/hooks","issue_events_url":"https://api.github.com/repos/fabianvf/scrapi/issues/events{/number}","events_url":"https://api.github.com/repos/fabianvf/scrapi/events","assignees_url":"https://api.github.com/repos/fabianvf/scrapi/assignees{/user}","branches_url":"https://api.github.com/repos/fabianvf/scrapi/branches{/branch}","tags_url":"https://api.github.com/repos/fabianvf/scrapi/tags","blobs_url":"https://api.github.com/repos/fabianvf/scrapi/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/fabianvf/scrapi/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/fabianvf/scrapi/git/refs{/sha}","trees_url":"https://api.github.com/repos/fabianvf/scrapi/git/trees{/sha}","statuses_url":"https://api.github.com/repos/fabianvf/scrapi/statuses/{sha}","languages_url":"https://api.github.com/repos/fabianvf/scrapi/languages","stargazers_url":"https://api.github.com/repos/fabianvf/scrapi/stargazers","contributors_url":"https://api.github.com/repos/fabianvf/scrapi/contributors","subscribers_url":"https://api.github.com/repos/fabianvf/scrapi/subscribers","subscription_url":"https://api.github.com/repos/fabianvf/scrapi/subscription","commits_url":"https://api.github.com/repos/fabianvf/scrapi/commits{/sha}","git_commits_url":"https://api.github.com/repos/fabianvf/scrapi/git/commits{/sha}","comments_url":"https://api.github.com/repos/fabianvf/scrapi/comments{/number}","issue_comment_url":"https://api.github.com/repos/fabianvf/scrapi/issues/comments{/number}","contents_url":"https://api.github.com/repos/fabianvf/scrapi/contents/{+path}","compare_url":"https://api.github.com/repos/fabianvf/scrapi/compare/{base}...{head}","merges_url":"https://api.github.com/repos/fabianvf/scrapi/merges","archive_url":"https://api.github.com/repos/fabianvf/scrapi/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/fabianvf/scrapi/downloads","issues_url":"https://api.github.com/repos/fabianvf/scrapi/issues{/number}","pulls_url":"https://api.github.com/repos/fabianvf/scrapi/pulls{/number}","milestones_url":"https://api.github.com/repos/fabianvf/scrapi/milestones{/number}","notifications_url":"https://api.github.com/repos/fabianvf/scrapi/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/fabianvf/scrapi/labels{/name}","releases_url":"https://api.github.com/repos/fabianvf/scrapi/releases{/id}","created_at":"2014-06-25T16:21:08Z","updated_at":"2015-08-21T07:55:45Z","pushed_at":"2015-08-28T13:36:01Z","git_url":"git://github.com/fabianvf/scrapi.git","ssh_url":"git@github.com:fabianvf/scrapi.git","clone_url":"https://github.com/fabianvf/scrapi.git","svn_url":"https://github.com/fabianvf/scrapi","homepage":"","size":33677,"stargazers_count":8,"watchers_count":8,"language":"Python","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":29,"mirror_url":null,"open_issues_count":41,"forks":29,"open_issues":41,"watchers":8,"default_branch":"develop"}},"_links":{"self":{"href":"https://api.github.com/repos/fabianvf/scrapi/pulls/340"},"html":{"href":"https://github.com/fabianvf/scrapi/pull/340"},"issue":{"href":"https://api.github.com/repos/fabianvf/scrapi/issues/340"},"comments":{"href":"https://api.github.com/repos/fabianvf/scrapi/issues/340/comments"},"review_comments":{"href":"https://api.github.com/repos/fabianvf/scrapi/pulls/340/comments"},"review_comment":{"href":"https://api.github.com/repos/fabianvf/scrapi/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/fabianvf/scrapi/pulls/340/commits"},"statuses":{"href":"https://api.github.com/repos/fabianvf/scrapi/statuses/2eaa7d99ccc5bc16d131d41386ec0807bc762ad3"}}}}