{"action":"opened","number":4,"pull_request":{"url":"https://api.github.com/repos/wigginslab/vc-matcher/pulls/4","id":43179125,"html_url":"https://github.com/wigginslab/vc-matcher/pull/4","diff_url":"https://github.com/wigginslab/vc-matcher/pull/4.diff","patch_url":"https://github.com/wigginslab/vc-matcher/pull/4.patch","issue_url":"https://api.github.com/repos/wigginslab/vc-matcher/issues/4","number":4,"state":"open","locked":false,"title":"Use pycrunchbase to scrape Crunchbase. Added some tests.","user":{"login":"alabid","id":928460,"avatar_url":"https://avatars.githubusercontent.com/u/928460?v=3","gravatar_id":"","url":"https://api.github.com/users/alabid","html_url":"https://github.com/alabid","followers_url":"https://api.github.com/users/alabid/followers","following_url":"https://api.github.com/users/alabid/following{/other_user}","gists_url":"https://api.github.com/users/alabid/gists{/gist_id}","starred_url":"https://api.github.com/users/alabid/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alabid/subscriptions","organizations_url":"https://api.github.com/users/alabid/orgs","repos_url":"https://api.github.com/users/alabid/repos","events_url":"https://api.github.com/users/alabid/events{/privacy}","received_events_url":"https://api.github.com/users/alabid/received_events","type":"User","site_admin":false},"body":"I intend to use github for *codereview*. Depending on how many of my subsequent tasks depend on a particular pull request, I'll merge the pull request in 8-36 hours. You can always comment on a pull request after it's been merged.\r\n\r\nResolves #3 \r\n\r\n**tl;dr**\r\n\r\n`pip install -r requirements.txt` and then\r\nRun scraper using defaults:\r\n`python -m scrapers.crunchbase_scraper -k <api_key>`\r\nSee options:\r\n`python -m scrapers.crunchbase_scraper -h`\r\nRun tests:\r\n`python -m tests.test_crunchbase_scraper`\r\n\r\nWhat this pull request accomplishes:\r\n* Uses my fork of *pycrunchbase* to scrape CrunchBase. There's currently no way to get all investors in *pycrunchbase* so I added that functionality: https://github.com/alabid/pycrunchbase/tree/vc-matcher. `pycrunchbase` still has some bugs that can be fixed incrementally.\r\nAlso crunchbase v1 is pretty different from v3, unfortunately.\r\n\r\n* Now easier to run the scraper without much setup. i.e. you can pass the api key via the command line options.\r\n\r\n* Added some unit tests (need to add more though).\r\n\r\n**Next up**: update README to reflect latest changes; fix `pycrunchbase` bugs and submit PR?","created_at":"2015-08-24T14:15:58Z","updated_at":"2015-08-24T14:15:58Z","closed_at":null,"merged_at":null,"merge_commit_sha":null,"assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/wigginslab/vc-matcher/pulls/4/commits","review_comments_url":"https://api.github.com/repos/wigginslab/vc-matcher/pulls/4/comments","review_comment_url":"https://api.github.com/repos/wigginslab/vc-matcher/pulls/comments{/number}","comments_url":"https://api.github.com/repos/wigginslab/vc-matcher/issues/4/comments","statuses_url":"https://api.github.com/repos/wigginslab/vc-matcher/statuses/dd4de82ff7d7c5f771af41d422e0cb0f763ae12a","head":{"label":"wigginslab:alabid/pycrunchbase","ref":"alabid/pycrunchbase","sha":"dd4de82ff7d7c5f771af41d422e0cb0f763ae12a","user":{"login":"wigginslab","id":739883,"avatar_url":"https://avatars.githubusercontent.com/u/739883?v=3","gravatar_id":"","url":"https://api.github.com/users/wigginslab","html_url":"https://github.com/wigginslab","followers_url":"https://api.github.com/users/wigginslab/followers","following_url":"https://api.github.com/users/wigginslab/following{/other_user}","gists_url":"https://api.github.com/users/wigginslab/gists{/gist_id}","starred_url":"https://api.github.com/users/wigginslab/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wigginslab/subscriptions","organizations_url":"https://api.github.com/users/wigginslab/orgs","repos_url":"https://api.github.com/users/wigginslab/repos","events_url":"https://api.github.com/users/wigginslab/events{/privacy}","received_events_url":"https://api.github.com/users/wigginslab/received_events","type":"Organization","site_admin":false},"repo":{"id":15029433,"name":"vc-matcher","full_name":"wigginslab/vc-matcher","owner":{"login":"wigginslab","id":739883,"avatar_url":"https://avatars.githubusercontent.com/u/739883?v=3","gravatar_id":"","url":"https://api.github.com/users/wigginslab","html_url":"https://github.com/wigginslab","followers_url":"https://api.github.com/users/wigginslab/followers","following_url":"https://api.github.com/users/wigginslab/following{/other_user}","gists_url":"https://api.github.com/users/wigginslab/gists{/gist_id}","starred_url":"https://api.github.com/users/wigginslab/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wigginslab/subscriptions","organizations_url":"https://api.github.com/users/wigginslab/orgs","repos_url":"https://api.github.com/users/wigginslab/repos","events_url":"https://api.github.com/users/wigginslab/events{/privacy}","received_events_url":"https://api.github.com/users/wigginslab/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/wigginslab/vc-matcher","description":"","fork":false,"url":"https://api.github.com/repos/wigginslab/vc-matcher","forks_url":"https://api.github.com/repos/wigginslab/vc-matcher/forks","keys_url":"https://api.github.com/repos/wigginslab/vc-matcher/keys{/key_id}","collaborators_url":"https://api.github.com/repos/wigginslab/vc-matcher/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/wigginslab/vc-matcher/teams","hooks_url":"https://api.github.com/repos/wigginslab/vc-matcher/hooks","issue_events_url":"https://api.github.com/repos/wigginslab/vc-matcher/issues/events{/number}","events_url":"https://api.github.com/repos/wigginslab/vc-matcher/events","assignees_url":"https://api.github.com/repos/wigginslab/vc-matcher/assignees{/user}","branches_url":"https://api.github.com/repos/wigginslab/vc-matcher/branches{/branch}","tags_url":"https://api.github.com/repos/wigginslab/vc-matcher/tags","blobs_url":"https://api.github.com/repos/wigginslab/vc-matcher/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/wigginslab/vc-matcher/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/wigginslab/vc-matcher/git/refs{/sha}","trees_url":"https://api.github.com/repos/wigginslab/vc-matcher/git/trees{/sha}","statuses_url":"https://api.github.com/repos/wigginslab/vc-matcher/statuses/{sha}","languages_url":"https://api.github.com/repos/wigginslab/vc-matcher/languages","stargazers_url":"https://api.github.com/repos/wigginslab/vc-matcher/stargazers","contributors_url":"https://api.github.com/repos/wigginslab/vc-matcher/contributors","subscribers_url":"https://api.github.com/repos/wigginslab/vc-matcher/subscribers","subscription_url":"https://api.github.com/repos/wigginslab/vc-matcher/subscription","commits_url":"https://api.github.com/repos/wigginslab/vc-matcher/commits{/sha}","git_commits_url":"https://api.github.com/repos/wigginslab/vc-matcher/git/commits{/sha}","comments_url":"https://api.github.com/repos/wigginslab/vc-matcher/comments{/number}","issue_comment_url":"https://api.github.com/repos/wigginslab/vc-matcher/issues/comments{/number}","contents_url":"https://api.github.com/repos/wigginslab/vc-matcher/contents/{+path}","compare_url":"https://api.github.com/repos/wigginslab/vc-matcher/compare/{base}...{head}","merges_url":"https://api.github.com/repos/wigginslab/vc-matcher/merges","archive_url":"https://api.github.com/repos/wigginslab/vc-matcher/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/wigginslab/vc-matcher/downloads","issues_url":"https://api.github.com/repos/wigginslab/vc-matcher/issues{/number}","pulls_url":"https://api.github.com/repos/wigginslab/vc-matcher/pulls{/number}","milestones_url":"https://api.github.com/repos/wigginslab/vc-matcher/milestones{/number}","notifications_url":"https://api.github.com/repos/wigginslab/vc-matcher/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/wigginslab/vc-matcher/labels{/name}","releases_url":"https://api.github.com/repos/wigginslab/vc-matcher/releases{/id}","created_at":"2013-12-08T19:06:22Z","updated_at":"2015-02-02T05:09:43Z","pushed_at":"2015-08-24T13:59:08Z","git_url":"git://github.com/wigginslab/vc-matcher.git","ssh_url":"git@github.com:wigginslab/vc-matcher.git","clone_url":"https://github.com/wigginslab/vc-matcher.git","svn_url":"https://github.com/wigginslab/vc-matcher","homepage":null,"size":19848,"stargazers_count":3,"watchers_count":3,"language":"OpenEdge ABL","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":1,"mirror_url":null,"open_issues_count":4,"forks":1,"open_issues":4,"watchers":3,"default_branch":"master"}},"base":{"label":"wigginslab:master","ref":"master","sha":"a4a0c985de87a3c8a5a48914b8b45c69d9212326","user":{"login":"wigginslab","id":739883,"avatar_url":"https://avatars.githubusercontent.com/u/739883?v=3","gravatar_id":"","url":"https://api.github.com/users/wigginslab","html_url":"https://github.com/wigginslab","followers_url":"https://api.github.com/users/wigginslab/followers","following_url":"https://api.github.com/users/wigginslab/following{/other_user}","gists_url":"https://api.github.com/users/wigginslab/gists{/gist_id}","starred_url":"https://api.github.com/users/wigginslab/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wigginslab/subscriptions","organizations_url":"https://api.github.com/users/wigginslab/orgs","repos_url":"https://api.github.com/users/wigginslab/repos","events_url":"https://api.github.com/users/wigginslab/events{/privacy}","received_events_url":"https://api.github.com/users/wigginslab/received_events","type":"Organization","site_admin":false},"repo":{"id":15029433,"name":"vc-matcher","full_name":"wigginslab/vc-matcher","owner":{"login":"wigginslab","id":739883,"avatar_url":"https://avatars.githubusercontent.com/u/739883?v=3","gravatar_id":"","url":"https://api.github.com/users/wigginslab","html_url":"https://github.com/wigginslab","followers_url":"https://api.github.com/users/wigginslab/followers","following_url":"https://api.github.com/users/wigginslab/following{/other_user}","gists_url":"https://api.github.com/users/wigginslab/gists{/gist_id}","starred_url":"https://api.github.com/users/wigginslab/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wigginslab/subscriptions","organizations_url":"https://api.github.com/users/wigginslab/orgs","repos_url":"https://api.github.com/users/wigginslab/repos","events_url":"https://api.github.com/users/wigginslab/events{/privacy}","received_events_url":"https://api.github.com/users/wigginslab/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/wigginslab/vc-matcher","description":"","fork":false,"url":"https://api.github.com/repos/wigginslab/vc-matcher","forks_url":"https://api.github.com/repos/wigginslab/vc-matcher/forks","keys_url":"https://api.github.com/repos/wigginslab/vc-matcher/keys{/key_id}","collaborators_url":"https://api.github.com/repos/wigginslab/vc-matcher/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/wigginslab/vc-matcher/teams","hooks_url":"https://api.github.com/repos/wigginslab/vc-matcher/hooks","issue_events_url":"https://api.github.com/repos/wigginslab/vc-matcher/issues/events{/number}","events_url":"https://api.github.com/repos/wigginslab/vc-matcher/events","assignees_url":"https://api.github.com/repos/wigginslab/vc-matcher/assignees{/user}","branches_url":"https://api.github.com/repos/wigginslab/vc-matcher/branches{/branch}","tags_url":"https://api.github.com/repos/wigginslab/vc-matcher/tags","blobs_url":"https://api.github.com/repos/wigginslab/vc-matcher/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/wigginslab/vc-matcher/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/wigginslab/vc-matcher/git/refs{/sha}","trees_url":"https://api.github.com/repos/wigginslab/vc-matcher/git/trees{/sha}","statuses_url":"https://api.github.com/repos/wigginslab/vc-matcher/statuses/{sha}","languages_url":"https://api.github.com/repos/wigginslab/vc-matcher/languages","stargazers_url":"https://api.github.com/repos/wigginslab/vc-matcher/stargazers","contributors_url":"https://api.github.com/repos/wigginslab/vc-matcher/contributors","subscribers_url":"https://api.github.com/repos/wigginslab/vc-matcher/subscribers","subscription_url":"https://api.github.com/repos/wigginslab/vc-matcher/subscription","commits_url":"https://api.github.com/repos/wigginslab/vc-matcher/commits{/sha}","git_commits_url":"https://api.github.com/repos/wigginslab/vc-matcher/git/commits{/sha}","comments_url":"https://api.github.com/repos/wigginslab/vc-matcher/comments{/number}","issue_comment_url":"https://api.github.com/repos/wigginslab/vc-matcher/issues/comments{/number}","contents_url":"https://api.github.com/repos/wigginslab/vc-matcher/contents/{+path}","compare_url":"https://api.github.com/repos/wigginslab/vc-matcher/compare/{base}...{head}","merges_url":"https://api.github.com/repos/wigginslab/vc-matcher/merges","archive_url":"https://api.github.com/repos/wigginslab/vc-matcher/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/wigginslab/vc-matcher/downloads","issues_url":"https://api.github.com/repos/wigginslab/vc-matcher/issues{/number}","pulls_url":"https://api.github.com/repos/wigginslab/vc-matcher/pulls{/number}","milestones_url":"https://api.github.com/repos/wigginslab/vc-matcher/milestones{/number}","notifications_url":"https://api.github.com/repos/wigginslab/vc-matcher/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/wigginslab/vc-matcher/labels{/name}","releases_url":"https://api.github.com/repos/wigginslab/vc-matcher/releases{/id}","created_at":"2013-12-08T19:06:22Z","updated_at":"2015-02-02T05:09:43Z","pushed_at":"2015-08-24T13:59:08Z","git_url":"git://github.com/wigginslab/vc-matcher.git","ssh_url":"git@github.com:wigginslab/vc-matcher.git","clone_url":"https://github.com/wigginslab/vc-matcher.git","svn_url":"https://github.com/wigginslab/vc-matcher","homepage":null,"size":19848,"stargazers_count":3,"watchers_count":3,"language":"OpenEdge ABL","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":1,"mirror_url":null,"open_issues_count":4,"forks":1,"open_issues":4,"watchers":3,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/wigginslab/vc-matcher/pulls/4"},"html":{"href":"https://github.com/wigginslab/vc-matcher/pull/4"},"issue":{"href":"https://api.github.com/repos/wigginslab/vc-matcher/issues/4"},"comments":{"href":"https://api.github.com/repos/wigginslab/vc-matcher/issues/4/comments"},"review_comments":{"href":"https://api.github.com/repos/wigginslab/vc-matcher/pulls/4/comments"},"review_comment":{"href":"https://api.github.com/repos/wigginslab/vc-matcher/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/wigginslab/vc-matcher/pulls/4/commits"},"statuses":{"href":"https://api.github.com/repos/wigginslab/vc-matcher/statuses/dd4de82ff7d7c5f771af41d422e0cb0f763ae12a"}},"merged":false,"mergeable":null,"mergeable_state":"unknown","merged_by":null,"comments":0,"review_comments":0,"commits":5,"additions":382,"deletions":1,"changed_files":7}}