{"action":"created","comment":{"url":"https://api.github.com/repos/Clever/redshifter/pulls/comments/23231778","id":23231778,"diff_hunk":"@@ -1 +1,22 @@\n # redshifter\n+\n+`redshifter` is responsible for getting data from any source into AWS Redshift for data analysis.\n+\n+## Motivation\n+\n+[AWS Redshift](http://aws.amazon.com/redshift/) is a columnar storage based data warehouse solution.\n+It is optimized for analysis and business intelligence and has integration with many tools.\n+\n+## Features\n+\n+Right now this repository contains a single script that exports OAuth authorize events data from\n+Mixpanel into Redshift via S3.","path":"README.md","position":13,"original_position":13,"commit_id":"eb75d41607fa6a59661f8ee962891b8366d5781c","original_commit_id":"f6a4b30b38755ac411a31415dc6c6c5f83461dd7","user":{"login":"rgarcia","id":72655,"avatar_url":"https://avatars.githubusercontent.com/u/72655?v=3","gravatar_id":"","url":"https://api.github.com/users/rgarcia","html_url":"https://github.com/rgarcia","followers_url":"https://api.github.com/users/rgarcia/followers","following_url":"https://api.github.com/users/rgarcia/following{/other_user}","gists_url":"https://api.github.com/users/rgarcia/gists{/gist_id}","starred_url":"https://api.github.com/users/rgarcia/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rgarcia/subscriptions","organizations_url":"https://api.github.com/users/rgarcia/orgs","repos_url":"https://api.github.com/users/rgarcia/repos","events_url":"https://api.github.com/users/rgarcia/events{/privacy}","received_events_url":"https://api.github.com/users/rgarcia/received_events","type":"User","site_admin":false},"body":":+1: seems easy to remove references to oauth here and in the filename `mixpanel_oauth_to_redshift.go`","created_at":"2015-01-20T16:02:16Z","updated_at":"2015-01-20T16:02:16Z","html_url":"https://github.com/Clever/redshifter/pull/1#discussion_r23231778","pull_request_url":"https://api.github.com/repos/Clever/redshifter/pulls/1","_links":{"self":{"href":"https://api.github.com/repos/Clever/redshifter/pulls/comments/23231778"},"html":{"href":"https://github.com/Clever/redshifter/pull/1#discussion_r23231778"},"pull_request":{"href":"https://api.github.com/repos/Clever/redshifter/pulls/1"}}},"pull_request":{"url":"https://api.github.com/repos/Clever/redshifter/pulls/1","id":27544521,"html_url":"https://github.com/Clever/redshifter/pull/1","diff_url":"https://github.com/Clever/redshifter/pull/1.diff","patch_url":"https://github.com/Clever/redshifter/pull/1.patch","issue_url":"https://api.github.com/repos/Clever/redshifter/issues/1","number":1,"state":"open","locked":false,"title":"Birthday","user":{"login":"agclever","id":10036433,"avatar_url":"https://avatars.githubusercontent.com/u/10036433?v=3","gravatar_id":"","url":"https://api.github.com/users/agclever","html_url":"https://github.com/agclever","followers_url":"https://api.github.com/users/agclever/followers","following_url":"https://api.github.com/users/agclever/following{/other_user}","gists_url":"https://api.github.com/users/agclever/gists{/gist_id}","starred_url":"https://api.github.com/users/agclever/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/agclever/subscriptions","organizations_url":"https://api.github.com/users/agclever/orgs","repos_url":"https://api.github.com/users/agclever/repos","events_url":"https://api.github.com/users/agclever/events{/privacy}","received_events_url":"https://api.github.com/users/agclever/received_events","type":"User","site_admin":false},"body":"This is an initial version of a script that copies Mixpanel OAuth data to Redshift via S3. See https://clever.atlassian.net/browse/INFRA-571 on more context.\r\n\r\nTested:\r\nRan command and verified that it works.\r\n\r\n```\r\n$ MIXPANEL_API_KEY=<mixpanel_key> \\\r\nMIXPANEL_API_SECRET=<mixpanel_secret> \\\r\nAWS_ACCESS_KEY_ID=<aws_key> \\ \r\nAWS_SECRET_ACCESS_KEY=<aws_secret> \r\nAWS_REGION='us-east-1' \\\r\nAWS_REDSHIFT_HOST=<redshift_host> \\\r\nAWS_REDSHIFT_PORT=5439 \\\r\nAWS_REDSHIFT_USER=<user> \\\r\nAWS_REDSHIFT_PASSWORD=<password> \\\r\nAWS_REDSHIFT_DB_NAME=dev \\\r\ngo run mixpanel_export.go\r\n```","created_at":"2015-01-16T23:18:56Z","updated_at":"2015-01-20T16:02:16Z","closed_at":null,"merged_at":null,"merge_commit_sha":"62917bf0da1a7bf80fae26b50955abb872c0a96f","assignee":{"login":"nathanleiby","id":102242,"avatar_url":"https://avatars.githubusercontent.com/u/102242?v=3","gravatar_id":"","url":"https://api.github.com/users/nathanleiby","html_url":"https://github.com/nathanleiby","followers_url":"https://api.github.com/users/nathanleiby/followers","following_url":"https://api.github.com/users/nathanleiby/following{/other_user}","gists_url":"https://api.github.com/users/nathanleiby/gists{/gist_id}","starred_url":"https://api.github.com/users/nathanleiby/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nathanleiby/subscriptions","organizations_url":"https://api.github.com/users/nathanleiby/orgs","repos_url":"https://api.github.com/users/nathanleiby/repos","events_url":"https://api.github.com/users/nathanleiby/events{/privacy}","received_events_url":"https://api.github.com/users/nathanleiby/received_events","type":"User","site_admin":false},"milestone":null,"commits_url":"https://api.github.com/repos/Clever/redshifter/pulls/1/commits","review_comments_url":"https://api.github.com/repos/Clever/redshifter/pulls/1/comments","review_comment_url":"https://api.github.com/repos/Clever/redshifter/pulls/comments/{number}","comments_url":"https://api.github.com/repos/Clever/redshifter/issues/1/comments","statuses_url":"https://api.github.com/repos/Clever/redshifter/statuses/eb75d41607fa6a59661f8ee962891b8366d5781c","head":{"label":"Clever:INFRA-571-birthday","ref":"INFRA-571-birthday","sha":"eb75d41607fa6a59661f8ee962891b8366d5781c","user":{"login":"Clever","id":1885509,"avatar_url":"https://avatars.githubusercontent.com/u/1885509?v=3","gravatar_id":"","url":"https://api.github.com/users/Clever","html_url":"https://github.com/Clever","followers_url":"https://api.github.com/users/Clever/followers","following_url":"https://api.github.com/users/Clever/following{/other_user}","gists_url":"https://api.github.com/users/Clever/gists{/gist_id}","starred_url":"https://api.github.com/users/Clever/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Clever/subscriptions","organizations_url":"https://api.github.com/users/Clever/orgs","repos_url":"https://api.github.com/users/Clever/repos","events_url":"https://api.github.com/users/Clever/events{/privacy}","received_events_url":"https://api.github.com/users/Clever/received_events","type":"Organization","site_admin":false},"repo":{"id":29368865,"name":"redshifter","full_name":"Clever/redshifter","owner":{"login":"Clever","id":1885509,"avatar_url":"https://avatars.githubusercontent.com/u/1885509?v=3","gravatar_id":"","url":"https://api.github.com/users/Clever","html_url":"https://github.com/Clever","followers_url":"https://api.github.com/users/Clever/followers","following_url":"https://api.github.com/users/Clever/following{/other_user}","gists_url":"https://api.github.com/users/Clever/gists{/gist_id}","starred_url":"https://api.github.com/users/Clever/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Clever/subscriptions","organizations_url":"https://api.github.com/users/Clever/orgs","repos_url":"https://api.github.com/users/Clever/repos","events_url":"https://api.github.com/users/Clever/events{/privacy}","received_events_url":"https://api.github.com/users/Clever/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/Clever/redshifter","description":"","fork":false,"url":"https://api.github.com/repos/Clever/redshifter","forks_url":"https://api.github.com/repos/Clever/redshifter/forks","keys_url":"https://api.github.com/repos/Clever/redshifter/keys{/key_id}","collaborators_url":"https://api.github.com/repos/Clever/redshifter/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/Clever/redshifter/teams","hooks_url":"https://api.github.com/repos/Clever/redshifter/hooks","issue_events_url":"https://api.github.com/repos/Clever/redshifter/issues/events{/number}","events_url":"https://api.github.com/repos/Clever/redshifter/events","assignees_url":"https://api.github.com/repos/Clever/redshifter/assignees{/user}","branches_url":"https://api.github.com/repos/Clever/redshifter/branches{/branch}","tags_url":"https://api.github.com/repos/Clever/redshifter/tags","blobs_url":"https://api.github.com/repos/Clever/redshifter/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/Clever/redshifter/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/Clever/redshifter/git/refs{/sha}","trees_url":"https://api.github.com/repos/Clever/redshifter/git/trees{/sha}","statuses_url":"https://api.github.com/repos/Clever/redshifter/statuses/{sha}","languages_url":"https://api.github.com/repos/Clever/redshifter/languages","stargazers_url":"https://api.github.com/repos/Clever/redshifter/stargazers","contributors_url":"https://api.github.com/repos/Clever/redshifter/contributors","subscribers_url":"https://api.github.com/repos/Clever/redshifter/subscribers","subscription_url":"https://api.github.com/repos/Clever/redshifter/subscription","commits_url":"https://api.github.com/repos/Clever/redshifter/commits{/sha}","git_commits_url":"https://api.github.com/repos/Clever/redshifter/git/commits{/sha}","comments_url":"https://api.github.com/repos/Clever/redshifter/comments{/number}","issue_comment_url":"https://api.github.com/repos/Clever/redshifter/issues/comments/{number}","contents_url":"https://api.github.com/repos/Clever/redshifter/contents/{+path}","compare_url":"https://api.github.com/repos/Clever/redshifter/compare/{base}...{head}","merges_url":"https://api.github.com/repos/Clever/redshifter/merges","archive_url":"https://api.github.com/repos/Clever/redshifter/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/Clever/redshifter/downloads","issues_url":"https://api.github.com/repos/Clever/redshifter/issues{/number}","pulls_url":"https://api.github.com/repos/Clever/redshifter/pulls{/number}","milestones_url":"https://api.github.com/repos/Clever/redshifter/milestones{/number}","notifications_url":"https://api.github.com/repos/Clever/redshifter/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/Clever/redshifter/labels{/name}","releases_url":"https://api.github.com/repos/Clever/redshifter/releases{/id}","created_at":"2015-01-16T21:35:10Z","updated_at":"2015-01-16T21:35:10Z","pushed_at":"2015-01-20T02:10:40Z","git_url":"git://github.com/Clever/redshifter.git","ssh_url":"git@github.com:Clever/redshifter.git","clone_url":"https://github.com/Clever/redshifter.git","svn_url":"https://github.com/Clever/redshifter","homepage":null,"size":0,"stargazers_count":0,"watchers_count":0,"language":null,"has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":1,"forks":0,"open_issues":1,"watchers":0,"default_branch":"master"}},"base":{"label":"Clever:master","ref":"master","sha":"c37a201c9a04fb458fc544a9954ab7974cb0768f","user":{"login":"Clever","id":1885509,"avatar_url":"https://avatars.githubusercontent.com/u/1885509?v=3","gravatar_id":"","url":"https://api.github.com/users/Clever","html_url":"https://github.com/Clever","followers_url":"https://api.github.com/users/Clever/followers","following_url":"https://api.github.com/users/Clever/following{/other_user}","gists_url":"https://api.github.com/users/Clever/gists{/gist_id}","starred_url":"https://api.github.com/users/Clever/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Clever/subscriptions","organizations_url":"https://api.github.com/users/Clever/orgs","repos_url":"https://api.github.com/users/Clever/repos","events_url":"https://api.github.com/users/Clever/events{/privacy}","received_events_url":"https://api.github.com/users/Clever/received_events","type":"Organization","site_admin":false},"repo":{"id":29368865,"name":"redshifter","full_name":"Clever/redshifter","owner":{"login":"Clever","id":1885509,"avatar_url":"https://avatars.githubusercontent.com/u/1885509?v=3","gravatar_id":"","url":"https://api.github.com/users/Clever","html_url":"https://github.com/Clever","followers_url":"https://api.github.com/users/Clever/followers","following_url":"https://api.github.com/users/Clever/following{/other_user}","gists_url":"https://api.github.com/users/Clever/gists{/gist_id}","starred_url":"https://api.github.com/users/Clever/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Clever/subscriptions","organizations_url":"https://api.github.com/users/Clever/orgs","repos_url":"https://api.github.com/users/Clever/repos","events_url":"https://api.github.com/users/Clever/events{/privacy}","received_events_url":"https://api.github.com/users/Clever/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/Clever/redshifter","description":"","fork":false,"url":"https://api.github.com/repos/Clever/redshifter","forks_url":"https://api.github.com/repos/Clever/redshifter/forks","keys_url":"https://api.github.com/repos/Clever/redshifter/keys{/key_id}","collaborators_url":"https://api.github.com/repos/Clever/redshifter/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/Clever/redshifter/teams","hooks_url":"https://api.github.com/repos/Clever/redshifter/hooks","issue_events_url":"https://api.github.com/repos/Clever/redshifter/issues/events{/number}","events_url":"https://api.github.com/repos/Clever/redshifter/events","assignees_url":"https://api.github.com/repos/Clever/redshifter/assignees{/user}","branches_url":"https://api.github.com/repos/Clever/redshifter/branches{/branch}","tags_url":"https://api.github.com/repos/Clever/redshifter/tags","blobs_url":"https://api.github.com/repos/Clever/redshifter/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/Clever/redshifter/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/Clever/redshifter/git/refs{/sha}","trees_url":"https://api.github.com/repos/Clever/redshifter/git/trees{/sha}","statuses_url":"https://api.github.com/repos/Clever/redshifter/statuses/{sha}","languages_url":"https://api.github.com/repos/Clever/redshifter/languages","stargazers_url":"https://api.github.com/repos/Clever/redshifter/stargazers","contributors_url":"https://api.github.com/repos/Clever/redshifter/contributors","subscribers_url":"https://api.github.com/repos/Clever/redshifter/subscribers","subscription_url":"https://api.github.com/repos/Clever/redshifter/subscription","commits_url":"https://api.github.com/repos/Clever/redshifter/commits{/sha}","git_commits_url":"https://api.github.com/repos/Clever/redshifter/git/commits{/sha}","comments_url":"https://api.github.com/repos/Clever/redshifter/comments{/number}","issue_comment_url":"https://api.github.com/repos/Clever/redshifter/issues/comments/{number}","contents_url":"https://api.github.com/repos/Clever/redshifter/contents/{+path}","compare_url":"https://api.github.com/repos/Clever/redshifter/compare/{base}...{head}","merges_url":"https://api.github.com/repos/Clever/redshifter/merges","archive_url":"https://api.github.com/repos/Clever/redshifter/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/Clever/redshifter/downloads","issues_url":"https://api.github.com/repos/Clever/redshifter/issues{/number}","pulls_url":"https://api.github.com/repos/Clever/redshifter/pulls{/number}","milestones_url":"https://api.github.com/repos/Clever/redshifter/milestones{/number}","notifications_url":"https://api.github.com/repos/Clever/redshifter/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/Clever/redshifter/labels{/name}","releases_url":"https://api.github.com/repos/Clever/redshifter/releases{/id}","created_at":"2015-01-16T21:35:10Z","updated_at":"2015-01-16T21:35:10Z","pushed_at":"2015-01-20T02:10:40Z","git_url":"git://github.com/Clever/redshifter.git","ssh_url":"git@github.com:Clever/redshifter.git","clone_url":"https://github.com/Clever/redshifter.git","svn_url":"https://github.com/Clever/redshifter","homepage":null,"size":0,"stargazers_count":0,"watchers_count":0,"language":null,"has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":1,"forks":0,"open_issues":1,"watchers":0,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/Clever/redshifter/pulls/1"},"html":{"href":"https://github.com/Clever/redshifter/pull/1"},"issue":{"href":"https://api.github.com/repos/Clever/redshifter/issues/1"},"comments":{"href":"https://api.github.com/repos/Clever/redshifter/issues/1/comments"},"review_comments":{"href":"https://api.github.com/repos/Clever/redshifter/pulls/1/comments"},"review_comment":{"href":"https://api.github.com/repos/Clever/redshifter/pulls/comments/{number}"},"commits":{"href":"https://api.github.com/repos/Clever/redshifter/pulls/1/commits"},"statuses":{"href":"https://api.github.com/repos/Clever/redshifter/statuses/eb75d41607fa6a59661f8ee962891b8366d5781c"}}}}