{"action":"created","comment":{"url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/comments/29633149","id":29633149,"diff_hunk":"@@ -0,0 +1,59 @@\n+Realtime Twitter To HBase Adapter Configuration\n+===============================================\n+\n+Lets say we want to fetch Tweets from Twitter in Realtime and persist it in an HBase Table.\n+\n+ETL Realtime Template can be used to create an Adapter that reads from a Realtime Source and persists it to a Sink. In this example, we will read messages from Twitter in realtime and use a TableSink to write the Tweets to HBase.\n+\n+The config.json contains a sample Adapter configuration that you can use to accomplish the above task. We choose the ETL Realtime Application Template since we want to create a Realtime Adapter. \n+We set the Application Template name using the \"template\" property.\n+\n+We chose the Source to be Twitter Source and provide the OAuth credentials as properties to the Source. Since we want to persist the Tweets to HBase, we use a Table Sink. For the Table Sink, we choose the table name to be tweetTable (which will be created if the Table doesn't exist already) and we choose the row key to be id field of the Record emitted by the Twitter Source.\n+\n+For setting the Source name, we use the \"source\" property. The Twitter Source expects four properties (OAuth credentials for Twitter).\n+\n+- AccessToken\n+- AccessTokenSecret\n+- ConsumerKey\n+- ConsumerSecret\n+\n+Similarly, for selecting the Sink, we use the \"sink\" property. The Table Sink expects two properties.\n+\n+- name : Name of the Table Dataset.\n+- schema.row.field : The field which is used as the row key in the Table.\n+\n+Since we don't use any transforms in this Adapter, we leave that as an empty array.\n+\n+::\n+\n+You can create and start the Adapter by using the CDAP CLI (or the UI, for a more visual approach).","path":"RealtimeTwitterToHBase/README.rst","position":29,"original_position":29,"commit_id":"f19e19aafd163c6f95da4b589e556359ee62dc46","original_commit_id":"f19e19aafd163c6f95da4b589e556359ee62dc46","user":{"login":"jwang47","id":1084704,"avatar_url":"https://avatars.githubusercontent.com/u/1084704?v=3","gravatar_id":"","url":"https://api.github.com/users/jwang47","html_url":"https://github.com/jwang47","followers_url":"https://api.github.com/users/jwang47/followers","following_url":"https://api.github.com/users/jwang47/following{/other_user}","gists_url":"https://api.github.com/users/jwang47/gists{/gist_id}","starred_url":"https://api.github.com/users/jwang47/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jwang47/subscriptions","organizations_url":"https://api.github.com/users/jwang47/orgs","repos_url":"https://api.github.com/users/jwang47/repos","events_url":"https://api.github.com/users/jwang47/events{/privacy}","received_events_url":"https://api.github.com/users/jwang47/received_events","type":"User","site_admin":false},"body":"Actually I don't think this guide will work well if the reader uses the UI, since they have to figure out how to configure an adapter in the UI that matches the configuration from config.json.","created_at":"2015-05-04T23:16:36Z","updated_at":"2015-05-04T23:16:36Z","html_url":"https://github.com/cdap-guides/cdap-etl-adapter-guide/pull/1#discussion_r29633149","pull_request_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/1","_links":{"self":{"href":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/comments/29633149"},"html":{"href":"https://github.com/cdap-guides/cdap-etl-adapter-guide/pull/1#discussion_r29633149"},"pull_request":{"href":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/1"}}},"pull_request":{"url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/1","id":34669752,"html_url":"https://github.com/cdap-guides/cdap-etl-adapter-guide/pull/1","diff_url":"https://github.com/cdap-guides/cdap-etl-adapter-guide/pull/1.diff","patch_url":"https://github.com/cdap-guides/cdap-etl-adapter-guide/pull/1.patch","issue_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/issues/1","number":1,"state":"open","locked":false,"title":"Checkin of Twitter To HBase example","user":{"login":"gokulavasan","id":558459,"avatar_url":"https://avatars.githubusercontent.com/u/558459?v=3","gravatar_id":"","url":"https://api.github.com/users/gokulavasan","html_url":"https://github.com/gokulavasan","followers_url":"https://api.github.com/users/gokulavasan/followers","following_url":"https://api.github.com/users/gokulavasan/following{/other_user}","gists_url":"https://api.github.com/users/gokulavasan/gists{/gist_id}","starred_url":"https://api.github.com/users/gokulavasan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gokulavasan/subscriptions","organizations_url":"https://api.github.com/users/gokulavasan/orgs","repos_url":"https://api.github.com/users/gokulavasan/repos","events_url":"https://api.github.com/users/gokulavasan/events{/privacy}","received_events_url":"https://api.github.com/users/gokulavasan/received_events","type":"User","site_admin":false},"body":"","created_at":"2015-05-04T20:05:44Z","updated_at":"2015-05-04T23:16:36Z","closed_at":null,"merged_at":null,"merge_commit_sha":"5a58bdc517ab2861636917f3bad7c174ba61cab3","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/1/commits","review_comments_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/1/comments","review_comment_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/comments{/number}","comments_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/issues/1/comments","statuses_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/statuses/f19e19aafd163c6f95da4b589e556359ee62dc46","head":{"label":"cdap-guides:feature/kafka-config","ref":"feature/kafka-config","sha":"f19e19aafd163c6f95da4b589e556359ee62dc46","user":{"login":"cdap-guides","id":9012786,"avatar_url":"https://avatars.githubusercontent.com/u/9012786?v=3","gravatar_id":"","url":"https://api.github.com/users/cdap-guides","html_url":"https://github.com/cdap-guides","followers_url":"https://api.github.com/users/cdap-guides/followers","following_url":"https://api.github.com/users/cdap-guides/following{/other_user}","gists_url":"https://api.github.com/users/cdap-guides/gists{/gist_id}","starred_url":"https://api.github.com/users/cdap-guides/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cdap-guides/subscriptions","organizations_url":"https://api.github.com/users/cdap-guides/orgs","repos_url":"https://api.github.com/users/cdap-guides/repos","events_url":"https://api.github.com/users/cdap-guides/events{/privacy}","received_events_url":"https://api.github.com/users/cdap-guides/received_events","type":"Organization","site_admin":false},"repo":{"id":35052304,"name":"cdap-etl-adapter-guide","full_name":"cdap-guides/cdap-etl-adapter-guide","owner":{"login":"cdap-guides","id":9012786,"avatar_url":"https://avatars.githubusercontent.com/u/9012786?v=3","gravatar_id":"","url":"https://api.github.com/users/cdap-guides","html_url":"https://github.com/cdap-guides","followers_url":"https://api.github.com/users/cdap-guides/followers","following_url":"https://api.github.com/users/cdap-guides/following{/other_user}","gists_url":"https://api.github.com/users/cdap-guides/gists{/gist_id}","starred_url":"https://api.github.com/users/cdap-guides/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cdap-guides/subscriptions","organizations_url":"https://api.github.com/users/cdap-guides/orgs","repos_url":"https://api.github.com/users/cdap-guides/repos","events_url":"https://api.github.com/users/cdap-guides/events{/privacy}","received_events_url":"https://api.github.com/users/cdap-guides/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/cdap-guides/cdap-etl-adapter-guide","description":"Guide to configure ETL adapters","fork":false,"url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide","forks_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/forks","keys_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/keys{/key_id}","collaborators_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/teams","hooks_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/hooks","issue_events_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/issues/events{/number}","events_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/events","assignees_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/assignees{/user}","branches_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/branches{/branch}","tags_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/tags","blobs_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/git/refs{/sha}","trees_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/git/trees{/sha}","statuses_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/statuses/{sha}","languages_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/languages","stargazers_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/stargazers","contributors_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/contributors","subscribers_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/subscribers","subscription_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/subscription","commits_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/commits{/sha}","git_commits_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/git/commits{/sha}","comments_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/comments{/number}","issue_comment_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/issues/comments{/number}","contents_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/contents/{+path}","compare_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/compare/{base}...{head}","merges_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/merges","archive_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/downloads","issues_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/issues{/number}","pulls_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls{/number}","milestones_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/milestones{/number}","notifications_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/labels{/name}","releases_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/releases{/id}","created_at":"2015-05-04T18:36:32Z","updated_at":"2015-05-04T20:10:25Z","pushed_at":"2015-05-04T23:16:29Z","git_url":"git://github.com/cdap-guides/cdap-etl-adapter-guide.git","ssh_url":"git@github.com:cdap-guides/cdap-etl-adapter-guide.git","clone_url":"https://github.com/cdap-guides/cdap-etl-adapter-guide.git","svn_url":"https://github.com/cdap-guides/cdap-etl-adapter-guide","homepage":null,"size":0,"stargazers_count":0,"watchers_count":0,"language":null,"has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":2,"forks":0,"open_issues":2,"watchers":0,"default_branch":"develop"}},"base":{"label":"cdap-guides:develop","ref":"develop","sha":"3c221794db2a5584df28775e6ec09e5b4a556452","user":{"login":"cdap-guides","id":9012786,"avatar_url":"https://avatars.githubusercontent.com/u/9012786?v=3","gravatar_id":"","url":"https://api.github.com/users/cdap-guides","html_url":"https://github.com/cdap-guides","followers_url":"https://api.github.com/users/cdap-guides/followers","following_url":"https://api.github.com/users/cdap-guides/following{/other_user}","gists_url":"https://api.github.com/users/cdap-guides/gists{/gist_id}","starred_url":"https://api.github.com/users/cdap-guides/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cdap-guides/subscriptions","organizations_url":"https://api.github.com/users/cdap-guides/orgs","repos_url":"https://api.github.com/users/cdap-guides/repos","events_url":"https://api.github.com/users/cdap-guides/events{/privacy}","received_events_url":"https://api.github.com/users/cdap-guides/received_events","type":"Organization","site_admin":false},"repo":{"id":35052304,"name":"cdap-etl-adapter-guide","full_name":"cdap-guides/cdap-etl-adapter-guide","owner":{"login":"cdap-guides","id":9012786,"avatar_url":"https://avatars.githubusercontent.com/u/9012786?v=3","gravatar_id":"","url":"https://api.github.com/users/cdap-guides","html_url":"https://github.com/cdap-guides","followers_url":"https://api.github.com/users/cdap-guides/followers","following_url":"https://api.github.com/users/cdap-guides/following{/other_user}","gists_url":"https://api.github.com/users/cdap-guides/gists{/gist_id}","starred_url":"https://api.github.com/users/cdap-guides/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cdap-guides/subscriptions","organizations_url":"https://api.github.com/users/cdap-guides/orgs","repos_url":"https://api.github.com/users/cdap-guides/repos","events_url":"https://api.github.com/users/cdap-guides/events{/privacy}","received_events_url":"https://api.github.com/users/cdap-guides/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/cdap-guides/cdap-etl-adapter-guide","description":"Guide to configure ETL adapters","fork":false,"url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide","forks_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/forks","keys_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/keys{/key_id}","collaborators_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/teams","hooks_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/hooks","issue_events_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/issues/events{/number}","events_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/events","assignees_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/assignees{/user}","branches_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/branches{/branch}","tags_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/tags","blobs_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/git/refs{/sha}","trees_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/git/trees{/sha}","statuses_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/statuses/{sha}","languages_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/languages","stargazers_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/stargazers","contributors_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/contributors","subscribers_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/subscribers","subscription_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/subscription","commits_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/commits{/sha}","git_commits_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/git/commits{/sha}","comments_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/comments{/number}","issue_comment_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/issues/comments{/number}","contents_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/contents/{+path}","compare_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/compare/{base}...{head}","merges_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/merges","archive_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/downloads","issues_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/issues{/number}","pulls_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls{/number}","milestones_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/milestones{/number}","notifications_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/labels{/name}","releases_url":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/releases{/id}","created_at":"2015-05-04T18:36:32Z","updated_at":"2015-05-04T20:10:25Z","pushed_at":"2015-05-04T23:16:29Z","git_url":"git://github.com/cdap-guides/cdap-etl-adapter-guide.git","ssh_url":"git@github.com:cdap-guides/cdap-etl-adapter-guide.git","clone_url":"https://github.com/cdap-guides/cdap-etl-adapter-guide.git","svn_url":"https://github.com/cdap-guides/cdap-etl-adapter-guide","homepage":null,"size":0,"stargazers_count":0,"watchers_count":0,"language":null,"has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":2,"forks":0,"open_issues":2,"watchers":0,"default_branch":"develop"}},"_links":{"self":{"href":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/1"},"html":{"href":"https://github.com/cdap-guides/cdap-etl-adapter-guide/pull/1"},"issue":{"href":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/issues/1"},"comments":{"href":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/issues/1/comments"},"review_comments":{"href":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/1/comments"},"review_comment":{"href":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/pulls/1/commits"},"statuses":{"href":"https://api.github.com/repos/cdap-guides/cdap-etl-adapter-guide/statuses/f19e19aafd163c6f95da4b589e556359ee62dc46"}}}}