{"action":"created","comment":{"url":"https://api.github.com/repos/bloomberg/chef-bach/pulls/comments/27896901","id":27896901,"diff_hunk":"@@ -0,0 +1,24 @@\n+# Setup HDFSDU config\n+\n+set_hosts\n+\n+@rm_hosts = node[:bcpc][:hadoop][:rm_hosts]\n+if defined?@rm_hosts and not @rm_hosts.empty? then\n+   node.override[:hdfsdu][:jobtracker] = \"#{float_host(@rm_hosts.first[:hostname])}:8032\" \n+end\n+\n+node.override[:hdfsdu][:namenode] = \"hdfs://#{node.chef_environment}\"\n+\n+@oozie_hosts = node[:bcpc][:hadoop][:oozie_hosts]\n+if defined?@oozie_hosts and not @oozie_hosts.empty? then\n+   node.override[:hdfsdu][:oozie_url] = \"http://#{float_host(@oozie_hosts.first[:hostname])}:11000/oozie\"\n+end\n+\n+node.override[:hdfsdu][:pig_jar] = '/usr/lib/pig/pig-0.12.0.2.0.11.0-1.jar'\n+\n+node.override[:hdfsdu][:oozie_frequency] = 120\n+node.override[:hdfsdu][:oozie_timezone] = \"EST\"\n+node.override[:hdfsdu][:oozie_start_time] = %x[date -u \"+%Y-%m-%dT%H:00Z\"].strip \n+# Setting the end date to 6 months from today?\n+#node.override[:hdfsdu][:oozie_end_time] = %x[date -v+6m -u \"+%Y-%m-%dT%H:00Z\"].strip\n+node.override[:hdfsdu][:oozie_end_time] = \"2015-12-31T21:00Z\"","path":"cookbooks/bcpc-hadoop/recipes/hdfsdu_pre_fetch.rb","position":24,"original_position":24,"commit_id":"5564fac5683e179ed480a10e155521641a366a5c","original_commit_id":"5564fac5683e179ed480a10e155521641a366a5c","user":{"login":"cbaenziger","id":4192761,"avatar_url":"https://avatars.githubusercontent.com/u/4192761?v=3","gravatar_id":"","url":"https://api.github.com/users/cbaenziger","html_url":"https://github.com/cbaenziger","followers_url":"https://api.github.com/users/cbaenziger/followers","following_url":"https://api.github.com/users/cbaenziger/following{/other_user}","gists_url":"https://api.github.com/users/cbaenziger/gists{/gist_id}","starred_url":"https://api.github.com/users/cbaenziger/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cbaenziger/subscriptions","organizations_url":"https://api.github.com/users/cbaenziger/orgs","repos_url":"https://api.github.com/users/cbaenziger/repos","events_url":"https://api.github.com/users/cbaenziger/events{/privacy}","received_events_url":"https://api.github.com/users/cbaenziger/received_events","type":"User","site_admin":false},"body":"If there is a forever option in Oozie, that seems like the right answer here rather than an arbitary date (even if it's a dynamically long date).\r\n\r\nOtherwise, if the job gets re-submitted when the coordinator expires, simply submitting the job for the current date plus a week could likely be useful too.","created_at":"2015-04-07T16:53:40Z","updated_at":"2015-04-07T16:53:40Z","html_url":"https://github.com/bloomberg/chef-bach/pull/86#discussion_r27896901","pull_request_url":"https://api.github.com/repos/bloomberg/chef-bach/pulls/86","_links":{"self":{"href":"https://api.github.com/repos/bloomberg/chef-bach/pulls/comments/27896901"},"html":{"href":"https://github.com/bloomberg/chef-bach/pull/86#discussion_r27896901"},"pull_request":{"href":"https://api.github.com/repos/bloomberg/chef-bach/pulls/86"}}},"pull_request":{"url":"https://api.github.com/repos/bloomberg/chef-bach/pulls/86","id":29306252,"html_url":"https://github.com/bloomberg/chef-bach/pull/86","diff_url":"https://github.com/bloomberg/chef-bach/pull/86.diff","patch_url":"https://github.com/bloomberg/chef-bach/pull/86.patch","issue_url":"https://api.github.com/repos/bloomberg/chef-bach/issues/86","number":86,"state":"open","locked":false,"title":"Add hdfsdu cookbook","user":{"login":"kiiranh","id":4454094,"avatar_url":"https://avatars.githubusercontent.com/u/4454094?v=3","gravatar_id":"","url":"https://api.github.com/users/kiiranh","html_url":"https://github.com/kiiranh","followers_url":"https://api.github.com/users/kiiranh/followers","following_url":"https://api.github.com/users/kiiranh/following{/other_user}","gists_url":"https://api.github.com/users/kiiranh/gists{/gist_id}","starred_url":"https://api.github.com/users/kiiranh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kiiranh/subscriptions","organizations_url":"https://api.github.com/users/kiiranh/orgs","repos_url":"https://api.github.com/users/kiiranh/repos","events_url":"https://api.github.com/users/kiiranh/events{/privacy}","received_events_url":"https://api.github.com/users/kiiranh/received_events","type":"User","site_admin":false},"body":"This PR provides hdfsdu cookbook to build and deploy HDFSDU tool.\r\nHDFSDU helps visualize the HDFS disk usage.\r\nNote: Oozie, HDFS, Pig jar path related attributes have to be overridden in a wrapper recipe or environment file.","created_at":"2015-02-13T22:52:51Z","updated_at":"2015-04-07T16:53:40Z","closed_at":null,"merged_at":null,"merge_commit_sha":"4642d06603d6232741a8f89a3888d449bb0fe340","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/bloomberg/chef-bach/pulls/86/commits","review_comments_url":"https://api.github.com/repos/bloomberg/chef-bach/pulls/86/comments","review_comment_url":"https://api.github.com/repos/bloomberg/chef-bach/pulls/comments{/number}","comments_url":"https://api.github.com/repos/bloomberg/chef-bach/issues/86/comments","statuses_url":"https://api.github.com/repos/bloomberg/chef-bach/statuses/5564fac5683e179ed480a10e155521641a366a5c","head":{"label":"kiiranh:hdfsdu","ref":"hdfsdu","sha":"5564fac5683e179ed480a10e155521641a366a5c","user":{"login":"kiiranh","id":4454094,"avatar_url":"https://avatars.githubusercontent.com/u/4454094?v=3","gravatar_id":"","url":"https://api.github.com/users/kiiranh","html_url":"https://github.com/kiiranh","followers_url":"https://api.github.com/users/kiiranh/followers","following_url":"https://api.github.com/users/kiiranh/following{/other_user}","gists_url":"https://api.github.com/users/kiiranh/gists{/gist_id}","starred_url":"https://api.github.com/users/kiiranh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kiiranh/subscriptions","organizations_url":"https://api.github.com/users/kiiranh/orgs","repos_url":"https://api.github.com/users/kiiranh/repos","events_url":"https://api.github.com/users/kiiranh/events{/privacy}","received_events_url":"https://api.github.com/users/kiiranh/received_events","type":"User","site_admin":false},"repo":{"id":25661154,"name":"chef-bach","full_name":"kiiranh/chef-bach","owner":{"login":"kiiranh","id":4454094,"avatar_url":"https://avatars.githubusercontent.com/u/4454094?v=3","gravatar_id":"","url":"https://api.github.com/users/kiiranh","html_url":"https://github.com/kiiranh","followers_url":"https://api.github.com/users/kiiranh/followers","following_url":"https://api.github.com/users/kiiranh/following{/other_user}","gists_url":"https://api.github.com/users/kiiranh/gists{/gist_id}","starred_url":"https://api.github.com/users/kiiranh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kiiranh/subscriptions","organizations_url":"https://api.github.com/users/kiiranh/orgs","repos_url":"https://api.github.com/users/kiiranh/repos","events_url":"https://api.github.com/users/kiiranh/events{/privacy}","received_events_url":"https://api.github.com/users/kiiranh/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/kiiranh/chef-bach","description":"Chef recipes for Bloomberg's deployment of Hadoop and related components","fork":true,"url":"https://api.github.com/repos/kiiranh/chef-bach","forks_url":"https://api.github.com/repos/kiiranh/chef-bach/forks","keys_url":"https://api.github.com/repos/kiiranh/chef-bach/keys{/key_id}","collaborators_url":"https://api.github.com/repos/kiiranh/chef-bach/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/kiiranh/chef-bach/teams","hooks_url":"https://api.github.com/repos/kiiranh/chef-bach/hooks","issue_events_url":"https://api.github.com/repos/kiiranh/chef-bach/issues/events{/number}","events_url":"https://api.github.com/repos/kiiranh/chef-bach/events","assignees_url":"https://api.github.com/repos/kiiranh/chef-bach/assignees{/user}","branches_url":"https://api.github.com/repos/kiiranh/chef-bach/branches{/branch}","tags_url":"https://api.github.com/repos/kiiranh/chef-bach/tags","blobs_url":"https://api.github.com/repos/kiiranh/chef-bach/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/kiiranh/chef-bach/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/kiiranh/chef-bach/git/refs{/sha}","trees_url":"https://api.github.com/repos/kiiranh/chef-bach/git/trees{/sha}","statuses_url":"https://api.github.com/repos/kiiranh/chef-bach/statuses/{sha}","languages_url":"https://api.github.com/repos/kiiranh/chef-bach/languages","stargazers_url":"https://api.github.com/repos/kiiranh/chef-bach/stargazers","contributors_url":"https://api.github.com/repos/kiiranh/chef-bach/contributors","subscribers_url":"https://api.github.com/repos/kiiranh/chef-bach/subscribers","subscription_url":"https://api.github.com/repos/kiiranh/chef-bach/subscription","commits_url":"https://api.github.com/repos/kiiranh/chef-bach/commits{/sha}","git_commits_url":"https://api.github.com/repos/kiiranh/chef-bach/git/commits{/sha}","comments_url":"https://api.github.com/repos/kiiranh/chef-bach/comments{/number}","issue_comment_url":"https://api.github.com/repos/kiiranh/chef-bach/issues/comments{/number}","contents_url":"https://api.github.com/repos/kiiranh/chef-bach/contents/{+path}","compare_url":"https://api.github.com/repos/kiiranh/chef-bach/compare/{base}...{head}","merges_url":"https://api.github.com/repos/kiiranh/chef-bach/merges","archive_url":"https://api.github.com/repos/kiiranh/chef-bach/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/kiiranh/chef-bach/downloads","issues_url":"https://api.github.com/repos/kiiranh/chef-bach/issues{/number}","pulls_url":"https://api.github.com/repos/kiiranh/chef-bach/pulls{/number}","milestones_url":"https://api.github.com/repos/kiiranh/chef-bach/milestones{/number}","notifications_url":"https://api.github.com/repos/kiiranh/chef-bach/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/kiiranh/chef-bach/labels{/name}","releases_url":"https://api.github.com/repos/kiiranh/chef-bach/releases{/id}","created_at":"2014-10-23T22:44:35Z","updated_at":"2015-03-30T17:34:56Z","pushed_at":"2015-04-01T16:24:47Z","git_url":"git://github.com/kiiranh/chef-bach.git","ssh_url":"git@github.com:kiiranh/chef-bach.git","clone_url":"https://github.com/kiiranh/chef-bach.git","svn_url":"https://github.com/kiiranh/chef-bach","homepage":null,"size":2462,"stargazers_count":0,"watchers_count":0,"language":"HTML","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"bloomberg:master","ref":"master","sha":"dba62ec446a12ef8df4fee66d6979c80c5c2ed3e","user":{"login":"bloomberg","id":1416818,"avatar_url":"https://avatars.githubusercontent.com/u/1416818?v=3","gravatar_id":"","url":"https://api.github.com/users/bloomberg","html_url":"https://github.com/bloomberg","followers_url":"https://api.github.com/users/bloomberg/followers","following_url":"https://api.github.com/users/bloomberg/following{/other_user}","gists_url":"https://api.github.com/users/bloomberg/gists{/gist_id}","starred_url":"https://api.github.com/users/bloomberg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bloomberg/subscriptions","organizations_url":"https://api.github.com/users/bloomberg/orgs","repos_url":"https://api.github.com/users/bloomberg/repos","events_url":"https://api.github.com/users/bloomberg/events{/privacy}","received_events_url":"https://api.github.com/users/bloomberg/received_events","type":"Organization","site_admin":false},"repo":{"id":24933148,"name":"chef-bach","full_name":"bloomberg/chef-bach","owner":{"login":"bloomberg","id":1416818,"avatar_url":"https://avatars.githubusercontent.com/u/1416818?v=3","gravatar_id":"","url":"https://api.github.com/users/bloomberg","html_url":"https://github.com/bloomberg","followers_url":"https://api.github.com/users/bloomberg/followers","following_url":"https://api.github.com/users/bloomberg/following{/other_user}","gists_url":"https://api.github.com/users/bloomberg/gists{/gist_id}","starred_url":"https://api.github.com/users/bloomberg/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bloomberg/subscriptions","organizations_url":"https://api.github.com/users/bloomberg/orgs","repos_url":"https://api.github.com/users/bloomberg/repos","events_url":"https://api.github.com/users/bloomberg/events{/privacy}","received_events_url":"https://api.github.com/users/bloomberg/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/bloomberg/chef-bach","description":"Chef recipes for Bloomberg's deployment of Hadoop and related components","fork":false,"url":"https://api.github.com/repos/bloomberg/chef-bach","forks_url":"https://api.github.com/repos/bloomberg/chef-bach/forks","keys_url":"https://api.github.com/repos/bloomberg/chef-bach/keys{/key_id}","collaborators_url":"https://api.github.com/repos/bloomberg/chef-bach/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/bloomberg/chef-bach/teams","hooks_url":"https://api.github.com/repos/bloomberg/chef-bach/hooks","issue_events_url":"https://api.github.com/repos/bloomberg/chef-bach/issues/events{/number}","events_url":"https://api.github.com/repos/bloomberg/chef-bach/events","assignees_url":"https://api.github.com/repos/bloomberg/chef-bach/assignees{/user}","branches_url":"https://api.github.com/repos/bloomberg/chef-bach/branches{/branch}","tags_url":"https://api.github.com/repos/bloomberg/chef-bach/tags","blobs_url":"https://api.github.com/repos/bloomberg/chef-bach/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/bloomberg/chef-bach/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/bloomberg/chef-bach/git/refs{/sha}","trees_url":"https://api.github.com/repos/bloomberg/chef-bach/git/trees{/sha}","statuses_url":"https://api.github.com/repos/bloomberg/chef-bach/statuses/{sha}","languages_url":"https://api.github.com/repos/bloomberg/chef-bach/languages","stargazers_url":"https://api.github.com/repos/bloomberg/chef-bach/stargazers","contributors_url":"https://api.github.com/repos/bloomberg/chef-bach/contributors","subscribers_url":"https://api.github.com/repos/bloomberg/chef-bach/subscribers","subscription_url":"https://api.github.com/repos/bloomberg/chef-bach/subscription","commits_url":"https://api.github.com/repos/bloomberg/chef-bach/commits{/sha}","git_commits_url":"https://api.github.com/repos/bloomberg/chef-bach/git/commits{/sha}","comments_url":"https://api.github.com/repos/bloomberg/chef-bach/comments{/number}","issue_comment_url":"https://api.github.com/repos/bloomberg/chef-bach/issues/comments{/number}","contents_url":"https://api.github.com/repos/bloomberg/chef-bach/contents/{+path}","compare_url":"https://api.github.com/repos/bloomberg/chef-bach/compare/{base}...{head}","merges_url":"https://api.github.com/repos/bloomberg/chef-bach/merges","archive_url":"https://api.github.com/repos/bloomberg/chef-bach/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/bloomberg/chef-bach/downloads","issues_url":"https://api.github.com/repos/bloomberg/chef-bach/issues{/number}","pulls_url":"https://api.github.com/repos/bloomberg/chef-bach/pulls{/number}","milestones_url":"https://api.github.com/repos/bloomberg/chef-bach/milestones{/number}","notifications_url":"https://api.github.com/repos/bloomberg/chef-bach/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/bloomberg/chef-bach/labels{/name}","releases_url":"https://api.github.com/repos/bloomberg/chef-bach/releases{/id}","created_at":"2014-10-08T09:16:26Z","updated_at":"2015-04-07T01:05:53Z","pushed_at":"2015-04-07T01:05:53Z","git_url":"git://github.com/bloomberg/chef-bach.git","ssh_url":"git@github.com:bloomberg/chef-bach.git","clone_url":"https://github.com/bloomberg/chef-bach.git","svn_url":"https://github.com/bloomberg/chef-bach","homepage":null,"size":2977,"stargazers_count":10,"watchers_count":10,"language":"HTML","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":6,"mirror_url":null,"open_issues_count":43,"forks":6,"open_issues":43,"watchers":10,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/bloomberg/chef-bach/pulls/86"},"html":{"href":"https://github.com/bloomberg/chef-bach/pull/86"},"issue":{"href":"https://api.github.com/repos/bloomberg/chef-bach/issues/86"},"comments":{"href":"https://api.github.com/repos/bloomberg/chef-bach/issues/86/comments"},"review_comments":{"href":"https://api.github.com/repos/bloomberg/chef-bach/pulls/86/comments"},"review_comment":{"href":"https://api.github.com/repos/bloomberg/chef-bach/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/bloomberg/chef-bach/pulls/86/commits"},"statuses":{"href":"https://api.github.com/repos/bloomberg/chef-bach/statuses/5564fac5683e179ed480a10e155521641a366a5c"}}}}