{"action":"created","issue":{"url":"https://api.github.com/repos/linkedin/gobblin/issues/36","labels_url":"https://api.github.com/repos/linkedin/gobblin/issues/36/labels{/name}","comments_url":"https://api.github.com/repos/linkedin/gobblin/issues/36/comments","events_url":"https://api.github.com/repos/linkedin/gobblin/issues/36/events","html_url":"https://github.com/linkedin/gobblin/pull/36","id":59642031,"number":36,"title":"Fix mapreduce startup","user":{"login":"lbendig","id":3898961,"avatar_url":"https://avatars.githubusercontent.com/u/3898961?v=3","gravatar_id":"","url":"https://api.github.com/users/lbendig","html_url":"https://github.com/lbendig","followers_url":"https://api.github.com/users/lbendig/followers","following_url":"https://api.github.com/users/lbendig/following{/other_user}","gists_url":"https://api.github.com/users/lbendig/gists{/gist_id}","starred_url":"https://api.github.com/users/lbendig/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lbendig/subscriptions","organizations_url":"https://api.github.com/users/lbendig/orgs","repos_url":"https://api.github.com/users/lbendig/repos","events_url":"https://api.github.com/users/lbendig/events{/privacy}","received_events_url":"https://api.github.com/users/lbendig/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-03-03T13:35:47Z","updated_at":"2015-03-04T17:03:56Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/linkedin/gobblin/pulls/36","html_url":"https://github.com/linkedin/gobblin/pull/36","diff_url":"https://github.com/linkedin/gobblin/pull/36.diff","patch_url":"https://github.com/linkedin/gobblin/pull/36.patch"},"body":"Hi,\r\n\r\nGreat to see that Gobblin is released, many thanks for open-sourcing it!\r\nDuring the evaluation of the MR mode I've found some minor issues in the start script which I'd\r\nlike to fix with this patch. The changes are as follows:\r\n\r\ngobblin-mapreduce.sh :\r\n- Added a new command line parameter: <job jar>\r\n- Removed internal Linkedin dependencies from LIBJARS\r\n- Load Gobblin related dependencies first to HADOOP_CLASSPATH to avoid jar hell\r\n- Introduce gobblin-env.sh\r\n- Add missing command line toggles (sysconfig and jobconfig)\r\n\r\nCliMRJobLauncher.java :\r\n- Use GenericOptionsParser to be able to pick up Gobblin as well as Hadoop related \r\n  command line arguments\r\n\r\ngobblin-env.sh\r\n- A script that initializes environment variables used by gobblin-standalone.sh \r\n  and gobblin-mapreduce.sh\r\n\r\nbuild.gradle:\r\n- bump avro version to 1.7.6 to conform with the version of avro-mapred\r\n- force guava version 15.0: otherwise during the build gradle may pick up guava 17.0 \r\n  and will include that one in the /lib directory instead of the defined version 15.0. \r\n\r\nThanks,\r\nLorand"},"comment":{"url":"https://api.github.com/repos/linkedin/gobblin/issues/comments/77198710","html_url":"https://github.com/linkedin/gobblin/pull/36#issuecomment-77198710","issue_url":"https://api.github.com/repos/linkedin/gobblin/issues/36","id":77198710,"user":{"login":"liyinan926","id":3709137,"avatar_url":"https://avatars.githubusercontent.com/u/3709137?v=3","gravatar_id":"","url":"https://api.github.com/users/liyinan926","html_url":"https://github.com/liyinan926","followers_url":"https://api.github.com/users/liyinan926/followers","following_url":"https://api.github.com/users/liyinan926/following{/other_user}","gists_url":"https://api.github.com/users/liyinan926/gists{/gist_id}","starred_url":"https://api.github.com/users/liyinan926/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/liyinan926/subscriptions","organizations_url":"https://api.github.com/users/liyinan926/orgs","repos_url":"https://api.github.com/users/liyinan926/repos","events_url":"https://api.github.com/users/liyinan926/events{/privacy}","received_events_url":"https://api.github.com/users/liyinan926/received_events","type":"User","site_admin":false},"created_at":"2015-03-04T17:03:56Z","updated_at":"2015-03-04T17:03:56Z","body":"Just one comment: since gobblin-mapreduce.sh takes the namenode URL (-fs) as one of the input argument, it would be better to use that to populate fs.uri in gobblin-mapreduce.properties and GOBBLIN_WORK_DIR in gobblin-env.sh, instead of using hdfs://localhost:8020."}}