{"action":"created","issue":{"url":"https://api.github.com/repos/druid-io/druid/issues/1463","labels_url":"https://api.github.com/repos/druid-io/druid/issues/1463/labels{/name}","comments_url":"https://api.github.com/repos/druid-io/druid/issues/1463/comments","events_url":"https://api.github.com/repos/druid-io/druid/issues/1463/events","html_url":"https://github.com/druid-io/druid/issues/1463","id":90754170,"number":1463,"title":"HadoopDruidDetermineConfigurationJob checks input files without first setting Job properties from spec file","user":{"login":"michaelschiff","id":1669670,"avatar_url":"https://avatars.githubusercontent.com/u/1669670?v=3","gravatar_id":"","url":"https://api.github.com/users/michaelschiff","html_url":"https://github.com/michaelschiff","followers_url":"https://api.github.com/users/michaelschiff/followers","following_url":"https://api.github.com/users/michaelschiff/following{/other_user}","gists_url":"https://api.github.com/users/michaelschiff/gists{/gist_id}","starred_url":"https://api.github.com/users/michaelschiff/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/michaelschiff/subscriptions","organizations_url":"https://api.github.com/users/michaelschiff/orgs","repos_url":"https://api.github.com/users/michaelschiff/repos","events_url":"https://api.github.com/users/michaelschiff/events{/privacy}","received_events_url":"https://api.github.com/users/michaelschiff/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/druid-io/druid/labels/Difficulty%20-%20Medium","name":"Difficulty - Medium","color":"207de5"},{"url":"https://api.github.com/repos/druid-io/druid/labels/Ease%20of%20Use","name":"Ease of Use","color":"006b75"},{"url":"https://api.github.com/repos/druid-io/druid/labels/Indexing","name":"Indexing","color":"d4c5f9"},{"url":"https://api.github.com/repos/druid-io/druid/labels/Operations","name":"Operations","color":"009800"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-06-24T18:30:09Z","updated_at":"2015-06-27T00:04:03Z","closed_at":null,"body":"HadoopDruidDetermineConfigurationJob.run() ensures the job input paths before setting any of the job properties specified in the indexing spec. This is problematic in the case where input files reside in S3 in a location that requires different access keys from those configured in core-site.xml.\r\n\r\nCurrently the work-around is to modify the keys in core-site.xml directly, but this is not ideal.  If job properties were set before ensuring paths then the indexing spec would be fully self-contained, all job properties can be set there, and no modifications to the hadoop *.xml files would be necessary."},"comment":{"url":"https://api.github.com/repos/druid-io/druid/issues/comments/115922429","html_url":"https://github.com/druid-io/druid/issues/1463#issuecomment-115922429","issue_url":"https://api.github.com/repos/druid-io/druid/issues/1463","id":115922429,"user":{"login":"michaelschiff","id":1669670,"avatar_url":"https://avatars.githubusercontent.com/u/1669670?v=3","gravatar_id":"","url":"https://api.github.com/users/michaelschiff","html_url":"https://github.com/michaelschiff","followers_url":"https://api.github.com/users/michaelschiff/followers","following_url":"https://api.github.com/users/michaelschiff/following{/other_user}","gists_url":"https://api.github.com/users/michaelschiff/gists{/gist_id}","starred_url":"https://api.github.com/users/michaelschiff/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/michaelschiff/subscriptions","organizations_url":"https://api.github.com/users/michaelschiff/orgs","repos_url":"https://api.github.com/users/michaelschiff/repos","events_url":"https://api.github.com/users/michaelschiff/events{/privacy}","received_events_url":"https://api.github.com/users/michaelschiff/received_events","type":"User","site_admin":false},"created_at":"2015-06-27T00:04:03Z","updated_at":"2015-06-27T00:04:03Z","body":"0adc51c07af4b411ab3006e3209e7b8769a970f5\r\nTest for JobHelper.ensurePaths\r\n"}}