{"action":"opened","issue":{"url":"https://api.github.com/repos/nathanmarz/dfs-datastores/issues/50","labels_url":"https://api.github.com/repos/nathanmarz/dfs-datastores/issues/50/labels{/name}","comments_url":"https://api.github.com/repos/nathanmarz/dfs-datastores/issues/50/comments","events_url":"https://api.github.com/repos/nathanmarz/dfs-datastores/issues/50/events","html_url":"https://github.com/nathanmarz/dfs-datastores/issues/50","id":79117343,"number":50,"title":"A VersionedTap overrides mapreduce.input.fileinputformat.inputdir without taking in account the previous values","user":{"login":"bqm","id":2635923,"avatar_url":"https://avatars.githubusercontent.com/u/2635923?v=3","gravatar_id":"","url":"https://api.github.com/users/bqm","html_url":"https://github.com/bqm","followers_url":"https://api.github.com/users/bqm/followers","following_url":"https://api.github.com/users/bqm/following{/other_user}","gists_url":"https://api.github.com/users/bqm/gists{/gist_id}","starred_url":"https://api.github.com/users/bqm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bqm/subscriptions","organizations_url":"https://api.github.com/users/bqm/orgs","repos_url":"https://api.github.com/users/bqm/repos","events_url":"https://api.github.com/users/bqm/events{/privacy}","received_events_url":"https://api.github.com/users/bqm/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2015-05-21T18:47:52Z","updated_at":"2015-05-21T18:47:52Z","closed_at":null,"body":"The VersionedTap's sourceConfInit method overrides mapreduce.input.fileinputformat.inputdir in:\r\n\r\nhttps://github.com/nathanmarz/dfs-datastores/blob/master/dfs-datastores-cascading/src/main/java/com/backtype/cascading/tap/VersionedTap.java#L96\r\n\r\nAs a result, we can't define out of the box a cascading.tap.MultiTap as a list of VersionedTap as each VersionedTap is going to override the previous input paths.\r\n\r\nI am not familiar with the cascading code so I am not sure what would be the best solution to this issue. Maybe a VersionedTap could add its own path to the existing list of paths instead of overriding the whole list?\r\nAs a temporary solution in my code, I am using a custom MultiTap that redefines the input paths but that doesn't seem optimal."}}