{"action":"created","issue":{"url":"https://api.github.com/repos/CommBank/maestro/issues/259","labels_url":"https://api.github.com/repos/CommBank/maestro/issues/259/labels{/name}","comments_url":"https://api.github.com/repos/CommBank/maestro/issues/259/comments","events_url":"https://api.github.com/repos/CommBank/maestro/issues/259/events","html_url":"https://github.com/CommBank/maestro/issues/259","id":50337528,"number":259,"title":"Ability to merge smaller files into a bigger file","user":{"login":"anandsiva","id":6812544,"avatar_url":"https://avatars.githubusercontent.com/u/6812544?v=3","gravatar_id":"","url":"https://api.github.com/users/anandsiva","html_url":"https://github.com/anandsiva","followers_url":"https://api.github.com/users/anandsiva/followers","following_url":"https://api.github.com/users/anandsiva/following{/other_user}","gists_url":"https://api.github.com/users/anandsiva/gists{/gist_id}","starred_url":"https://api.github.com/users/anandsiva/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/anandsiva/subscriptions","organizations_url":"https://api.github.com/users/anandsiva/orgs","repos_url":"https://api.github.com/users/anandsiva/repos","events_url":"https://api.github.com/users/anandsiva/events{/privacy}","received_events_url":"https://api.github.com/users/anandsiva/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/CommBank/maestro/labels/feature","name":"feature","color":"fbca04"}],"state":"open","locked":false,"assignee":{"login":"SamRoberts","id":1086978,"avatar_url":"https://avatars.githubusercontent.com/u/1086978?v=3","gravatar_id":"","url":"https://api.github.com/users/SamRoberts","html_url":"https://github.com/SamRoberts","followers_url":"https://api.github.com/users/SamRoberts/followers","following_url":"https://api.github.com/users/SamRoberts/following{/other_user}","gists_url":"https://api.github.com/users/SamRoberts/gists{/gist_id}","starred_url":"https://api.github.com/users/SamRoberts/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SamRoberts/subscriptions","organizations_url":"https://api.github.com/users/SamRoberts/orgs","repos_url":"https://api.github.com/users/SamRoberts/repos","events_url":"https://api.github.com/users/SamRoberts/events{/privacy}","received_events_url":"https://api.github.com/users/SamRoberts/received_events","type":"User","site_admin":false},"milestone":null,"comments":7,"created_at":"2014-11-28T03:25:13Z","updated_at":"2015-03-15T10:34:31Z","closed_at":null,"body":"Some of the reference data or the source system sending delta files will have lots of smaller files. In the long run this could cause issue. We could do compaction as an optional post processing for certain feeds."},"comment":{"url":"https://api.github.com/repos/CommBank/maestro/issues/comments/80951050","html_url":"https://github.com/CommBank/maestro/issues/259#issuecomment-80951050","issue_url":"https://api.github.com/repos/CommBank/maestro/issues/259","id":80951050,"user":{"login":"SamRoberts","id":1086978,"avatar_url":"https://avatars.githubusercontent.com/u/1086978?v=3","gravatar_id":"","url":"https://api.github.com/users/SamRoberts","html_url":"https://github.com/SamRoberts","followers_url":"https://api.github.com/users/SamRoberts/followers","following_url":"https://api.github.com/users/SamRoberts/following{/other_user}","gists_url":"https://api.github.com/users/SamRoberts/gists{/gist_id}","starred_url":"https://api.github.com/users/SamRoberts/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SamRoberts/subscriptions","organizations_url":"https://api.github.com/users/SamRoberts/orgs","repos_url":"https://api.github.com/users/SamRoberts/repos","events_url":"https://api.github.com/users/SamRoberts/events{/privacy}","received_events_url":"https://api.github.com/users/SamRoberts/received_events","type":"User","site_admin":false},"created_at":"2015-03-15T10:34:31Z","updated_at":"2015-03-15T10:34:31Z","body":"I didn't close this because I don't have any reason to believe that my load fix was enough to solve the broader problems of the tools we use producing small files.\r\n\r\nI imagine that, at the very least, we should be investigating hive files too. But it's really not up to me: we should be getting feedback from the platform team as to whether our loads are still producing too many small files or not."}}