{"action":"created","issue":{"url":"https://api.github.com/repos/bigdatagenomics/adam/issues/866","labels_url":"https://api.github.com/repos/bigdatagenomics/adam/issues/866/labels{/name}","comments_url":"https://api.github.com/repos/bigdatagenomics/adam/issues/866/comments","events_url":"https://api.github.com/repos/bigdatagenomics/adam/issues/866/events","html_url":"https://github.com/bigdatagenomics/adam/pull/866","id":111091931,"number":866,"title":"[ADAM-864] Don't force shuffle if reducing partition count.","user":{"login":"fnothaft","id":3752466,"avatar_url":"https://avatars.githubusercontent.com/u/3752466?v=3","gravatar_id":"","url":"https://api.github.com/users/fnothaft","html_url":"https://github.com/fnothaft","followers_url":"https://api.github.com/users/fnothaft/followers","following_url":"https://api.github.com/users/fnothaft/following{/other_user}","gists_url":"https://api.github.com/users/fnothaft/gists{/gist_id}","starred_url":"https://api.github.com/users/fnothaft/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fnothaft/subscriptions","organizations_url":"https://api.github.com/users/fnothaft/orgs","repos_url":"https://api.github.com/users/fnothaft/repos","events_url":"https://api.github.com/users/fnothaft/events{/privacy}","received_events_url":"https://api.github.com/users/fnothaft/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/bigdatagenomics/adam/milestones/13","html_url":"https://github.com/bigdatagenomics/adam/milestones/0.18.2","labels_url":"https://api.github.com/repos/bigdatagenomics/adam/milestones/13/labels","id":1382001,"number":13,"title":"0.18.2","description":"Issues for version 0.18.2 bugfix release. ","creator":{"login":"heuermh","id":35293,"avatar_url":"https://avatars.githubusercontent.com/u/35293?v=3","gravatar_id":"","url":"https://api.github.com/users/heuermh","html_url":"https://github.com/heuermh","followers_url":"https://api.github.com/users/heuermh/followers","following_url":"https://api.github.com/users/heuermh/following{/other_user}","gists_url":"https://api.github.com/users/heuermh/gists{/gist_id}","starred_url":"https://api.github.com/users/heuermh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/heuermh/subscriptions","organizations_url":"https://api.github.com/users/heuermh/orgs","repos_url":"https://api.github.com/users/heuermh/repos","events_url":"https://api.github.com/users/heuermh/events{/privacy}","received_events_url":"https://api.github.com/users/heuermh/received_events","type":"User","site_admin":false},"open_issues":3,"closed_issues":3,"state":"open","created_at":"2015-10-28T18:22:39Z","updated_at":"2015-11-04T19:15:51Z","due_on":null,"closed_at":null},"comments":7,"created_at":"2015-10-13T02:37:05Z","updated_at":"2015-11-04T19:30:19Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/bigdatagenomics/adam/pulls/866","html_url":"https://github.com/bigdatagenomics/adam/pull/866","diff_url":"https://github.com/bigdatagenomics/adam/pull/866.diff","patch_url":"https://github.com/bigdatagenomics/adam/pull/866.patch"},"body":"Resolves #864. In Spark, coalescing will reduce the number of partitions in an\r\nRDD without performing a shuffle, but coalescing will only increase the number\r\nof partitions if a shuffle is performed. This PR modifies Transform and Vcf2ADAM\r\nto check whether the coalesce option will increase or decrease the partition\r\ncount. Additionally, it adds a flag that allows the user to force a shuffle;\r\nthis may be desirable as this causes a HashPartitioned shuffle, which may\r\nimprove the balance of records across partitions."},"comment":{"url":"https://api.github.com/repos/bigdatagenomics/adam/issues/comments/153839015","html_url":"https://github.com/bigdatagenomics/adam/pull/866#issuecomment-153839015","issue_url":"https://api.github.com/repos/bigdatagenomics/adam/issues/866","id":153839015,"user":{"login":"fnothaft","id":3752466,"avatar_url":"https://avatars.githubusercontent.com/u/3752466?v=3","gravatar_id":"","url":"https://api.github.com/users/fnothaft","html_url":"https://github.com/fnothaft","followers_url":"https://api.github.com/users/fnothaft/followers","following_url":"https://api.github.com/users/fnothaft/following{/other_user}","gists_url":"https://api.github.com/users/fnothaft/gists{/gist_id}","starred_url":"https://api.github.com/users/fnothaft/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fnothaft/subscriptions","organizations_url":"https://api.github.com/users/fnothaft/orgs","repos_url":"https://api.github.com/users/fnothaft/repos","events_url":"https://api.github.com/users/fnothaft/events{/privacy}","received_events_url":"https://api.github.com/users/fnothaft/received_events","type":"User","site_admin":false},"created_at":"2015-11-04T19:30:19Z","updated_at":"2015-11-04T19:30:19Z","body":"I thought I'd pushed a fix for the commit-pr.sh issue? Let me rebase this first... or, do you just want me to merge it?"}}