{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/5948","labels_url":"https://api.github.com/repos/apache/spark/issues/5948/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/5948/comments","events_url":"https://api.github.com/repos/apache/spark/issues/5948/events","html_url":"https://github.com/apache/spark/pull/5948","id":73721713,"number":5948,"title":"[SPARK-7375] [SQL] Avoid row copying in exchange when sort.serializeMapOutputs takes effect","user":{"login":"JoshRosen","id":50748,"avatar_url":"https://avatars.githubusercontent.com/u/50748?v=3","gravatar_id":"","url":"https://api.github.com/users/JoshRosen","html_url":"https://github.com/JoshRosen","followers_url":"https://api.github.com/users/JoshRosen/followers","following_url":"https://api.github.com/users/JoshRosen/following{/other_user}","gists_url":"https://api.github.com/users/JoshRosen/gists{/gist_id}","starred_url":"https://api.github.com/users/JoshRosen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JoshRosen/subscriptions","organizations_url":"https://api.github.com/users/JoshRosen/orgs","repos_url":"https://api.github.com/users/JoshRosen/repos","events_url":"https://api.github.com/users/JoshRosen/events{/privacy}","received_events_url":"https://api.github.com/users/JoshRosen/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":24,"created_at":"2015-05-06T20:05:18Z","updated_at":"2015-05-08T18:18:21Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/5948","html_url":"https://github.com/apache/spark/pull/5948","diff_url":"https://github.com/apache/spark/pull/5948.diff","patch_url":"https://github.com/apache/spark/pull/5948.patch"},"body":"This patch refactors the SQL `Exchange` operator's logic for determining whether map outputs need to be copied before being shuffled. As part of this change, we'll now avoid unnecessary copies in cases where sort-based shuffle operates on serialized map outputs (as in #4450 / \r\nSPARK-4550).\r\n\r\nThis patch also includes a change to copy the input to RangePartitioner partition bounds calculation, which is necessary because this calculation buffers mutable Java objects.\n\n<!-- Reviewable:start -->\n[<img src=\"https://reviewable.io/review_button.png\" height=40 alt=\"Review on Reviewable\"/>](https://reviewable.io/reviews/apache/spark/5948)\n<!-- Reviewable:end -->\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/100319078","html_url":"https://github.com/apache/spark/pull/5948#issuecomment-100319078","issue_url":"https://api.github.com/repos/apache/spark/issues/5948","id":100319078,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2015-05-08T18:18:20Z","updated_at":"2015-05-08T18:18:20Z","body":"Merged build finished. Test FAILed."}}