{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/6444","labels_url":"https://api.github.com/repos/apache/spark/issues/6444/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/6444/comments","events_url":"https://api.github.com/repos/apache/spark/issues/6444/events","html_url":"https://github.com/apache/spark/pull/6444","id":81621409,"number":6444,"title":"[SPARK-7078] [SPARK-7079] [WIP] Binary processing sort for Spark SQL","user":{"login":"JoshRosen","id":50748,"avatar_url":"https://avatars.githubusercontent.com/u/50748?v=3","gravatar_id":"","url":"https://api.github.com/users/JoshRosen","html_url":"https://github.com/JoshRosen","followers_url":"https://api.github.com/users/JoshRosen/followers","following_url":"https://api.github.com/users/JoshRosen/following{/other_user}","gists_url":"https://api.github.com/users/JoshRosen/gists{/gist_id}","starred_url":"https://api.github.com/users/JoshRosen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/JoshRosen/subscriptions","organizations_url":"https://api.github.com/users/JoshRosen/orgs","repos_url":"https://api.github.com/users/JoshRosen/repos","events_url":"https://api.github.com/users/JoshRosen/events{/privacy}","received_events_url":"https://api.github.com/users/JoshRosen/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":191,"created_at":"2015-05-27T20:55:55Z","updated_at":"2015-07-09T11:01:24Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/6444","html_url":"https://github.com/apache/spark/pull/6444","diff_url":"https://github.com/apache/spark/pull/6444.diff","patch_url":"https://github.com/apache/spark/pull/6444.patch"},"body":"This is a WIP commit towards implementing a binary processing cache aware external record sort for use in Spark SQL.  The code here is modeled after an early design of #5868, which supported pluggable functions for comparing key prefixes and comparing serialized records.\r\n\r\nI'll update this PR with a detailed design description later, similar to the detailed descriptions and comments posted at #5868; I'm only opening this now so that I can run some things through Jenkins and track some code review comments.\r\n\r\nTODOS:\r\n\r\n- [ ] Spill cleanup tests\r\n- [x] Refactoring of string prefix code, plus more tests.\r\n- [ ] Comments + real PR description.\r\n- [x] Split `copy` change to separate PR: **Edit**: done in #7306\r\n- [ ] Split changes to SparkPlanTest into separate PR.  **Update**: revert most of these changes and make sorting the default, not exception, in SparkPlanTest.\r\n\r\n\r\n\r\n<!-- Reviewable:start -->\r\n[<img src=\"https://reviewable.io/review_button.png\" height=40 alt=\"Review on Reviewable\"/>](https://reviewable.io/reviews/apache/spark/6444)\r\n<!-- Reviewable:end -->\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/119909258","html_url":"https://github.com/apache/spark/pull/6444#issuecomment-119909258","issue_url":"https://api.github.com/repos/apache/spark/issues/6444","id":119909258,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2015-07-09T11:01:24Z","updated_at":"2015-07-09T11:01:24Z","body":"Merged build finished. Test PASSed."}}