{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/5433","labels_url":"https://api.github.com/repos/apache/spark/issues/5433/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/5433/comments","events_url":"https://api.github.com/repos/apache/spark/issues/5433/events","html_url":"https://github.com/apache/spark/pull/5433","id":67271893,"number":5433,"title":"[SQL] [SPARK-6794] Use kryo-based SparkSqlSerializer for GeneralHashedRelation","user":{"login":"vlyubin","id":3303322,"avatar_url":"https://avatars.githubusercontent.com/u/3303322?v=3","gravatar_id":"","url":"https://api.github.com/users/vlyubin","html_url":"https://github.com/vlyubin","followers_url":"https://api.github.com/users/vlyubin/followers","following_url":"https://api.github.com/users/vlyubin/following{/other_user}","gists_url":"https://api.github.com/users/vlyubin/gists{/gist_id}","starred_url":"https://api.github.com/users/vlyubin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vlyubin/subscriptions","organizations_url":"https://api.github.com/users/vlyubin/orgs","repos_url":"https://api.github.com/users/vlyubin/repos","events_url":"https://api.github.com/users/vlyubin/events{/privacy}","received_events_url":"https://api.github.com/users/vlyubin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":6,"created_at":"2015-04-09T03:25:35Z","updated_at":"2015-04-09T21:19:21Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/5433","html_url":"https://github.com/apache/spark/pull/5433","diff_url":"https://github.com/apache/spark/pull/5433.diff","patch_url":"https://github.com/apache/spark/pull/5433.patch"},"body":"Benchmarking results: http://pastie.org/private/1dneo1mta5zpsw6gmsoeq"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/91358635","html_url":"https://github.com/apache/spark/pull/5433#issuecomment-91358635","issue_url":"https://api.github.com/repos/apache/spark/issues/5433","id":91358635,"user":{"login":"aarondav","id":1400247,"avatar_url":"https://avatars.githubusercontent.com/u/1400247?v=3","gravatar_id":"","url":"https://api.github.com/users/aarondav","html_url":"https://github.com/aarondav","followers_url":"https://api.github.com/users/aarondav/followers","following_url":"https://api.github.com/users/aarondav/following{/other_user}","gists_url":"https://api.github.com/users/aarondav/gists{/gist_id}","starred_url":"https://api.github.com/users/aarondav/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aarondav/subscriptions","organizations_url":"https://api.github.com/users/aarondav/orgs","repos_url":"https://api.github.com/users/aarondav/repos","events_url":"https://api.github.com/users/aarondav/events{/privacy}","received_events_url":"https://api.github.com/users/aarondav/received_events","type":"User","site_admin":false},"created_at":"2015-04-09T21:19:21Z","updated_at":"2015-04-09T21:19:21Z","body":"Note that this is only used for BroadcastHashJoins, and this is the broadcasted table. It is thus expected to be relatively small (< 10 MB). For Spark users with default configuration, the broadcast is serialized using Java serialization, which it turns out is much slower than Kryo in this case (see the benchmark).\r\n\r\nThis turns out to be a pretty significant win for very short O(seconds) queries, where a large portion of time may be spent in performing the broadcast."}}