{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/7410","labels_url":"https://api.github.com/repos/apache/spark/issues/7410/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/7410/comments","events_url":"https://api.github.com/repos/apache/spark/issues/7410/events","html_url":"https://github.com/apache/spark/pull/7410","id":95094464,"number":7410,"title":"[SPARK-9065][Streaming][PySpark] Add MessageHandler for Kafka Python API","user":{"login":"jerryshao","id":850797,"avatar_url":"https://avatars.githubusercontent.com/u/850797?v=3","gravatar_id":"","url":"https://api.github.com/users/jerryshao","html_url":"https://github.com/jerryshao","followers_url":"https://api.github.com/users/jerryshao/followers","following_url":"https://api.github.com/users/jerryshao/following{/other_user}","gists_url":"https://api.github.com/users/jerryshao/gists{/gist_id}","starred_url":"https://api.github.com/users/jerryshao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jerryshao/subscriptions","organizations_url":"https://api.github.com/users/jerryshao/orgs","repos_url":"https://api.github.com/users/jerryshao/repos","events_url":"https://api.github.com/users/jerryshao/events{/privacy}","received_events_url":"https://api.github.com/users/jerryshao/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":33,"created_at":"2015-07-15T03:12:20Z","updated_at":"2015-07-24T06:52:10Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/7410","html_url":"https://github.com/apache/spark/pull/7410","diff_url":"https://github.com/apache/spark/pull/7410.diff","patch_url":"https://github.com/apache/spark/pull/7410.patch"},"body":"Propose a way to add messageHandler for Kafka Python API, offer user a similar pattern to use message like Scala/Java:\r\n\r\n```python\r\n\r\ndef getOffset(m):\r\n    return m and m.offset\r\n  \r\nKafkaUtils.createDirectStream(ssc, topic, kafkaParams, messageHandler=getOffset)\r\n```\r\n\r\nInternally serialize the Kafka `MessageAndMetadata` to Python using Pickler.\r\n\r\nPlease help to review, thanks a lot.\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/124365477","html_url":"https://github.com/apache/spark/pull/7410#issuecomment-124365477","issue_url":"https://api.github.com/repos/apache/spark/issues/7410","id":124365477,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2015-07-24T06:52:10Z","updated_at":"2015-07-24T06:52:10Z","body":"Merged build finished. Test FAILed."}}