{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/3715","labels_url":"https://api.github.com/repos/apache/spark/issues/3715/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/3715/comments","events_url":"https://api.github.com/repos/apache/spark/issues/3715/events","html_url":"https://github.com/apache/spark/pull/3715","id":52175290,"number":3715,"title":"[SPARK-5154] [PySpark] [Streaming] Kafka streaming support in Python","user":{"login":"davies","id":40902,"avatar_url":"https://avatars.githubusercontent.com/u/40902?v=3","gravatar_id":"","url":"https://api.github.com/users/davies","html_url":"https://github.com/davies","followers_url":"https://api.github.com/users/davies/followers","following_url":"https://api.github.com/users/davies/following{/other_user}","gists_url":"https://api.github.com/users/davies/gists{/gist_id}","starred_url":"https://api.github.com/users/davies/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/davies/subscriptions","organizations_url":"https://api.github.com/users/davies/orgs","repos_url":"https://api.github.com/users/davies/repos","events_url":"https://api.github.com/users/davies/events{/privacy}","received_events_url":"https://api.github.com/users/davies/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":66,"created_at":"2014-12-16T22:19:54Z","updated_at":"2015-02-03T03:30:01Z","closed_at":"2015-02-03T03:17:35Z","pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/3715","html_url":"https://github.com/apache/spark/pull/3715","diff_url":"https://github.com/apache/spark/pull/3715.diff","patch_url":"https://github.com/apache/spark/pull/3715.patch"},"body":"This PR brings the Python API for Spark Streaming Kafka data source.\r\n\r\n```\r\n    class KafkaUtils(__builtin__.object)\r\n     |  Static methods defined here:\r\n     |\r\n     |  createStream(ssc, zkQuorum, groupId, topics, storageLevel=StorageLevel(True, True, False, False,\r\n2), keyDecoder=<function utf8_decoder>, valueDecoder=<function utf8_decoder>)\r\n     |      Create an input stream that pulls messages from a Kafka Broker.\r\n     |\r\n     |      :param ssc:  StreamingContext object\r\n     |      :param zkQuorum:  Zookeeper quorum (hostname:port,hostname:port,..).\r\n     |      :param groupId:  The group id for this consumer.\r\n     |      :param topics:  Dict of (topic_name -> numPartitions) to consume.\r\n     |                      Each partition is consumed in its own thread.\r\n     |      :param storageLevel:  RDD storage level.\r\n     |      :param keyDecoder:  A function used to decode key\r\n     |      :param valueDecoder:  A function used to decode value\r\n     |      :return: A DStream object\r\n```\r\nrun the example: \r\n\r\n```\r\nbin/spark-submit --driver-class-path external/kafka-assembly/target/scala-*/spark-streaming-kafka-assembly-*.jar examples/src/main/python/streaming/kafka_wordcount.py localhost:2181 test\r\n```"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/72586628","html_url":"https://github.com/apache/spark/pull/3715#issuecomment-72586628","issue_url":"https://api.github.com/repos/apache/spark/issues/3715","id":72586628,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2015-02-03T03:30:01Z","updated_at":"2015-02-03T03:30:01Z","body":"Test PASSed.\nRefer to this link for build results (access rights to CI server needed): \nhttps://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/26578/\nTest PASSed."}}