{"action":"created","issue":{"url":"https://api.github.com/repos/celery/kombu/issues/301","labels_url":"https://api.github.com/repos/celery/kombu/issues/301/labels{/name}","comments_url":"https://api.github.com/repos/celery/kombu/issues/301/comments","events_url":"https://api.github.com/repos/celery/kombu/issues/301/events","html_url":"https://github.com/celery/kombu/issues/301","id":25365006,"number":301,"title":"Kafka support","user":{"login":"rdiomar","id":5694435,"avatar_url":"https://avatars.githubusercontent.com/u/5694435?v=3","gravatar_id":"","url":"https://api.github.com/users/rdiomar","html_url":"https://github.com/rdiomar","followers_url":"https://api.github.com/users/rdiomar/followers","following_url":"https://api.github.com/users/rdiomar/following{/other_user}","gists_url":"https://api.github.com/users/rdiomar/gists{/gist_id}","starred_url":"https://api.github.com/users/rdiomar/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rdiomar/subscriptions","organizations_url":"https://api.github.com/users/rdiomar/orgs","repos_url":"https://api.github.com/users/rdiomar/repos","events_url":"https://api.github.com/users/rdiomar/events{/privacy}","received_events_url":"https://api.github.com/users/rdiomar/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":19,"created_at":"2014-01-09T23:36:55Z","updated_at":"2015-09-11T22:26:34Z","closed_at":"2014-01-13T15:06:12Z","body":"Any plans to add Kafka to the mix? mahendra implemented it [here]( https://github.com/mahendra/kombu/tree/kafka). It would be amazing if that gets pulled in."},"comment":{"url":"https://api.github.com/repos/celery/kombu/issues/comments/139676471","html_url":"https://github.com/celery/kombu/issues/301#issuecomment-139676471","issue_url":"https://api.github.com/repos/celery/kombu/issues/301","id":139676471,"user":{"login":"thedrow","id":48936,"avatar_url":"https://avatars.githubusercontent.com/u/48936?v=3","gravatar_id":"","url":"https://api.github.com/users/thedrow","html_url":"https://github.com/thedrow","followers_url":"https://api.github.com/users/thedrow/followers","following_url":"https://api.github.com/users/thedrow/following{/other_user}","gists_url":"https://api.github.com/users/thedrow/gists{/gist_id}","starred_url":"https://api.github.com/users/thedrow/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/thedrow/subscriptions","organizations_url":"https://api.github.com/users/thedrow/orgs","repos_url":"https://api.github.com/users/thedrow/repos","events_url":"https://api.github.com/users/thedrow/events{/privacy}","received_events_url":"https://api.github.com/users/thedrow/received_events","type":"User","site_admin":false},"created_at":"2015-09-11T22:26:34Z","updated_at":"2015-09-11T22:26:34Z","body":"@cerdman The first step is to pick a Python client for Kafka that can work for the versions that we support.\r\nhttps://github.com/mumrah/kafka-python seems like a possible choice but it doesn't work well with gevent as of yet. See https://github.com/mumrah/kafka-python/issues/37 https://github.com/mumrah/kafka-python/issues/271 https://github.com/mumrah/kafka-python/issues/257\r\nIt also seems that the client is not tested with eventlet as well.\r\nI think that the first step would be to add a connection pool to that project and ensure it supports both gevent and eventlet.\r\n\r\nAnother option would be https://github.com/Parsely/pykafka which is not tested with 3.3 as of yet and is not tested with either gevent and eventlet.\r\n\r\nAfter we chose a client we need to implement the transport interface: https://github.com/celery/kombu/blob/master/kombu/transport/base.py"}}