{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/logstash/issues/4078","labels_url":"https://api.github.com/repos/elastic/logstash/issues/4078/labels{/name}","comments_url":"https://api.github.com/repos/elastic/logstash/issues/4078/comments","events_url":"https://api.github.com/repos/elastic/logstash/issues/4078/events","html_url":"https://github.com/elastic/logstash/issues/4078","id":112825090,"number":4078,"title":"kafka input spinning on cpu","user":{"login":"bobrik","id":89186,"avatar_url":"https://avatars.githubusercontent.com/u/89186?v=3","gravatar_id":"","url":"https://api.github.com/users/bobrik","html_url":"https://github.com/bobrik","followers_url":"https://api.github.com/users/bobrik/followers","following_url":"https://api.github.com/users/bobrik/following{/other_user}","gists_url":"https://api.github.com/users/bobrik/gists{/gist_id}","starred_url":"https://api.github.com/users/bobrik/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bobrik/subscriptions","organizations_url":"https://api.github.com/users/bobrik/orgs","repos_url":"https://api.github.com/users/bobrik/repos","events_url":"https://api.github.com/users/bobrik/events{/privacy}","received_events_url":"https://api.github.com/users/bobrik/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/elastic/logstash/labels/bug","name":"bug","color":"e11d21"},{"url":"https://api.github.com/repos/elastic/logstash/labels/v2.1.2","name":"v2.1.2","color":"ededed"}],"state":"closed","locked":false,"assignee":{"login":"talevy","id":388837,"avatar_url":"https://avatars.githubusercontent.com/u/388837?v=3","gravatar_id":"","url":"https://api.github.com/users/talevy","html_url":"https://github.com/talevy","followers_url":"https://api.github.com/users/talevy/followers","following_url":"https://api.github.com/users/talevy/following{/other_user}","gists_url":"https://api.github.com/users/talevy/gists{/gist_id}","starred_url":"https://api.github.com/users/talevy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/talevy/subscriptions","organizations_url":"https://api.github.com/users/talevy/orgs","repos_url":"https://api.github.com/users/talevy/repos","events_url":"https://api.github.com/users/talevy/events{/privacy}","received_events_url":"https://api.github.com/users/talevy/received_events","type":"User","site_admin":false},"milestone":null,"comments":7,"created_at":"2015-10-22T15:12:24Z","updated_at":"2015-12-21T13:34:34Z","closed_at":"2015-12-21T13:34:34Z","body":"Trying 2.0.0-beta3, here's my config:\r\n\r\n```\r\ninput {\r\n  kafka {\r\n    codec               => \"json\"\r\n    topic_id            => \"test\"\r\n    group_id            => \"logstash\"\r\n    consumer_threads    => 4\r\n    auto_offset_reset   => \"largest\"\r\n    zk_connect          => \"zk:2181\"\r\n  }\r\n}\r\n\r\noutput {\r\n  stdout {\r\n    codec => \"rubydebug\"\r\n  }\r\n\r\n  file {\r\n    path => \"/var/log/logstash/%{program}/%{logsource}/%{+YYYY-MM-dd}.log\"\r\n    message_format => \"%{@timestamp} [pid:%{pid}] %{message}\"\r\n  }\r\n}\r\n```\r\n\r\nDebug mode logs after start up only show this:\r\n\r\n```\r\nlog4j, [2015-10-22T15:10:06.826] DEBUG: org.apache.zookeeper.ClientCnxn: Got ping response for sessionid: 0x25040575d7cbaf7 after 185ms\r\nlog4j, [2015-10-22T15:10:08.829] DEBUG: org.apache.zookeeper.ClientCnxn: Got ping response for sessionid: 0x25040575d7cbaf7 after 186ms\r\nlog4j, [2015-10-22T15:10:10.834] DEBUG: org.apache.zookeeper.ClientCnxn: Got ping response for sessionid: 0x25040575d7cbaf7 after 187ms\r\nlog4j, [2015-10-22T15:10:12.837] DEBUG: org.apache.zookeeper.ClientCnxn: Got ping response for sessionid: 0x25040575d7cbaf7 after 184ms\r\nlog4j, [2015-10-22T15:10:14.840] DEBUG: org.apache.zookeeper.ClientCnxn: Got ping response for sessionid: 0x25040575d7cbaf7 after 183ms\r\nlog4j, [2015-10-22T15:10:16.844] DEBUG: org.apache.zookeeper.ClientCnxn: Got ping response for sessionid: 0x25040575d7cbaf7 after 184ms\r\nlog4j, [2015-10-22T15:10:18.847] DEBUG: org.apache.zookeeper.ClientCnxn: Got ping response for sessionid: 0x25040575d7cbaf7 after 183ms\r\nlog4j, [2015-10-22T15:10:20.850] DEBUG: org.apache.zookeeper.ClientCnxn: Got ping response for sessionid: 0x25040575d7cbaf7 after 183ms\r\nlog4j, [2015-10-22T15:10:22.851] DEBUG: org.apache.zookeeper.ClientCnxn: Got ping response for sessionid: 0x25040575d7cbaf7 after 184ms\r\n```\r\n\r\nLogstash consumes full CPU in idle more after start up, all in user mode. Messages from topics appear, there's no issue with it.\r\n\r\nHaven't tried kafka input with earlier releases, could be an old issue."},"comment":{"url":"https://api.github.com/repos/elastic/logstash/issues/comments/166306916","html_url":"https://github.com/elastic/logstash/issues/4078#issuecomment-166306916","issue_url":"https://api.github.com/repos/elastic/logstash/issues/4078","id":166306916,"user":{"login":"suyograo","id":1595958,"avatar_url":"https://avatars.githubusercontent.com/u/1595958?v=3","gravatar_id":"","url":"https://api.github.com/users/suyograo","html_url":"https://github.com/suyograo","followers_url":"https://api.github.com/users/suyograo/followers","following_url":"https://api.github.com/users/suyograo/following{/other_user}","gists_url":"https://api.github.com/users/suyograo/gists{/gist_id}","starred_url":"https://api.github.com/users/suyograo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/suyograo/subscriptions","organizations_url":"https://api.github.com/users/suyograo/orgs","repos_url":"https://api.github.com/users/suyograo/repos","events_url":"https://api.github.com/users/suyograo/events{/privacy}","received_events_url":"https://api.github.com/users/suyograo/received_events","type":"User","site_admin":false},"created_at":"2015-12-21T13:34:34Z","updated_at":"2015-12-21T13:34:34Z","body":"Closing in favor of https://github.com/logstash-plugins/logstash-input-kafka/issues/52. This has been fixed in v2.0.3, see my comment above for instructions to update to this version. We'll be releasing LS 2.1.1 soon with this fix."}}