{"action":"created","issue":{"url":"https://api.github.com/repos/otoolep/syslog-gollector/issues/17","labels_url":"https://api.github.com/repos/otoolep/syslog-gollector/issues/17/labels{/name}","comments_url":"https://api.github.com/repos/otoolep/syslog-gollector/issues/17/comments","events_url":"https://api.github.com/repos/otoolep/syslog-gollector/issues/17/events","html_url":"https://github.com/otoolep/syslog-gollector/issues/17","id":58416633,"number":17,"title":"syslog-gollector and Kafka","user":{"login":"dirtdiver512","id":11097289,"avatar_url":"https://avatars.githubusercontent.com/u/11097289?v=3","gravatar_id":"","url":"https://api.github.com/users/dirtdiver512","html_url":"https://github.com/dirtdiver512","followers_url":"https://api.github.com/users/dirtdiver512/followers","following_url":"https://api.github.com/users/dirtdiver512/following{/other_user}","gists_url":"https://api.github.com/users/dirtdiver512/gists{/gist_id}","starred_url":"https://api.github.com/users/dirtdiver512/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dirtdiver512/subscriptions","organizations_url":"https://api.github.com/users/dirtdiver512/orgs","repos_url":"https://api.github.com/users/dirtdiver512/repos","events_url":"https://api.github.com/users/dirtdiver512/events{/privacy}","received_events_url":"https://api.github.com/users/dirtdiver512/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-02-20T22:01:45Z","updated_at":"2015-02-21T06:11:13Z","closed_at":null,"body":"Trying to use this to take syslog messages and dump in kafka.  I think I have everything running but I can not seem to get syslog-gollector to do anything with logs that are sent to it via UDP 514, the default syslog port.  Rsyslog service is stopped.  I can see the packets getting there but when I check  curl 'localhost:8080/statistics?pretty' I get the below:\r\n \r\n\r\n\r\ntcp        0      0 127.0.0.1:514           0.0.0.0:*               LISTEN\r\nudp        0      0 127.0.0.1:514           0.0.0.0:*\r\nudp        0      0 0.0.0.0:1514            0.0.0.0:*\r\n\r\n\r\ncurl 'localhost:8080/statistics?pretty'\r\n\r\n{\r\n    \"parser\": {\r\n        \"events.dropped\": {\r\n            \"count\": 0\r\n        },\r\n        \"events.parsed\": {\r\n            \"count\": 0\r\n        }\r\n    },\r\n    \"tcp\": {\r\n        \"connections.Active\": {\r\n            \"count\": 0\r\n        },\r\n        \"events.bytes.received\": {\r\n            \"count\": 0\r\n        },\r\n        \"events.received\": {\r\n            \"count\": 0\r\n        }\r\n    },\r\n    \"udp\": {\r\n        \"events.bytes.received\": {\r\n            \"count\": 0\r\n        },\r\n        \"events.received\": {\r\n            \"count\": 0\r\n        }\r\n    }\r\n \r\n \r\n \r\n \r\nAnyhelp would be great as I am a bit knew to kafka.\r\n"},"comment":{"url":"https://api.github.com/repos/otoolep/syslog-gollector/issues/comments/75358132","html_url":"https://github.com/otoolep/syslog-gollector/issues/17#issuecomment-75358132","issue_url":"https://api.github.com/repos/otoolep/syslog-gollector/issues/17","id":75358132,"user":{"login":"dirtdiver512","id":11097289,"avatar_url":"https://avatars.githubusercontent.com/u/11097289?v=3","gravatar_id":"","url":"https://api.github.com/users/dirtdiver512","html_url":"https://github.com/dirtdiver512","followers_url":"https://api.github.com/users/dirtdiver512/followers","following_url":"https://api.github.com/users/dirtdiver512/following{/other_user}","gists_url":"https://api.github.com/users/dirtdiver512/gists{/gist_id}","starred_url":"https://api.github.com/users/dirtdiver512/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dirtdiver512/subscriptions","organizations_url":"https://api.github.com/users/dirtdiver512/orgs","repos_url":"https://api.github.com/users/dirtdiver512/repos","events_url":"https://api.github.com/users/dirtdiver512/events{/privacy}","received_events_url":"https://api.github.com/users/dirtdiver512/received_events","type":"User","site_admin":false},"created_at":"2015-02-21T06:11:13Z","updated_at":"2015-02-21T06:11:13Z","body":"Ok found out my main issue….now gollector is getting the logs but I do not see them going into kafka…\n\nI did test kafka with the cli producer and consumer and I can type in the producer and see it kicked out the consumer\n\n \n\n \n\n \n\ncurl 'localhost:8080/statistics?pretty'\n\n{\n\n    \"parser\": {\n\n        \"events.dropped\": {\n\n            \"count\": 24\n\n        },\n\n        \"events.parsed\": {\n\n            \"count\": 0\n\n        }\n\n    },\n\n    \"tcp\": {\n\n        \"connections.Active\": {\n\n            \"count\": 0\n\n        },\n\n        \"events.bytes.received\": {\n\n            \"count\": 0\n\n        },\n\n        \"events.received\": {\n\n            \"count\": 0\n\n        }\n\n    },\n\n    \"udp\": {\n\n        \"events.bytes.received\": {\n\n            \"count\": 6144\n\n        },\n\n        \"events.received\": {\n\n            \"count\": 24\n\n        }\n\n    }\n\n \n\nFrom: otoolep [mailto:notifications@github.com] \nSent: Friday, February 20, 2015 5:49 PM\nTo: otoolep/syslog-gollector\nCc: dirtdiver512\nSubject: Re: [syslog-gollector] syslog-gollector and Kafka (#17)\n\n \n\nCouple of things: \n\n- show me the diagnostics output, from the diagnostics endpoint. \n- how are you actually sending logs via UDP to the Collector? Have you confirmed the problem is not with your sender? You could read about how to use netcat to listen in UDP mode and dump anything it receives to the terminal, to check the sender. \n\n> On Feb 20, 2015, at 2:01 PM, dirtdiver512 <notifications@github.com> wrote:\n> \n> Trying to use this to take syslog messages and dump in kafka. I think I have everything running but I can not seem to get syslog-gollector to do anything with logs that are sent to it via UDP 514, the default syslog port. Rsyslog service is stopped. I can see the packets getting there but when I check curl 'localhost:8080/statistics?pretty' I get the below:\n> \n> tcp 0 0 127.0.0.1:514 0.0.0.0:* LISTEN\n> udp 0 0 127.0.0.1:514 0.0.0.0:*\n> udp 0 0 0.0.0.0:1514 0.0.0.0:*\n> \n> curl 'localhost:8080/statistics?pretty'\n> \n> {\n> \"parser\": {\n> \"events.dropped\": {\n> \"count\": 0\n> },\n> \"events.parsed\": {\n> \"count\": 0\n> }\n> },\n> \"tcp\": {\n> \"connections.Active\": {\n> \"count\": 0\n> },\n> \"events.bytes.received\": {\n> \"count\": 0\n> },\n> \"events.received\": {\n> \"count\": 0\n> }\n> },\n> \"udp\": {\n> \"events.bytes.received\": {\n> \"count\": 0\n> },\n> \"events.received\": {\n> \"count\": 0\n> }\n> }\n> \n> Anyhelp would be great as I am a bit knew to kafka.\n> \n> —\n> Reply to this email directly or view it on GitHub.\n> \n\n\n\n—\nReply to this email directly or view it on GitHub <https://github.com/otoolep/syslog-gollector/issues/17#issuecomment-75352192> .Image removed by sender.\n\n"}}