{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/logstash/issues/2490","labels_url":"https://api.github.com/repos/elastic/logstash/issues/2490/labels{/name}","comments_url":"https://api.github.com/repos/elastic/logstash/issues/2490/comments","events_url":"https://api.github.com/repos/elastic/logstash/issues/2490/events","html_url":"https://github.com/elastic/logstash/issues/2490","id":56203314,"number":2490,"title":"Logstash 1.5 beta hanging, requires restarts, help debug?","user":{"login":"johnwards","id":34269,"avatar_url":"https://avatars.githubusercontent.com/u/34269?v=3","gravatar_id":"","url":"https://api.github.com/users/johnwards","html_url":"https://github.com/johnwards","followers_url":"https://api.github.com/users/johnwards/followers","following_url":"https://api.github.com/users/johnwards/following{/other_user}","gists_url":"https://api.github.com/users/johnwards/gists{/gist_id}","starred_url":"https://api.github.com/users/johnwards/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/johnwards/subscriptions","organizations_url":"https://api.github.com/users/johnwards/orgs","repos_url":"https://api.github.com/users/johnwards/repos","events_url":"https://api.github.com/users/johnwards/events{/privacy}","received_events_url":"https://api.github.com/users/johnwards/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":6,"created_at":"2015-02-02T07:11:19Z","updated_at":"2015-06-04T16:43:53Z","closed_at":null,"body":"Hello,\r\n\r\nI've got an issue with my central logstash collector. It randomly hangs and stops picking up messages from Redis, nothing in the error log or any log, I'm at a loss as to how to debug.\r\n\r\nBackground...\r\n\r\nSo I've got a logstash 1.5 setup, ala the logstash book. The collectors are running on 5 servers, with no filters, just stuffing stuff to redis. Then I have a central server processing these logs. I have two types of logs, a standard log that I grok on to process and a XML based log.\r\n\r\nI run various filters on these logs to sort them out into a structure, then I do two things. Of type one I save to a file, which rotates hourly using the date format in the filename inside the output filter, I also save to elasticsearch. The second type just gets saved to elasticsearch.\r\n\r\nRight, that is the background.\r\n\r\nSo as I said, the central logstasher just hangs, stops writing to the file or sending data to elasticsearch, with no errors in the logs.\r\n\r\nAll I need to do to \"fix\" this, is to restart logstash. This seems to have no adverse affect to anything, and instantly fixes the problem.\r\n\r\nAt the moment, I've got a cron restarting logstash every 3 hours to stop Redis filling up when I'm sleeping. Even this 3 hour restart doesn't fully fix it, as sometimes in that 3 hour window logstash can hang.\r\n\r\nAny tips to help me diagnose this?"},"comment":{"url":"https://api.github.com/repos/elastic/logstash/issues/comments/108964326","html_url":"https://github.com/elastic/logstash/issues/2490#issuecomment-108964326","issue_url":"https://api.github.com/repos/elastic/logstash/issues/2490","id":108964326,"user":{"login":"jsvd","id":31809,"avatar_url":"https://avatars.githubusercontent.com/u/31809?v=3","gravatar_id":"","url":"https://api.github.com/users/jsvd","html_url":"https://github.com/jsvd","followers_url":"https://api.github.com/users/jsvd/followers","following_url":"https://api.github.com/users/jsvd/following{/other_user}","gists_url":"https://api.github.com/users/jsvd/gists{/gist_id}","starred_url":"https://api.github.com/users/jsvd/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jsvd/subscriptions","organizations_url":"https://api.github.com/users/jsvd/orgs","repos_url":"https://api.github.com/users/jsvd/repos","events_url":"https://api.github.com/users/jsvd/events{/privacy}","received_events_url":"https://api.github.com/users/jsvd/received_events","type":"User","site_admin":false},"created_at":"2015-06-04T16:43:53Z","updated_at":"2015-06-04T16:43:53Z","body":"This is very likely related to https://github.com/elastic/logstash/issues/3361, and a fix has been proposed in https://github.com/elastic/logstash/pull/3378"}}