{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/logstash/issues/2246","labels_url":"https://api.github.com/repos/elastic/logstash/issues/2246/labels{/name}","comments_url":"https://api.github.com/repos/elastic/logstash/issues/2246/comments","events_url":"https://api.github.com/repos/elastic/logstash/issues/2246/events","html_url":"https://github.com/elastic/logstash/issues/2246","id":52021326,"number":2246,"title":"Logstash does not properly pick up the last position in file on restart","user":{"login":"jchalos","id":6777555,"avatar_url":"https://avatars.githubusercontent.com/u/6777555?v=3","gravatar_id":"","url":"https://api.github.com/users/jchalos","html_url":"https://github.com/jchalos","followers_url":"https://api.github.com/users/jchalos/followers","following_url":"https://api.github.com/users/jchalos/following{/other_user}","gists_url":"https://api.github.com/users/jchalos/gists{/gist_id}","starred_url":"https://api.github.com/users/jchalos/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jchalos/subscriptions","organizations_url":"https://api.github.com/users/jchalos/orgs","repos_url":"https://api.github.com/users/jchalos/repos","events_url":"https://api.github.com/users/jchalos/events{/privacy}","received_events_url":"https://api.github.com/users/jchalos/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/elastic/logstash/labels/bug","name":"bug","color":"e11d21"}],"state":"open","locked":false,"assignee":{"login":"suyograo","id":1595958,"avatar_url":"https://avatars.githubusercontent.com/u/1595958?v=3","gravatar_id":"","url":"https://api.github.com/users/suyograo","html_url":"https://github.com/suyograo","followers_url":"https://api.github.com/users/suyograo/followers","following_url":"https://api.github.com/users/suyograo/following{/other_user}","gists_url":"https://api.github.com/users/suyograo/gists{/gist_id}","starred_url":"https://api.github.com/users/suyograo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/suyograo/subscriptions","organizations_url":"https://api.github.com/users/suyograo/orgs","repos_url":"https://api.github.com/users/suyograo/repos","events_url":"https://api.github.com/users/suyograo/events{/privacy}","received_events_url":"https://api.github.com/users/suyograo/received_events","type":"User","site_admin":false},"milestone":null,"comments":1,"created_at":"2014-12-15T18:28:23Z","updated_at":"2015-05-17T23:40:57Z","closed_at":null,"body":"Symptom:  Logstash misses log events when using the file input if the logstash process is restarted or stops unexpectedly and is restarted.  It appears that the sincedb file is not being utilized on startup.\r\n\r\nUtilizing 'start_from => \"beginning\"' will result in duplicate data and is not the intended behavior.  It should pick up the log from the last read position when re-starting.\r\n\r\nLogstash version:1.4.2\r\n\r\nReproduction:\r\n\r\ninput {\r\n  file {\r\n    path => \"/tmp/\\*\\*/\\*.log\"\r\n    sincedb_path = \"/tmp/logstash.sincedb\"\r\n  }\r\n}\r\n\r\n1. Start logstash\r\n2. Append data to multiple logs in the directories being scanned.\r\n3. Stop logstash\r\n4. Append additional data to logs(This data will be missing including all data appended to the logs while logstash is starting)\r\n5. Start logstash\r\n6. Append additional data to logs(Eventually the logs will be read from the end again)\r\n"},"comment":{"url":"https://api.github.com/repos/elastic/logstash/issues/comments/102870747","html_url":"https://github.com/elastic/logstash/issues/2246#issuecomment-102870747","issue_url":"https://api.github.com/repos/elastic/logstash/issues/2246","id":102870747,"user":{"login":"jordansissel","id":131818,"avatar_url":"https://avatars.githubusercontent.com/u/131818?v=3","gravatar_id":"","url":"https://api.github.com/users/jordansissel","html_url":"https://github.com/jordansissel","followers_url":"https://api.github.com/users/jordansissel/followers","following_url":"https://api.github.com/users/jordansissel/following{/other_user}","gists_url":"https://api.github.com/users/jordansissel/gists{/gist_id}","starred_url":"https://api.github.com/users/jordansissel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jordansissel/subscriptions","organizations_url":"https://api.github.com/users/jordansissel/orgs","repos_url":"https://api.github.com/users/jordansissel/repos","events_url":"https://api.github.com/users/jordansissel/events{/privacy}","received_events_url":"https://api.github.com/users/jordansissel/received_events","type":"User","site_admin":false},"created_at":"2015-05-17T23:40:57Z","updated_at":"2015-05-17T23:40:57Z","body":"For Logstash 1.5.0, we've moved all plugins to individual repositories, so I have moved this issue to https://github.com/logstash-plugins/logstash-input-file/issues/35. Let's continue the discussion there! :)"}}