{"action":"closed","issue":{"url":"https://api.github.com/repos/elasticsearch/logstash/issues/2410","labels_url":"https://api.github.com/repos/elasticsearch/logstash/issues/2410/labels{/name}","comments_url":"https://api.github.com/repos/elasticsearch/logstash/issues/2410/comments","events_url":"https://api.github.com/repos/elasticsearch/logstash/issues/2410/events","html_url":"https://github.com/elasticsearch/logstash/issues/2410","id":55280908,"number":2410,"title":"file input: Massive loss off events if file globbing is used","user":{"login":"fonzmike","id":717031,"avatar_url":"https://avatars.githubusercontent.com/u/717031?v=3","gravatar_id":"","url":"https://api.github.com/users/fonzmike","html_url":"https://github.com/fonzmike","followers_url":"https://api.github.com/users/fonzmike/followers","following_url":"https://api.github.com/users/fonzmike/following{/other_user}","gists_url":"https://api.github.com/users/fonzmike/gists{/gist_id}","starred_url":"https://api.github.com/users/fonzmike/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fonzmike/subscriptions","organizations_url":"https://api.github.com/users/fonzmike/orgs","repos_url":"https://api.github.com/users/fonzmike/repos","events_url":"https://api.github.com/users/fonzmike/events{/privacy}","received_events_url":"https://api.github.com/users/fonzmike/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-01-23T13:25:56Z","updated_at":"2015-01-23T16:09:43Z","closed_at":"2015-01-23T16:09:43Z","body":"Hi,\r\n\r\nevery day i receive some dozen log files in a directory each file 50MB, 200.000 events. The Timestamps are ascending, about 5 to 20 events per second, no gaps. I process them with a file input using file globbing (\\*.log) to import all files within that directory. All files are read but there is a massive loss of events, some files simply stop processing. Kibana shows broad gaps.\r\nIf i process one file after the other using full file names, the timeline in Kibana is complete.\r\nProcessing of a single directory like /var/log with globbing (\\*.log) works like a charme.\r\n\r\nThere are no errors or messages in any log.\r\n\r\nPlease help in debugging/solving this, thank you.\r\n\r\nEnvironment:\r\nServer: RHEL, Java 1.8.0_25, Elasticsearch 1.4.2, Kibana 3 plugin, kopf plugin, logStash 1.4.2, redis 2.8.19, Apache 2.4 (reverse auth proxy to Kibana).\r\nShipper: Win Server 2008R2, Java 1.6.0_22 and 1.7.0_25 (tried both, no difference), logStash 1.4.2.\r\n\r\nSetup: \r\nlogStash shipper on win server, file input, filter, redis output\r\nindexer on rhel: redis input, elasticsearch output.\r\n\r\nThis issue was created after several hours of googling, no hints. If this is a duplicate, pls. pardon ;-)"}}