{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/logstash/issues/4318","labels_url":"https://api.github.com/repos/elastic/logstash/issues/4318/labels{/name}","comments_url":"https://api.github.com/repos/elastic/logstash/issues/4318/comments","events_url":"https://api.github.com/repos/elastic/logstash/issues/4318/events","html_url":"https://github.com/elastic/logstash/issues/4318","id":121073024,"number":4318,"title":"[Logstash Performance Issue]","user":{"login":"varunkumarmnnit","id":8800255,"avatar_url":"https://avatars.githubusercontent.com/u/8800255?v=3","gravatar_id":"","url":"https://api.github.com/users/varunkumarmnnit","html_url":"https://github.com/varunkumarmnnit","followers_url":"https://api.github.com/users/varunkumarmnnit/followers","following_url":"https://api.github.com/users/varunkumarmnnit/following{/other_user}","gists_url":"https://api.github.com/users/varunkumarmnnit/gists{/gist_id}","starred_url":"https://api.github.com/users/varunkumarmnnit/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/varunkumarmnnit/subscriptions","organizations_url":"https://api.github.com/users/varunkumarmnnit/orgs","repos_url":"https://api.github.com/users/varunkumarmnnit/repos","events_url":"https://api.github.com/users/varunkumarmnnit/events{/privacy}","received_events_url":"https://api.github.com/users/varunkumarmnnit/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/elastic/logstash/labels/needs%20details","name":"needs details","color":"cc317c"},{"url":"https://api.github.com/repos/elastic/logstash/labels/windows","name":"windows","color":"bfd4f2"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-12-08T18:48:32Z","updated_at":"2015-12-17T17:14:35Z","closed_at":null,"body":"Hello ,\r\nRecently I observed  when I  am generating a huge log file and simultaneously using the logstash parsing on that file I am seeing the speed that log file is generated is slower with logstash as compared standalone log generation "},"comment":{"url":"https://api.github.com/repos/elastic/logstash/issues/comments/165518263","html_url":"https://github.com/elastic/logstash/issues/4318#issuecomment-165518263","issue_url":"https://api.github.com/repos/elastic/logstash/issues/4318","id":165518263,"user":{"login":"varunkumarmnnit","id":8800255,"avatar_url":"https://avatars.githubusercontent.com/u/8800255?v=3","gravatar_id":"","url":"https://api.github.com/users/varunkumarmnnit","html_url":"https://github.com/varunkumarmnnit","followers_url":"https://api.github.com/users/varunkumarmnnit/followers","following_url":"https://api.github.com/users/varunkumarmnnit/following{/other_user}","gists_url":"https://api.github.com/users/varunkumarmnnit/gists{/gist_id}","starred_url":"https://api.github.com/users/varunkumarmnnit/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/varunkumarmnnit/subscriptions","organizations_url":"https://api.github.com/users/varunkumarmnnit/orgs","repos_url":"https://api.github.com/users/varunkumarmnnit/repos","events_url":"https://api.github.com/users/varunkumarmnnit/events{/privacy}","received_events_url":"https://api.github.com/users/varunkumarmnnit/received_events","type":"User","site_admin":false},"created_at":"2015-12-17T17:14:35Z","updated_at":"2015-12-17T17:14:35Z","body":"Hello suyog ,Please find the data related  to the issue in performance I have observed .\r\n\r\n\r\nSample Log File Generation timing (141Mb file size) 31808.262ms    -- without running logstash \r\n\r\nSample Log File Generation timing (141Mb file size) 40033.376ms ---  running logstash simultaneously \r\n\r\nLog stash parsing completed on above file \r\n6 minutes  \r\n\r\n\r\nConfig file :-1: \r\n\r\ninput {\r\n\tfile{\r\n\t\tpath => \"D:/Logs/*/MIP/*.log\"\r\n               start_position => \"beginning\"\r\n                \r\n                \r\n              \r\n\t}\r\n\t\r\n\t\r\n}\r\n\r\nfilter{\r\n\tmutate{\r\n\t\tgsub => [\"path\",\"D:/Logs/\", \"\"]\t\t\r\n\t}\r\n\t\r\n}\r\n\r\noutput {\r\n\t\t\r\n\r\n                file{\r\n\t\t\tpath => \"Z:/Logs/%{host}/%{path}\"\r\n\t\t\tmessage_format => \"%{message}\"\r\n\t\t\t\r\n}\r\n\r\n\r\n}\r\n\r\n\r\n\r\n\r\nYou can see we have two issues here .\r\nFirst simultaneously using log stash on the input log makes the input log file generation slow \r\n\r\nLogstash is taking huge time to get the final output .\r\n\r\n\r\nAll the above testing  I am doing on windows .\r\n\r\n\r\nPlease clarify my doubts .\r\n\r\nThanks and Regards\r\nVarun"}}