{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/logstash/issues/3477","labels_url":"https://api.github.com/repos/elastic/logstash/issues/3477/labels{/name}","comments_url":"https://api.github.com/repos/elastic/logstash/issues/3477/comments","events_url":"https://api.github.com/repos/elastic/logstash/issues/3477/events","html_url":"https://github.com/elastic/logstash/issues/3477","id":89943412,"number":3477,"title":"Performance improvements for plugins","user":{"login":"suyograo","id":1595958,"avatar_url":"https://avatars.githubusercontent.com/u/1595958?v=3","gravatar_id":"","url":"https://api.github.com/users/suyograo","html_url":"https://github.com/suyograo","followers_url":"https://api.github.com/users/suyograo/followers","following_url":"https://api.github.com/users/suyograo/following{/other_user}","gists_url":"https://api.github.com/users/suyograo/gists{/gist_id}","starred_url":"https://api.github.com/users/suyograo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/suyograo/subscriptions","organizations_url":"https://api.github.com/users/suyograo/orgs","repos_url":"https://api.github.com/users/suyograo/repos","events_url":"https://api.github.com/users/suyograo/events{/privacy}","received_events_url":"https://api.github.com/users/suyograo/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/elastic/logstash/labels/meta","name":"meta","color":"d4c5f9"},{"url":"https://api.github.com/repos/elastic/logstash/labels/performance-improvements","name":"performance-improvements","color":"fef2c0"}],"state":"open","locked":false,"assignee":{"login":"guyboertje","id":84912,"avatar_url":"https://avatars.githubusercontent.com/u/84912?v=3","gravatar_id":"","url":"https://api.github.com/users/guyboertje","html_url":"https://github.com/guyboertje","followers_url":"https://api.github.com/users/guyboertje/followers","following_url":"https://api.github.com/users/guyboertje/following{/other_user}","gists_url":"https://api.github.com/users/guyboertje/gists{/gist_id}","starred_url":"https://api.github.com/users/guyboertje/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/guyboertje/subscriptions","organizations_url":"https://api.github.com/users/guyboertje/orgs","repos_url":"https://api.github.com/users/guyboertje/repos","events_url":"https://api.github.com/users/guyboertje/events{/privacy}","received_events_url":"https://api.github.com/users/guyboertje/received_events","type":"User","site_admin":false},"milestone":null,"comments":19,"created_at":"2015-06-21T18:27:34Z","updated_at":"2015-11-06T16:20:12Z","closed_at":null,"body":"Meta issue to track and study performance of some plugins which are super popular. In 1.5.0 we improved grok performance (2x throughput in parsing Apache logs) -- similarly we need to focus on the next batch of plugins and see if we can fix any bottlenecks. \r\n\r\nSpecifically we should:\r\n0. Benchmark existing performance to get a baseline (/cc @purbon)\r\n1. Use a profiler and find the hotspots\r\n2. From 1, fix low hanging issues or obvious issues\r\n3. If not happy with numbers, consider POC/test rewrite in Java\r\n\r\nPlugins to focus on (first iteration):\r\n- [ ] Redis input\r\n- [ ] KV filter\r\n- [ ] TCP input\r\n- [ ] Lumberjack input\r\n- [ ] Kafka input\r\n- [ ] User agent filter https://github.com/logstash-plugins/logstash-filter-useragent/issues/5"},"comment":{"url":"https://api.github.com/repos/elastic/logstash/issues/comments/154456591","html_url":"https://github.com/elastic/logstash/issues/3477#issuecomment-154456591","issue_url":"https://api.github.com/repos/elastic/logstash/issues/3477","id":154456591,"user":{"login":"TinLe","id":465041,"avatar_url":"https://avatars.githubusercontent.com/u/465041?v=3","gravatar_id":"","url":"https://api.github.com/users/TinLe","html_url":"https://github.com/TinLe","followers_url":"https://api.github.com/users/TinLe/followers","following_url":"https://api.github.com/users/TinLe/following{/other_user}","gists_url":"https://api.github.com/users/TinLe/gists{/gist_id}","starred_url":"https://api.github.com/users/TinLe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/TinLe/subscriptions","organizations_url":"https://api.github.com/users/TinLe/orgs","repos_url":"https://api.github.com/users/TinLe/repos","events_url":"https://api.github.com/users/TinLe/events{/privacy}","received_events_url":"https://api.github.com/users/TinLe/received_events","type":"User","site_admin":false},"created_at":"2015-11-06T16:20:12Z","updated_at":"2015-11-06T16:20:12Z","body":"I am still on 1.5.4.   I did not know that 1.5.5 is released.   I'll give\nit a test to see if there are any improvements.\n\nTin\n\n\nOn Fri, Nov 6, 2015 at 4:30 AM, Guy Boertje <notifications@github.com>\nwrote:\n\n> @TinLe <https://github.com/TinLe> @gideononline\n> <https://github.com/gideononline> - do you see improvements with v1.5.5\n> or v2?\n>\n> —\n> Reply to this email directly or view it on GitHub\n> <https://github.com/elastic/logstash/issues/3477#issuecomment-154397580>.\n>\n"}}