{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/logstash/issues/3302","labels_url":"https://api.github.com/repos/elastic/logstash/issues/3302/labels{/name}","comments_url":"https://api.github.com/repos/elastic/logstash/issues/3302/comments","events_url":"https://api.github.com/repos/elastic/logstash/issues/3302/events","html_url":"https://github.com/elastic/logstash/issues/3302","id":79436305,"number":3302,"title":"Logstash 1.5.0 stops processing with 100% CPU","user":{"login":"neilprosser","id":231666,"avatar_url":"https://avatars.githubusercontent.com/u/231666?v=3","gravatar_id":"","url":"https://api.github.com/users/neilprosser","html_url":"https://github.com/neilprosser","followers_url":"https://api.github.com/users/neilprosser/followers","following_url":"https://api.github.com/users/neilprosser/following{/other_user}","gists_url":"https://api.github.com/users/neilprosser/gists{/gist_id}","starred_url":"https://api.github.com/users/neilprosser/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/neilprosser/subscriptions","organizations_url":"https://api.github.com/users/neilprosser/orgs","repos_url":"https://api.github.com/users/neilprosser/repos","events_url":"https://api.github.com/users/neilprosser/events{/privacy}","received_events_url":"https://api.github.com/users/neilprosser/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/elastic/logstash/labels/bug","name":"bug","color":"e11d21"},{"url":"https://api.github.com/repos/elastic/logstash/labels/needs%20details","name":"needs details","color":"f7c6c7"}],"state":"open","locked":false,"assignee":{"login":"ph","id":640,"avatar_url":"https://avatars.githubusercontent.com/u/640?v=3","gravatar_id":"","url":"https://api.github.com/users/ph","html_url":"https://github.com/ph","followers_url":"https://api.github.com/users/ph/followers","following_url":"https://api.github.com/users/ph/following{/other_user}","gists_url":"https://api.github.com/users/ph/gists{/gist_id}","starred_url":"https://api.github.com/users/ph/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ph/subscriptions","organizations_url":"https://api.github.com/users/ph/orgs","repos_url":"https://api.github.com/users/ph/repos","events_url":"https://api.github.com/users/ph/events{/privacy}","received_events_url":"https://api.github.com/users/ph/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/elastic/logstash/milestones/10","html_url":"https://github.com/elastic/logstash/milestones/v1.5.1","labels_url":"https://api.github.com/repos/elastic/logstash/milestones/10/labels","id":997363,"number":10,"title":"v1.5.1","description":"","creator":{"login":"suyograo","id":1595958,"avatar_url":"https://avatars.githubusercontent.com/u/1595958?v=3","gravatar_id":"","url":"https://api.github.com/users/suyograo","html_url":"https://github.com/suyograo","followers_url":"https://api.github.com/users/suyograo/followers","following_url":"https://api.github.com/users/suyograo/following{/other_user}","gists_url":"https://api.github.com/users/suyograo/gists{/gist_id}","starred_url":"https://api.github.com/users/suyograo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/suyograo/subscriptions","organizations_url":"https://api.github.com/users/suyograo/orgs","repos_url":"https://api.github.com/users/suyograo/repos","events_url":"https://api.github.com/users/suyograo/events{/privacy}","received_events_url":"https://api.github.com/users/suyograo/received_events","type":"User","site_admin":false},"open_issues":8,"closed_issues":2,"state":"open","created_at":"2015-02-26T17:28:31Z","updated_at":"2015-05-25T21:11:59Z","due_on":null,"closed_at":null},"comments":22,"created_at":"2015-05-22T12:26:43Z","updated_at":"2015-05-26T13:50:48Z","closed_at":null,"body":"I've found since upgrading from 1.4.2 to 1.5.0 that Logstash will process messages for some period of time and then stop without any errors being logged. The process will run at 100% CPU per core (depending on how many `filterworkers` have been enabled, so two cores would lock out if I have 2 workers).\r\n\r\nThe Logstash process looks like:\r\n\r\n```\r\n/usr/bin/java -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -Djava.awt.headless=true -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -javaagent:/opt/logstash/lib/metrics-graphite-agent.jar -Dfile.encoding=UTF8 -Duser.timezone=UTC -Xmx1536m -Xss2048k -Djffi.boot.library.path=/opt/logstash/vendor/jruby/lib/jni -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -Djava.awt.headless=true -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -javaagent:/opt/logstash/lib/metrics-graphite-agent.jar -Dfile.encoding=UTF8 -Duser.timezone=UTC -Xbootclasspath/a:/opt/logstash/vendor/jruby/lib/jruby.jar -classpath : -Djruby.home=/opt/logstash/vendor/jruby -Djruby.lib=/opt/logstash/vendor/jruby/lib -Djruby.script=jruby -Djruby.shell=/bin/sh org.jruby.Main --1.9 /opt/logstash/lib/bootstrap/environment.rb logstash/runner.rb agent -f /etc/logstash/conf*/*.conf --log /opt/logstash/logs/logstash.log --filterworkers 1 --verbose\r\n```\r\n\r\nWe're running JDK 1.7.0_79 on Amazon Linux.\r\n\r\nOur `logstash.log` file looks like this once Logstash stops processing:\r\n\r\n```\r\n{:timestamp=>\"2015-05-22T10:55:24.638000+0000\", :message=>\"Using version 0.1.x filter plugin 'drop'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:24.655000+0000\", :message=>\"Using version 0.1.x filter plugin 'grok'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:24.674000+0000\", :message=>\"Using version 0.1.x filter plugin 'date'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:24.686000+0000\", :message=>\"Using version 0.1.x filter plugin 'mutate'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:24.727000+0000\", :message=>\"Using version 0.1.x filter plugin 'kv'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.080000+0000\", :message=>\"Using version 0.1.x input plugin 'redis'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.089000+0000\", :message=>\"Using version 0.1.x codec plugin 'json'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.104000+0000\", :message=>\"Using version 0.1.x filter plugin 'environment'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.111000+0000\", :message=>\"Using version 0.1.x filter plugin 'json'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.127000+0000\", :message=>\"Using version 0.1.x output plugin 'statsd'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.133000+0000\", :message=>\"Using version 0.1.x codec plugin 'plain'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.482000+0000\", :message=>\"Using version 0.1.x output plugin 'elasticsearch'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.515000+0000\", :message=>\"Using version 0.1.x output plugin 'redis'. This plugin isn't well supported by the community and likely has no maintainer.\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.799000+0000\", :message=>\"Registering Redis\", :identity=>\"default\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.800000+0000\", :message=>\"Registering Redis\", :identity=>\"default\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.805000+0000\", :message=>\"Registering Redis\", :identity=>\"default\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.846000+0000\", :message=>\"Grok patterns path\", :patterns_dir=>[\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns\", \"/opt/logstash/patterns/*\"], :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.847000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/java\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.848000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/redis\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.848000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/grok-patterns\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.857000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/linux-syslog\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.858000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/haproxy\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.859000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/nagios\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.865000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/firewalls\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.905000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/junos\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.906000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/ruby\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.907000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/mongodb\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.907000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/mcollective-patterns\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.908000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/postgresql\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:25.909000+0000\", :message=>\"Grok loading patterns from file\", :path=>\"/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-0.1.10/patterns/mcollective\", :level=>:info}\r\n\r\n... lots of grok initialisation ...\r\n\r\n{:timestamp=>\"2015-05-22T10:55:33.267000+0000\", :message=>\"Create client to elasticsearch server on timburres:\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:34.561000+0000\", :message=>\"New Elasticsearch output\", :cluster=>nil, :host=>[\"timburres\"], :port=>80, :embedded=>false, :protocol=>\"http\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:34.570000+0000\", :message=>\"Create client to elasticsearch server on timburres:\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:34.582000+0000\", :message=>\"New Elasticsearch output\", :cluster=>nil, :host=>[\"timburres\"], :port=>80, :embedded=>false, :protocol=>\"http\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:34.592000+0000\", :message=>\"Create client to elasticsearch server on timburres:\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:34.598000+0000\", :message=>\"New Elasticsearch output\", :cluster=>nil, :host=>[\"timburres\"], :port=>80, :embedded=>false, :protocol=>\"http\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:34.605000+0000\", :message=>\"Create client to elasticsearch server on logstashes:\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:34.609000+0000\", :message=>\"New Elasticsearch output\", :cluster=>nil, :host=>[\"logstashes\"], :port=>80, :embedded=>false, :protocol=>\"http\", :level=>:info}\r\n{:timestamp=>\"2015-05-22T10:55:34.614000+0000\", :message=>\"Pipeline started\", :level=>:info}\r\n```\r\n\r\nA thread-dump from the Logstash process yields the following:\r\n\r\n```\r\n2015-05-22 12:10:16\r\nFull thread dump Java HotSpot(TM) 64-Bit Server VM (24.79-b02 mixed mode):\r\n\r\n\">output\" daemon prio=10 tid=0x00007f88e02f7000 nid=0x1e93 in Object.wait() [0x00007f88e63ef000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  - waiting on <0x00000000acba1100> (a org.jruby.ext.thread.SizedQueue)\r\n  at java.lang.Object.wait(Object.java:461)\r\n  at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049)\r\n  - locked <0x00000000acba1100> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065)\r\n  at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413)\r\n  at org.jruby.ext.thread.Queue.pop(Queue.java:152)\r\n  - locked <0x00000000acba1100> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.ext.thread.Queue.pop(Queue.java:127)\r\n  - locked <0x00000000acba1100> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.ext.thread.SizedQueue.pop(SizedQueue.java:111)\r\n  - locked <0x00000000acba1100> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.ext.thread.SizedQueue$INVOKER$i$pop.call(SizedQueue$INVOKER$i$pop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:134)\r\n  at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)\r\n  at org.jruby.ast.LocalAsgnNode.interpret(LocalAsgnNode.java:123)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.WhileNode.interpret(WhileNode.java:131)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:187)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136)\r\n  at org.jruby.ast.VCallNode.interpret(VCallNode.java:88)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-28: /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-0.2.4-java/lib/logstash/outputs/elasticsearch.rb:377\" daemon prio=10 tid=0x00007f88e02f5000 nid=0x1e92 in Object.wait() [0x00007f88e65f0000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at java.lang.Object.wait(Object.java:461)\r\n  at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049)\r\n  - locked <0x00000000ae219278> (a org.jruby.ext.thread.ConditionVariable)\r\n  at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065)\r\n  at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413)\r\n  at org.jruby.ext.thread.ConditionVariable.wait_ruby(ConditionVariable.java:96)\r\n  - locked <0x00000000ae219278> (a org.jruby.ext.thread.ConditionVariable)\r\n  at org.jruby.ext.thread.ConditionVariable$INVOKER$i$0$1$wait_ruby.call(ConditionVariable$INVOKER$i$0$1$wait_ruby.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.ext.thread.Mutex.synchronize(Mutex.java:149)\r\n  at org.jruby.ext.thread.Mutex$INVOKER$i$0$0$synchronize.call(Mutex$INVOKER$i$0$0$synchronize.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.WhileNode.interpret(WhileNode.java:131)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-27: /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-0.2.4-java/lib/logstash/outputs/elasticsearch.rb:370\" daemon prio=10 tid=0x00007f88e02f3000 nid=0x1e91 in Object.wait() [0x00007f88e67f2000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - eliminated <0x00000000ae211a58> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae211a58> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-26: /opt/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.19/lib/stud/buffer.rb:92\" daemon prio=10 tid=0x00007f88e02f1000 nid=0x1e90 in Object.wait() [0x00007f88e69f2000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - eliminated <0x00000000ae0caf88> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae0caf88> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-25: /opt/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/client.rb:369\" daemon prio=10 tid=0x00007f88e02ef000 nid=0x1e8f in Object.wait() [0x00007f88e6bf3000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  - waiting on <0x00000000ae211988> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - locked <0x00000000ae211988> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae211988> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-24: /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-0.2.4-java/lib/logstash/outputs/elasticsearch.rb:377\" daemon prio=10 tid=0x00007f88e02ed000 nid=0x1e8e in Object.wait() [0x00007f88e6df4000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at java.lang.Object.wait(Object.java:461)\r\n  at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049)\r\n  - locked <0x00000000ae214698> (a org.jruby.ext.thread.ConditionVariable)\r\n  at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065)\r\n  at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413)\r\n  at org.jruby.ext.thread.ConditionVariable.wait_ruby(ConditionVariable.java:96)\r\n  - locked <0x00000000ae214698> (a org.jruby.ext.thread.ConditionVariable)\r\n  at org.jruby.ext.thread.ConditionVariable$INVOKER$i$0$1$wait_ruby.call(ConditionVariable$INVOKER$i$0$1$wait_ruby.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.ext.thread.Mutex.synchronize(Mutex.java:149)\r\n  at org.jruby.ext.thread.Mutex$INVOKER$i$0$0$synchronize.call(Mutex$INVOKER$i$0$0$synchronize.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.WhileNode.interpret(WhileNode.java:131)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-23: /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-0.2.4-java/lib/logstash/outputs/elasticsearch.rb:370\" daemon prio=10 tid=0x00007f88e02eb000 nid=0x1e8d in Object.wait() [0x00007f88e6ff6000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - eliminated <0x00000000ae278738> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae278738> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-22: /opt/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.19/lib/stud/buffer.rb:92\" daemon prio=10 tid=0x00007f88e02e9800 nid=0x1e8c in Object.wait() [0x00007f88e71f7000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - eliminated <0x00000000ae278808> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae278808> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-21: /opt/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/client.rb:369\" daemon prio=10 tid=0x00007f88e02e8000 nid=0x1e8b in Object.wait() [0x00007f88e73f7000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  - waiting on <0x00000000ae2788d8> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - locked <0x00000000ae2788d8> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae2788d8> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-20: /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-0.2.4-java/lib/logstash/outputs/elasticsearch.rb:377\" daemon prio=10 tid=0x00007f88e02e5800 nid=0x1e8a in Object.wait() [0x00007f88e75f8000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at java.lang.Object.wait(Object.java:461)\r\n  at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049)\r\n  - locked <0x00000000ae50f818> (a org.jruby.ext.thread.ConditionVariable)\r\n  at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065)\r\n  at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413)\r\n  at org.jruby.ext.thread.ConditionVariable.wait_ruby(ConditionVariable.java:96)\r\n  - locked <0x00000000ae50f818> (a org.jruby.ext.thread.ConditionVariable)\r\n  at org.jruby.ext.thread.ConditionVariable$INVOKER$i$0$1$wait_ruby.call(ConditionVariable$INVOKER$i$0$1$wait_ruby.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.ext.thread.Mutex.synchronize(Mutex.java:149)\r\n  at org.jruby.ext.thread.Mutex$INVOKER$i$0$0$synchronize.call(Mutex$INVOKER$i$0$0$synchronize.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.WhileNode.interpret(WhileNode.java:131)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-19: /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-0.2.4-java/lib/logstash/outputs/elasticsearch.rb:370\" daemon prio=10 tid=0x00007f88e02e4000 nid=0x1e89 in Object.wait() [0x00007f88e77fa000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - eliminated <0x00000000ae211780> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae211780> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-18: /opt/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.19/lib/stud/buffer.rb:92\" daemon prio=10 tid=0x00007f88e02e3000 nid=0x1e88 in Object.wait() [0x00007f88e79fa000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - eliminated <0x00000000ae2116b0> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae2116b0> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-17: /opt/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/client.rb:369\" daemon prio=10 tid=0x00007f88e02e2000 nid=0x1e87 in Object.wait() [0x00007f88e7bfb000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  - waiting on <0x00000000ae2115e0> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - locked <0x00000000ae2115e0> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae2115e0> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-16: /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-0.2.4-java/lib/logstash/outputs/elasticsearch.rb:377\" daemon prio=10 tid=0x00007f88e02df000 nid=0x1e86 in Object.wait() [0x00007f88e7dfc000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at java.lang.Object.wait(Object.java:461)\r\n  at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049)\r\n  - locked <0x00000000abd89958> (a org.jruby.ext.thread.ConditionVariable)\r\n  at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065)\r\n  at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413)\r\n  at org.jruby.ext.thread.ConditionVariable.wait_ruby(ConditionVariable.java:96)\r\n  - locked <0x00000000abd89958> (a org.jruby.ext.thread.ConditionVariable)\r\n  at org.jruby.ext.thread.ConditionVariable$INVOKER$i$0$1$wait_ruby.call(ConditionVariable$INVOKER$i$0$1$wait_ruby.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.ext.thread.Mutex.synchronize(Mutex.java:149)\r\n  at org.jruby.ext.thread.Mutex$INVOKER$i$0$0$synchronize.call(Mutex$INVOKER$i$0$0$synchronize.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.WhileNode.interpret(WhileNode.java:131)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-15: /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-output-elasticsearch-0.2.4-java/lib/logstash/outputs/elasticsearch.rb:370\" daemon prio=10 tid=0x00007f88e02dd800 nid=0x1e85 in Object.wait() [0x00007f88e7ffe000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - eliminated <0x00000000ae211510> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae211510> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-14: /opt/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.19/lib/stud/buffer.rb:92\" daemon prio=10 tid=0x00007f88e02dd000 nid=0x1e84 in Object.wait() [0x00007f89103b3000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - eliminated <0x00000000ae528140> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae528140> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-13: /opt/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/client.rb:369\" daemon prio=10 tid=0x00007f88e02dc000 nid=0x1e83 in Object.wait() [0x00007f89105b3000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  - waiting on <0x00000000ae5287c0> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - locked <0x00000000ae5287c0> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae5287c0> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-12: /opt/logstash/vendor/bundle/jruby/1.9/gems/manticore-0.4.1-java/lib/manticore/client.rb:369\" daemon prio=10 tid=0x00007f88e02bd800 nid=0x1e82 in Object.wait() [0x00007f89107b4000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  - waiting on <0x00000000ae528210> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyThread.sleep(RubyThread.java:1001)\r\n  - locked <0x00000000ae528210> (a org.jruby.RubyThread)\r\n  - locked <0x00000000ae528210> (a org.jruby.RubyThread)\r\n  at org.jruby.RubyKernel.sleep(RubyKernel.java:834)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$1$sleep.call(RubyKernel$INVOKER$s$0$1$sleep.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:665)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:206)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Interpreted19Block.yieldSpecific(Interpreted19Block.java:130)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:111)\r\n  at org.jruby.RubyKernel.loop(RubyKernel.java:1507)\r\n  at org.jruby.RubyKernel$INVOKER$s$0$0$loop.call(RubyKernel$INVOKER$s$0$0$loop.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.FCallNoArgBlockNode.interpret(FCallNoArgBlockNode.java:32)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-11: /opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-1.5.0-java/lib/logstash/pipeline.rb:160\" daemon prio=10 tid=0x00007f88e01d0000 nid=0x1e75 in Object.wait() [0x00007f8910e1e000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  - waiting on <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at java.lang.Object.wait(Object.java:461)\r\n  at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049)\r\n  - locked <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065)\r\n  at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413)\r\n  at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:133)\r\n  - locked <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:157)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.ext.thread.Mutex.synchronize(Mutex.java:149)\r\n  at org.jruby.ext.thread.Mutex$INVOKER$i$0$0$synchronize.call(Mutex$INVOKER$i$0$0$synchronize.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:64)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call19(RubyProc.java:271)\r\n  at org.jruby.RubyProc$INVOKER$i$0$0$call19.call(RubyProc$INVOKER$i$0$0$call19.gen)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:202)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:198)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:134)\r\n  at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.IfNode.interpret(IfNode.java:118)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.WhileNode.interpret(WhileNode.java:131)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:204)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:211)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:336)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:179)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188)\r\n  at org.jruby.ast.CallOneArgBlockNode.interpret(CallOneArgBlockNode.java:60)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"|worker\" daemon prio=10 tid=0x00007f88e0137800 nid=0x1e74 runnable [0x00007f891101d000]\r\n   java.lang.Thread.State: RUNNABLE\r\n  at org.joni.ByteCodeMachine.matchAt(ByteCodeMachine.java:203)\r\n  at org.joni.Matcher.matchCheck(Matcher.java:304)\r\n  at org.joni.Matcher.searchInterruptible(Matcher.java:480)\r\n  at org.jruby.RubyRegexp$SearchMatchTask.run(RubyRegexp.java:273)\r\n  at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065)\r\n  at org.jruby.RubyRegexp.matcherSearch(RubyRegexp.java:235)\r\n  at org.jruby.RubyRegexp.search19(RubyRegexp.java:1780)\r\n  at org.jruby.RubyRegexp.matchPos(RubyRegexp.java:1720)\r\n  at org.jruby.RubyRegexp.match19Common(RubyRegexp.java:1701)\r\n  at org.jruby.RubyRegexp.match_m19(RubyRegexp.java:1680)\r\n  at org.jruby.RubyRegexp$INVOKER$i$match_m19.call(RubyRegexp$INVOKER$i$match_m19.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodOneOrNBlock.call(JavaMethod.java:350)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at rubyjit.Grok$$match_and_capture_5fff680283e4b4ebc4c0eb1732d88dbb187668931360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/jls-grok-0.11.2/lib/grok-pure.rb:177)\r\n  at rubyjit.Grok$$match_and_capture_5fff680283e4b4ebc4c0eb1732d88dbb187668931360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/jls-grok-0.11.2/lib/grok-pure.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188)\r\n  at rubyjit.LogStash::Filters::Grok$$match_against_groks_b11b0692f934736d879641011e2c7d2eefbcc86b1360263927.block_0$RUBY$__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-0.1.10/lib/logstash/filters/grok.rb:322)\r\n  at rubyjit$LogStash::Filters::Grok$$match_against_groks_b11b0692f934736d879641011e2c7d2eefbcc86b1360263927$block_0$RUBY$__file__.call(rubyjit$LogStash::Filters::Grok$$match_against_groks_b11b0692f934736d879641011e2c7d2eefbcc86b1360263927$block_0$RUBY$__file__)\r\n  at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.RubyArray.eachCommon(RubyArray.java:1606)\r\n  at org.jruby.RubyArray.each(RubyArray.java:1613)\r\n  at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at rubyjit.LogStash::Filters::Grok$$match_against_groks_b11b0692f934736d879641011e2c7d2eefbcc86b1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-0.1.10/lib/logstash/filters/grok.rb:320)\r\n  at rubyjit.LogStash::Filters::Grok$$match_against_groks_b11b0692f934736d879641011e2c7d2eefbcc86b1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-0.1.10/lib/logstash/filters/grok.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:261)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:236)\r\n  at rubyjit.LogStash::Filters::Grok$$match_8bdbe64326db8304553339f720ad604df5c8e7641360263927.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-0.1.10/lib/logstash/filters/grok.rb:311)\r\n  at rubyjit.LogStash::Filters::Grok$$match_8bdbe64326db8304553339f720ad604df5c8e7641360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-0.1.10/lib/logstash/filters/grok.rb)\r\n  at rubyjit.LogStash::Filters::Grok$$match_8bdbe64326db8304553339f720ad604df5c8e7641360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-0.1.10/lib/logstash/filters/grok.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:261)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:236)\r\n  at rubyjit.LogStash::Filters::Grok$$filter_726ca6ef94988c7465ec5f8f33fd4416b5eab33e1360263927.block_0$RUBY$__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-0.1.10/lib/logstash/filters/grok.rb:280)\r\n  at rubyjit$LogStash::Filters::Grok$$filter_726ca6ef94988c7465ec5f8f33fd4416b5eab33e1360263927$block_0$RUBY$__file__.call(rubyjit$LogStash::Filters::Grok$$filter_726ca6ef94988c7465ec5f8f33fd4416b5eab33e1360263927$block_0$RUBY$__file__)\r\n  at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.RubyHash$13.visit(RubyHash.java:1354)\r\n  at org.jruby.RubyHash.visitLimited(RubyHash.java:648)\r\n  at org.jruby.RubyHash.visitAll(RubyHash.java:634)\r\n  at org.jruby.RubyHash.iteratorVisitAll(RubyHash.java:1305)\r\n  at org.jruby.RubyHash.each_pairCommon(RubyHash.java:1350)\r\n  at org.jruby.RubyHash.each19(RubyHash.java:1341)\r\n  at org.jruby.RubyHash$INVOKER$i$0$0$each19.call(RubyHash$INVOKER$i$0$0$each19.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at rubyjit.LogStash::Filters::Grok$$filter_726ca6ef94988c7465ec5f8f33fd4416b5eab33e1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-0.1.10/lib/logstash/filters/grok.rb:279)\r\n  at rubyjit.LogStash::Filters::Grok$$filter_726ca6ef94988c7465ec5f8f33fd4416b5eab33e1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-filter-grok-0.1.10/lib/logstash/filters/grok.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:336)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:179)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188)\r\n  at rubyjit.LogStash::Filters::Base$$multi_filter_23dd53ffcf01f316bd396c1ca6264acc7395c01f1360263927.block_0$RUBY$__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-1.5.0-java/lib/logstash/filters/base.rb:162)\r\n  at rubyjit$LogStash::Filters::Base$$multi_filter_23dd53ffcf01f316bd396c1ca6264acc7395c01f1360263927$block_0$RUBY$__file__.call(rubyjit$LogStash::Filters::Base$$multi_filter_23dd53ffcf01f316bd396c1ca6264acc7395c01f1360263927$block_0$RUBY$__file__)\r\n  at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.RubyArray.eachCommon(RubyArray.java:1606)\r\n  at org.jruby.RubyArray.each(RubyArray.java:1613)\r\n  at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at rubyjit.LogStash::Filters::Base$$multi_filter_23dd53ffcf01f316bd396c1ca6264acc7395c01f1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-1.5.0-java/lib/logstash/filters/base.rb:159)\r\n  at rubyjit.LogStash::Filters::Base$$multi_filter_23dd53ffcf01f316bd396c1ca6264acc7395c01f1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-core-1.5.0-java/lib/logstash/filters/base.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:181)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at rubyjit.LogStash::Pipeline$$cond_func_9859_b0383d340890bfe1540f572a350593995d4f6f351360263927.block_0$RUBY$__file__((eval):25447)\r\n  at rubyjit$LogStash::Pipeline$$cond_func_9859_b0383d340890bfe1540f572a350593995d4f6f351360263927$block_0$RUBY$__file__.call(rubyjit$LogStash::Pipeline$$cond_func_9859_b0383d340890bfe1540f572a350593995d4f6f351360263927$block_0$RUBY$__file__)\r\n  at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.RubyArray.eachCommon(RubyArray.java:1606)\r\n  at org.jruby.RubyArray.each(RubyArray.java:1613)\r\n  at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at rubyjit.LogStash::Pipeline$$cond_func_9859_b0383d340890bfe1540f572a350593995d4f6f351360263927.__file__((eval):25443)\r\n  at rubyjit.LogStash::Pipeline$$cond_func_9859_b0383d340890bfe1540f572a350593995d4f6f351360263927.__file__((eval))\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:181)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at rubyjit.LogStash::Pipeline$$filter_func_636c7c001a4cccfb3f002843a14238bcb57d497f1360263927.__file__((eval):12826)\r\n  at rubyjit.LogStash::Pipeline$$filter_func_636c7c001a4cccfb3f002843a14238bcb57d497f1360263927.__file__((eval))\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:181)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.CallNoArgBlockNode.interpret(CallNoArgBlockNode.java:60)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.WhenOneArgNode.whenSlowTest(WhenOneArgNode.java:36)\r\n  at org.jruby.ast.WhenOneArgNode.when(WhenOneArgNode.java:46)\r\n  at org.jruby.ast.CaseNode.interpret(CaseNode.java:133)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.WhileNode.interpret(WhileNode.java:131)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.ast.BeginNode.interpret(BeginNode.java:83)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:187)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136)\r\n  at org.jruby.ast.VCallNode.interpret(VCallNode.java:88)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"JRubyWorker-2\" daemon prio=10 tid=0x00007f88e8001000 nid=0x1e64 waiting on condition [0x00007f8911256000]\r\n   java.lang.Thread.State: WAITING (parking)\r\n  at sun.misc.Unsafe.park(Native Method)\r\n  - parking to wait for  <0x00000000a630fee8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)\r\n  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)\r\n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)\r\n  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)\r\n  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)\r\n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)\r\n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)\r\n  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"<redis\" daemon prio=10 tid=0x00007f88e01b7800 nid=0x1e63 in Object.wait() [0x00007f8911454000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  - waiting on <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at java.lang.Object.wait(Object.java:461)\r\n  at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049)\r\n  - locked <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065)\r\n  at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413)\r\n  at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:133)\r\n  - locked <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.runtime.callsite.ShiftLeftCallSite.call(ShiftLeftCallSite.java:24)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.block_0$RUBY$__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:134)\r\n  at rubyjit$LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927$block_0$RUBY$__file__.call(rubyjit$LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927$block_0$RUBY$__file__)\r\n  at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135)\r\n  at org.jruby.runtime.CompiledBlock19.yieldSpecific(CompiledBlock19.java:97)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:120)\r\n  at rubyjit.LogStash::Codecs::JSON$$decode_b42e37317405ae75b57c511e84fa39ba25541cf21360263927.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-codec-json-0.1.7/lib/logstash/codecs/json.rb:35)\r\n  at rubyjit.LogStash::Codecs::JSON$$decode_b42e37317405ae75b57c511e84fa39ba25541cf21360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-codec-json-0.1.7/lib/logstash/codecs/json.rb:34)\r\n  at rubyjit.LogStash::Codecs::JSON$$decode_b42e37317405ae75b57c511e84fa39ba25541cf21360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-codec-json-0.1.7/lib/logstash/codecs/json.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:132)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:131)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:221)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:202)\r\n  at rubyjit.LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927.block_0$RUBY$__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:159)\r\n  at rubyjit$LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927$block_0$RUBY$__file__.call(rubyjit$LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927$block_0$RUBY$__file__)\r\n  at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.RubyArray.eachCommon(RubyArray.java:1606)\r\n  at org.jruby.RubyArray.each(RubyArray.java:1613)\r\n  at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at rubyjit.LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:158)\r\n  at rubyjit.LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:157)\r\n  at rubyjit.LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:241)\r\n  at org.jruby.RubyClass.finvoke(RubyClass.java:587)\r\n  at org.jruby.RubyBasicObject.send19(RubyBasicObject.java:1513)\r\n  at org.jruby.RubyKernel.send19(RubyKernel.java:2243)\r\n  at org.jruby.RubyKernel$INVOKER$s$send19.call(RubyKernel$INVOKER$s$send19.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodOneOrTwoOrThreeOrNBlock.call(JavaMethod.java:384)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:236)\r\n  at org.jruby.ast.CallThreeArgNode.interpret(CallThreeArgNode.java:61)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.ast.BeginNode.interpret(BeginNode.java:83)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.WhileNode.interpret(WhileNode.java:131)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:225)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:219)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:202)\r\n  at org.jruby.ast.FCallTwoArgNode.interpret(FCallTwoArgNode.java:38)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.IfNode.interpret(IfNode.java:116)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.ast.BeginNode.interpret(BeginNode.java:83)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"JRubyWorker-1\" daemon prio=10 tid=0x00007f88ec001800 nid=0x1e62 waiting on condition [0x00007f8911658000]\r\n   java.lang.Thread.State: WAITING (parking)\r\n  at sun.misc.Unsafe.park(Native Method)\r\n  - parking to wait for  <0x00000000a630fee8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)\r\n  at java.util.concurrent.locks.LockSupport.park(LockSupport.java:186)\r\n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2043)\r\n  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1079)\r\n  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)\r\n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)\r\n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)\r\n  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"<redis\" daemon prio=10 tid=0x00007f88e01b6000 nid=0x1e61 in Object.wait() [0x00007f8911857000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  - waiting on <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at java.lang.Object.wait(Object.java:461)\r\n  at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049)\r\n  - locked <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065)\r\n  at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413)\r\n  at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:133)\r\n  - locked <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.runtime.callsite.ShiftLeftCallSite.call(ShiftLeftCallSite.java:24)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.block_0$RUBY$__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:134)\r\n  at rubyjit$LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927$block_0$RUBY$__file__.call(rubyjit$LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927$block_0$RUBY$__file__)\r\n  at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135)\r\n  at org.jruby.runtime.CompiledBlock19.yieldSpecific(CompiledBlock19.java:97)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:120)\r\n  at rubyjit.LogStash::Codecs::JSON$$decode_b42e37317405ae75b57c511e84fa39ba25541cf21360263927.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-codec-json-0.1.7/lib/logstash/codecs/json.rb:35)\r\n  at rubyjit.LogStash::Codecs::JSON$$decode_b42e37317405ae75b57c511e84fa39ba25541cf21360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-codec-json-0.1.7/lib/logstash/codecs/json.rb:34)\r\n  at rubyjit.LogStash::Codecs::JSON$$decode_b42e37317405ae75b57c511e84fa39ba25541cf21360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-codec-json-0.1.7/lib/logstash/codecs/json.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:132)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:131)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:221)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:202)\r\n  at rubyjit.LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:152)\r\n  at rubyjit.LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:241)\r\n  at org.jruby.RubyClass.finvoke(RubyClass.java:587)\r\n  at org.jruby.RubyBasicObject.send19(RubyBasicObject.java:1513)\r\n  at org.jruby.RubyKernel.send19(RubyKernel.java:2243)\r\n  at org.jruby.RubyKernel$INVOKER$s$send19.call(RubyKernel$INVOKER$s$send19.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodOneOrTwoOrThreeOrNBlock.call(JavaMethod.java:384)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:236)\r\n  at org.jruby.ast.CallThreeArgNode.interpret(CallThreeArgNode.java:61)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.ast.BeginNode.interpret(BeginNode.java:83)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.WhileNode.interpret(WhileNode.java:131)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:225)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:219)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:202)\r\n  at org.jruby.ast.FCallTwoArgNode.interpret(FCallTwoArgNode.java:38)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.IfNode.interpret(IfNode.java:116)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.ast.BeginNode.interpret(BeginNode.java:83)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"<redis\" daemon prio=10 tid=0x00007f88e0128000 nid=0x1e60 in Object.wait() [0x00007f8911a57000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  - waiting on <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at java.lang.Object.wait(Object.java:461)\r\n  at org.jruby.RubyThread$SleepTask.run(RubyThread.java:1049)\r\n  - locked <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.RubyThread.executeBlockingTask(RubyThread.java:1065)\r\n  at org.jruby.RubyThread.wait_timeout(RubyThread.java:1413)\r\n  at org.jruby.ext.thread.SizedQueue.push(SizedQueue.java:133)\r\n  - locked <0x00000000acba11a0> (a org.jruby.ext.thread.SizedQueue)\r\n  at org.jruby.ext.thread.SizedQueue$INVOKER$i$1$0$push.call(SizedQueue$INVOKER$i$1$0$push.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:168)\r\n  at org.jruby.runtime.callsite.ShiftLeftCallSite.call(ShiftLeftCallSite.java:24)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.block_0$RUBY$__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:134)\r\n  at rubyjit$LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927$block_0$RUBY$__file__.call(rubyjit$LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927$block_0$RUBY$__file__)\r\n  at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135)\r\n  at org.jruby.runtime.CompiledBlock19.yieldSpecific(CompiledBlock19.java:97)\r\n  at org.jruby.runtime.Block.yieldSpecific(Block.java:120)\r\n  at rubyjit.LogStash::Codecs::JSON$$decode_b42e37317405ae75b57c511e84fa39ba25541cf21360263927.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-codec-json-0.1.7/lib/logstash/codecs/json.rb:35)\r\n  at rubyjit.LogStash::Codecs::JSON$$decode_b42e37317405ae75b57c511e84fa39ba25541cf21360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-codec-json-0.1.7/lib/logstash/codecs/json.rb:34)\r\n  at rubyjit.LogStash::Codecs::JSON$$decode_b42e37317405ae75b57c511e84fa39ba25541cf21360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-codec-json-0.1.7/lib/logstash/codecs/json.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:201)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:177)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:188)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:132)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:131)\r\n  at rubyjit.LogStash::Inputs::Redis$$queue_event_9b5edc8f8afbb54018d2a4a5dda8e5efe5d42fb01360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:221)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:202)\r\n  at rubyjit.LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927.block_0$RUBY$__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:159)\r\n  at rubyjit$LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927$block_0$RUBY$__file__.call(rubyjit$LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927$block_0$RUBY$__file__)\r\n  at org.jruby.runtime.CompiledBlock19.yield(CompiledBlock19.java:135)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.RubyArray.eachCommon(RubyArray.java:1606)\r\n  at org.jruby.RubyArray.each(RubyArray.java:1613)\r\n  at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:143)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callIter(CachingCallSite.java:154)\r\n  at rubyjit.LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927.chained_0_rescue_1$RUBY$SYNTHETIC__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:158)\r\n  at rubyjit.LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb:157)\r\n  at rubyjit.LogStash::Inputs::Redis$$list_listener_c00bb00b9521490ae37c31d73a9f06dac84be3ac1360263927.__file__(/opt/logstash/vendor/bundle/jruby/1.9/gems/logstash-input-redis-0.1.5/lib/logstash/inputs/redis.rb)\r\n  at org.jruby.internal.runtime.methods.JittedMethod.call(JittedMethod.java:241)\r\n  at org.jruby.RubyClass.finvoke(RubyClass.java:587)\r\n  at org.jruby.RubyBasicObject.send19(RubyBasicObject.java:1513)\r\n  at org.jruby.RubyKernel.send19(RubyKernel.java:2243)\r\n  at org.jruby.RubyKernel$INVOKER$s$send19.call(RubyKernel$INVOKER$s$send19.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodOneOrTwoOrThreeOrNBlock.call(JavaMethod.java:384)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:236)\r\n  at org.jruby.ast.CallThreeArgNode.interpret(CallThreeArgNode.java:61)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.ast.BeginNode.interpret(BeginNode.java:83)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.WhileNode.interpret(WhileNode.java:131)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:225)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:219)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:346)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:204)\r\n  at org.jruby.ast.FCallTwoArgNode.interpret(FCallTwoArgNode.java:38)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.IfNode.interpret(IfNode.java:116)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170)\r\n  at org.jruby.ast.CallOneArgNode.interpret(CallOneArgNode.java:57)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.ast.BeginNode.interpret(BeginNode.java:83)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Ruby-0-Thread-4: /opt/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.19/lib/stud/task.rb:10\" daemon prio=10 tid=0x00007f892c2e9800 nid=0x1e3d in Object.wait() [0x00007f8911d91000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at java.lang.Thread.join(Thread.java:1289)\r\n  - locked <0x00000000a90166c0> (a java.lang.Thread)\r\n  at org.jruby.internal.runtime.NativeThread.join(NativeThread.java:75)\r\n  at org.jruby.RubyThread.join(RubyThread.java:696)\r\n  at org.jruby.RubyThread$INVOKER$i$0$1$join.call(RubyThread$INVOKER$i$0$1$join.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:677)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:286)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:81)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:85)\r\n  at org.jruby.RubySymbol$1.yieldInner(RubySymbol.java:454)\r\n  at org.jruby.RubySymbol$1.yield(RubySymbol.java:474)\r\n  at org.jruby.runtime.Block.yield(Block.java:142)\r\n  at org.jruby.RubyArray.eachCommon(RubyArray.java:1606)\r\n  at org.jruby.RubyArray.each(RubyArray.java:1613)\r\n  at org.jruby.RubyArray$INVOKER$i$0$0$each.call(RubyArray$INVOKER$i$0$0$each.gen)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:316)\r\n  at org.jruby.runtime.callsite.CachingCallSite.callBlock(CachingCallSite.java:145)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:149)\r\n  at org.jruby.ast.CallNoArgBlockPassNode.interpret(CallNoArgBlockPassNode.java:53)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:187)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136)\r\n  at org.jruby.ast.VCallNode.interpret(VCallNode.java:88)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:187)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136)\r\n  at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.ast.EnsureNode.interpret(EnsureNode.java:96)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:187)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136)\r\n  at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)\r\n  at org.jruby.ast.ReturnNode.interpret(ReturnNode.java:92)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call19(RubyProc.java:271)\r\n  at org.jruby.RubyProc$INVOKER$i$0$0$call19.call(RubyProc$INVOKER$i$0$0$call19.gen)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:202)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:198)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136)\r\n  at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call19(RubyProc.java:271)\r\n  at org.jruby.RubyProc$INVOKER$i$0$0$call19.call(RubyProc$INVOKER$i$0$0$call19.gen)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:202)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:198)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136)\r\n  at org.jruby.ast.CallSpecialArgNode.interpret(CallSpecialArgNode.java:65)\r\n  at org.jruby.ast.DAsgnNode.interpret(DAsgnNode.java:110)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.ast.RescueNode.executeBody(RescueNode.java:221)\r\n  at org.jruby.ast.RescueNode.interpret(RescueNode.java:116)\r\n  at org.jruby.ast.BeginNode.interpret(BeginNode.java:83)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_BLOCK(ASTInterpreter.java:112)\r\n  at org.jruby.runtime.Interpreted19Block.evalBlockBody(Interpreted19Block.java:206)\r\n  at org.jruby.runtime.Interpreted19Block.yield(Interpreted19Block.java:194)\r\n  at org.jruby.runtime.Interpreted19Block.call(Interpreted19Block.java:125)\r\n  at org.jruby.runtime.Block.call(Block.java:101)\r\n  at org.jruby.RubyProc.call(RubyProc.java:290)\r\n  at org.jruby.RubyProc.call(RubyProc.java:228)\r\n  at org.jruby.internal.runtime.RubyRunnable.run(RubyRunnable.java:99)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"ReferenceReaper\" daemon prio=10 tid=0x00007f892c251000 nid=0x1e3c in Object.wait() [0x00007f8911f94000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  - waiting on <0x00000000a6ba61e8> (a java.lang.ref.ReferenceQueue$Lock)\r\n  at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)\r\n  - locked <0x00000000a6ba61e8> (a java.lang.ref.ReferenceQueue$Lock)\r\n  at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)\r\n  at org.jruby.util.ReferenceReaper$1.run(ReferenceReaper.java:32)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Service Thread\" daemon prio=10 tid=0x00007f892c258800 nid=0x1e27 runnable [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C2 CompilerThread1\" daemon prio=10 tid=0x00007f892c256000 nid=0x1e26 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"C2 CompilerThread0\" daemon prio=10 tid=0x00007f892c254000 nid=0x1e25 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"metrics-graphite-reporter-thread-1\" daemon prio=10 tid=0x00007f892c248800 nid=0x1e24 waiting on condition [0x00007f8912f5e000]\r\n   java.lang.Thread.State: TIMED_WAITING (parking)\r\n  at sun.misc.Unsafe.park(Native Method)\r\n  - parking to wait for  <0x00000000a54987a0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)\r\n  at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)\r\n  at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)\r\n  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)\r\n  at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)\r\n  at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)\r\n  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)\r\n  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\r\n  at java.lang.Thread.run(Thread.java:745)\r\n\r\n\"Signal Dispatcher\" daemon prio=10 tid=0x00007f892c15b000 nid=0x1e23 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"Surrogate Locker Thread (Concurrent GC)\" daemon prio=10 tid=0x00007f892c159000 nid=0x1e22 waiting on condition [0x0000000000000000]\r\n   java.lang.Thread.State: RUNNABLE\r\n\r\n\"Finalizer\" daemon prio=10 tid=0x00007f892c139800 nid=0x1e21 in Object.wait() [0x00007f8913dfd000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:135)\r\n  - locked <0x00000000a549f2a8> (a java.lang.ref.ReferenceQueue$Lock)\r\n  at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:151)\r\n  at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:209)\r\n\r\n\"Reference Handler\" daemon prio=10 tid=0x00007f892c137800 nid=0x1e20 in Object.wait() [0x00007f8913ffe000]\r\n   java.lang.Thread.State: WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at java.lang.Object.wait(Object.java:503)\r\n  at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:133)\r\n  - locked <0x00000000a549f2d8> (a java.lang.ref.Reference$Lock)\r\n\r\n\"LogStash::Runner\" prio=10 tid=0x00007f892c00a800 nid=0x1e1b in Object.wait() [0x00007f8933127000]\r\n   java.lang.Thread.State: TIMED_WAITING (on object monitor)\r\n  at java.lang.Object.wait(Native Method)\r\n  at java.lang.Thread.join(Thread.java:1289)\r\n  - locked <0x00000000a6b4b410> (a java.lang.Thread)\r\n  at org.jruby.internal.runtime.NativeThread.join(NativeThread.java:75)\r\n  at org.jruby.RubyThread.join(RubyThread.java:696)\r\n  at org.jruby.RubyThread$INVOKER$i$0$1$join.call(RubyThread$INVOKER$i$0$1$join.gen)\r\n  at org.jruby.internal.runtime.methods.JavaMethod$JavaMethodN.call(JavaMethod.java:661)\r\n  at org.jruby.internal.runtime.methods.DynamicMethod.call(DynamicMethod.java:198)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136)\r\n  at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:139)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:187)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:306)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:136)\r\n  at org.jruby.ast.CallNoArgNode.interpret(CallNoArgNode.java:60)\r\n  at org.jruby.ast.FCallOneArgNode.interpret(FCallOneArgNode.java:36)\r\n  at org.jruby.ast.NewlineNode.interpret(NewlineNode.java:105)\r\n  at org.jruby.ast.BlockNode.interpret(BlockNode.java:71)\r\n  at org.jruby.evaluator.ASTInterpreter.INTERPRET_METHOD(ASTInterpreter.java:74)\r\n  at org.jruby.internal.runtime.methods.InterpretedMethod.call(InterpretedMethod.java:182)\r\n  at org.jruby.internal.runtime.methods.DefaultMethod.call(DefaultMethod.java:203)\r\n  at org.jruby.runtime.callsite.CachingCallSite.cacheAndCall(CachingCallSite.java:326)\r\n  at org.jruby.runtime.callsite.CachingCallSite.call(CachingCallSite.java:170)\r\n  at opt.logstash.lib.bootstrap.environment.__file__(/opt/logstash/lib/bootstrap/environment.rb:48)\r\n  at opt.logstash.lib.bootstrap.environment.load(/opt/logstash/lib/bootstrap/environment.rb)\r\n  at org.jruby.Ruby.runScript(Ruby.java:866)\r\n  at org.jruby.Ruby.runScript(Ruby.java:859)\r\n  at org.jruby.Ruby.runNormally(Ruby.java:728)\r\n  at org.jruby.Ruby.runFromMain(Ruby.java:577)\r\n  at org.jruby.Main.doRunFromMain(Main.java:395)\r\n  at org.jruby.Main.internalRun(Main.java:290)\r\n  at org.jruby.Main.run(Main.java:217)\r\n  at org.jruby.Main.main(Main.java:197)\r\n\r\n\"VM Thread\" prio=10 tid=0x00007f892c133000 nid=0x1e1f runnable\r\n\r\n\"Gang worker#0 (Parallel GC Threads)\" prio=10 tid=0x00007f892c01c000 nid=0x1e1c runnable\r\n\r\n\"Gang worker#1 (Parallel GC Threads)\" prio=10 tid=0x00007f892c01e000 nid=0x1e1d runnable\r\n\r\n\"Concurrent Mark-Sweep GC Thread\" prio=10 tid=0x00007f892c073800 nid=0x1e1e runnable\r\n\"VM Periodic Task Thread\" prio=10 tid=0x00007f892c26c000 nid=0x1e28 waiting on condition\r\n\r\nJNI global references: 307\r\n\r\nHeap\r\n par new generation   total 18112K, used 1377K [0x000000009ae00000, 0x000000009c1a0000, 0x00000000a5460000)\r\n  eden space 16128K,   3% used [0x000000009ae00000, 0x000000009ae98f08, 0x000000009bdc0000)\r\n  from space 1984K,  38% used [0x000000009bdc0000, 0x000000009be7f580, 0x000000009bfb0000)\r\n  to   space 1984K,   0% used [0x000000009bfb0000, 0x000000009bfb0000, 0x000000009c1a0000)\r\n concurrent mark-sweep generation total 244548K, used 164367K [0x00000000a5460000, 0x00000000b4331000, 0x00000000fae00000)\r\n concurrent-mark-sweep perm gen total 67260K, used 40841K [0x00000000fae00000, 0x00000000fefaf000, 0x0000000100000000)\r\n```\r\n\r\nThe configuration is pretty large and is split into various files so we can customise for different environments. I've tried to rename things that are private and I'm going to redact a couple of the files and describe what they do so hopefully you'll get the picture.\r\n\r\n```\r\ninput {\r\n  redis {\r\n    host => \"logstash-redis\"\r\n    port => 6379\r\n    type => \"redis-input\"\r\n    data_type => \"list\"\r\n    batch_count => 50\r\n    key => \"new-logstash\"\r\n  }\r\n  redis {\r\n    host => \"logstash-redis\"\r\n    port => 6379\r\n    type => \"application-log\"\r\n    data_type => \"list\"\r\n    batch_count => 50\r\n    key => \"timburr\"\r\n  }\r\n  redis {\r\n    host => \"logstash-redis\"\r\n    port => 6379\r\n    type => \"aws-log\"\r\n    data_type => \"list\"\r\n    batch_count => 50\r\n    key => \"cloudtrail\"\r\n  }\r\n}\r\nfilter {\r\n  environment {\r\n    add_field_from_env => [ \"processing_box_id\", \"BOX_ID\" ]\r\n  }\r\n  if [type] == \"summary-log\" {\r\n    json {\r\n      source => \"message\"\r\n      remove_field => [ \"message\" ]\r\n    }\r\n  }\r\n  if [type] == \"matcher-info-log\" or [type] == \"rex-info-log\" or ([type] == \"application-log\" and !(\"no-processing\" in [tags])) {\r\n    mutate {\r\n      rename => [ \"message\", \"json_message\" ]\r\n    }\r\n    json {\r\n      source => \"json_message\"\r\n      remove_field => [ \"json_message\" ]\r\n    }\r\n  }\r\n  if [type] == \"application-log\" and [custom][DeviceId] =~ /.+/ {\r\n    grok {\r\n      patterns_dir => \"/etc/logstash/patterns\"\r\n      match => [ \"[custom][DeviceId]\", \"%{STARTOFGUID:[custom][DeviceIdStart]}\" ]\r\n    }\r\n  }\r\n}\r\noutput {\r\n  statsd {\r\n    host => \"statsd\"\r\n    port => 8125\r\n    namespace => \"environment\"\r\n    sender => \"logstashindexer\"\r\n    increment => \"%{processing_box_id}.logsProcessed.%{type}\"\r\n  }\r\n  if \"_jsonparsefailure\" in [tags] {\r\n    statsd {\r\n      host => \"statsd\"\r\n      port => 8125\r\n      namespace => \"environment\"\r\n      sender => \"logstashindexer\"\r\n      increment => \"%{processing_box_id}.logsFailed.json.%{type}\"\r\n    }\r\n  }\r\n  if \"_grokparsefailure\" in [tags] {\r\n    statsd {\r\n      host => \"statsd\"\r\n      port => 8125\r\n      namespace => \"environment\"\r\n      sender => \"logstashindexer\"\r\n      increment => \"%{processing_box_id}.logsFailed.grok.%{type}\"\r\n    }\r\n  }\r\n  if [type] == \"application-log\" {\r\n    if [log-id] =~ /.+/ {\r\n      elasticsearch {\r\n        document_id => \"%{log-id}\"\r\n        host => \"application-log-elasticsearch\"\r\n        manage_template => false\r\n        port => 80\r\n        protocol => \"http\"\r\n      }\r\n    } else if [id] =~ /.+/ {\r\n      elasticsearch {\r\n        document_id => \"%{id}\"\r\n        host => \"application-log-elasticsearch\"\r\n        manage_template => false\r\n        port => 80\r\n        protocol => \"http\"\r\n      }\r\n    } else {\r\n      elasticsearch {\r\n        host => \"application-log-elasticsearch\"\r\n        manage_template => false\r\n        port => 80\r\n        protocol => \"http\"\r\n      }\r\n    }\r\n  } else {\r\n    elasticsearch {\r\n      host => \"logstash-elasticsearch\"\r\n      manage_template => false\r\n      port => 80\r\n      protocol => \"http\"\r\n    }\r\n  }\r\n  if [application] =~ /.+/ and \"request-log\" in [tags] {\r\n    redis {\r\n      host => \"logstash-redis\"\r\n      port => 6379\r\n      key => \"%{application}-requests\"\r\n      data_type => \"channel\"\r\n    }\r\n  }\r\n}\r\n```\r\n\r\n```\r\nfilter {\r\n  if [message] =~ /^$/ or [message] =~ /^\\s*#/ {\r\n    drop {\r\n    }\r\n  }\r\n  if [type] == \"linux-syslog\" {\r\n    if [file] =~ /\\/var\\/log\\/boot.log$/ or [path] =~ /\\/var\\/log\\/boot.log$/ {\r\n      grok {\r\n        match => [ \"message\", \"%{GREEDYDATA:message}\" ]\r\n        overwrite => [ \"message\" ]\r\n      }\r\n    } else if [file] =~ /\\/var\\/log\\/yum.log$/ or [path] =~ /\\/var\\/log\\/yum.log$/ {\r\n      grok {\r\n        match => [ \"message\", \"(?:%{SYSLOGTIMESTAMP:timestamp}|%{TIMESTAMP_ISO8601:timestamp8601}) %{GREEDYDATA:message}\" ]\r\n        overwrite => [ \"message\" ]\r\n      }\r\n    } else {\r\n      grok {\r\n        match => [ \"message\", \"%{SYSLOGLINE}\" ]\r\n        overwrite => [ \"message\" ]\r\n      }\r\n    }\r\n    date {\r\n      match => [ \"timestamp\", \"MMM  d HH:mm:ss\", \"MMM dd HH:mm:ss\" ]\r\n    }\r\n    mutate {\r\n      gsub => [\"message\", \"\\x1B\\[([0-9]{1,2}(;[0-9]{1,2})?)?[m|K]\", \"\"]\r\n    }\r\n  }\r\n  if [type] == \"apache-request-log\" {\r\n    if !(\"request-log\" in [tags]) {\r\n      mutate {\r\n        add_tag => [ \"request-log\" ]\r\n      }\r\n    }\r\n    grok {\r\n      patterns_dir => \"/etc/logstash/patterns\"\r\n      match => [ \"message\", \"%{CUSTOMAPACHELOG}\" ]\r\n    }\r\n    date {\r\n      match => [ \"timestamp\", \"dd/MMM/yyyy:HH:mm:ss Z\" ]\r\n    }\r\n  }\r\n  if [type] == \"apache-error-log\" {\r\n    grok {\r\n      patterns_dir => \"/etc/logstash/patterns\"\r\n      match => [ \"message\", \"%{APACHEERRORLOG}\" ]\r\n      overwrite => [ \"message\" ]\r\n    }\r\n    date {\r\n      match => [ \"timestamp\", \"MMM dd HH:mm:ss yyyy\" ]\r\n    }\r\n  }\r\n  if [type] == \"jetty-request-log\" {\r\n    if !(\"request-log\" in [tags]) {\r\n      mutate {\r\n        add_tag => [ \"request-log\" ]\r\n      }\r\n    }\r\n    grok {\r\n      patterns_dir => \"/etc/logstash/patterns\"\r\n      match => [ \"message\", \"%{JETTYREQUESTLOG}\", \"message\", \"%{OLDJETTYREQUESTLOG}\" ]\r\n    }\r\n    date {\r\n      match => [ \"timestamp\", \"dd/MMM/yyyy:HH:mm:ss Z\" ]\r\n    }\r\n    mutate {\r\n      split => [ \"forwardedfor\", \",\" ]\r\n    }\r\n    if \"enforcer\" in [tags] and ([querystring] =~ /app_id=/ or [querystring] =~ /client_id=/) {\r\n      mutate {\r\n        add_tag => [ \"third-party\" ]\r\n      }\r\n    }\r\n  }\r\n  if [type] == \"jboss-request-log\" {\r\n    if !(\"request-log\" in [tags]) {\r\n      mutate {\r\n        add_tag => [ \"request-log\" ]\r\n      }\r\n    }\r\n    grok {\r\n      patterns_dir => \"/etc/logstash/patterns\"\r\n      match => [ \"message\", \"%{JBOSSREQUESTLOG}\" ]\r\n    }\r\n    mutate {\r\n      replace => [ \"timestamp\", \"%{timestamp} +0000\" ]\r\n    }\r\n    date {\r\n      match => [ \"timestamp\", \"yyyy-MM-dd HH:mm:ss Z\" ]\r\n    }\r\n  }\r\n  if [querystring] =~ /.+/ {\r\n    mutate {\r\n      add_tag => [\"hasquerystring\"]\r\n    }\r\n  }\r\n  if ([type] == \"apache-request-log\" or [type] == \"jetty-request-log\" or [type] == \"jboss-request-log\") and \"hasquerystring\" in [tags] {\r\n    kv {\r\n      field_split => \"&\"\r\n      source => \"querystring\"\r\n      prefix => \"qs_\"\r\n    }\r\n  }\r\n  mutate {\r\n    lowercase => [ \"host\" ]\r\n  }\r\n  mutate {\r\n    gsub => [ \"clientip\", \"::1\", \"127.0.0.1\" ]\r\n  }\r\n  mutate {\r\n    gsub => [ \"clientip\", \"0:0:0:0:0:0:0:1%0\", \"127.0.0.1\" ]\r\n  }\r\n  mutate {\r\n    gsub => [ \"clientip\", \"0:0:0:0:0:0:0:1\", \"127.0.0.1\" ]\r\n  }\r\n  if [type] == \"jboss-request-log\" {\r\n    mutate {\r\n      convert => [ \"latency\", \"string\" ]\r\n    }\r\n    mutate {\r\n      gsub => [ \"latency\", \"\\.\", \"\" ]\r\n    }\r\n  }\r\n  mutate {\r\n    convert => [ \"latency\", \"integer\" ]\r\n  }\r\n  mutate {\r\n    convert => [ \"response\", \"integer\" ]\r\n  }\r\n  mutate {\r\n    remove_field => [ \"timestamp\" ]\r\n    remove_tag => [ \"hasquerystring\" ]\r\n    strip => [ \"message\" ]\r\n  }\r\n}\r\n```\r\n\r\nThe last of the configuration files are repeats of roughly the same sort of thing:\r\n\r\n```\r\nfilter {\r\n  if [type] == \"jetty-request-log\" and \"enforcer\" in [tags] {\r\n    if !(\"grokked\" in [tags]) {\r\n      grok {\r\n        patterns_dir => \"/etc/logstash/request-patterns\"\r\n        match => [ \"requestpath\", \"^%{PATTERN}$\" ]\r\n        add_field => [ \"method\", \"some-method\" ]\r\n        add_tag => [ \"grokked\", \"private\" ]\r\n        tag_on_failure => []\r\n      }\r\n    }\r\n    ... repeat this sort of thing for various different patterns ...\r\n  }\r\n}\r\n```\r\n\r\nWe've got over 100 of those sorts of `grok` patterns.\r\n\r\nI've tried various configurations but can't seem to make it work reliably for any length of time. In terms of normal volume of use we'll tend to get about 35k messages per hour so it's nowhere close to our bigger Logstash 1.4.2 cluster which quite happily handles about 4m messages per hour at peak times. I haven't upgraded that cluster since I want our development cluster to work reliably first (which is where I discovered this problem).\r\n\r\nAny help or advice would be greatly appreciated. The processes are still running (and dead) and I can provide more information if required."},"comment":{"url":"https://api.github.com/repos/elastic/logstash/issues/comments/105531168","html_url":"https://github.com/elastic/logstash/issues/3302#issuecomment-105531168","issue_url":"https://api.github.com/repos/elastic/logstash/issues/3302","id":105531168,"user":{"login":"neilprosser","id":231666,"avatar_url":"https://avatars.githubusercontent.com/u/231666?v=3","gravatar_id":"","url":"https://api.github.com/users/neilprosser","html_url":"https://github.com/neilprosser","followers_url":"https://api.github.com/users/neilprosser/followers","following_url":"https://api.github.com/users/neilprosser/following{/other_user}","gists_url":"https://api.github.com/users/neilprosser/gists{/gist_id}","starred_url":"https://api.github.com/users/neilprosser/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/neilprosser/subscriptions","organizations_url":"https://api.github.com/users/neilprosser/orgs","repos_url":"https://api.github.com/users/neilprosser/repos","events_url":"https://api.github.com/users/neilprosser/events{/privacy}","received_events_url":"https://api.github.com/users/neilprosser/received_events","type":"User","site_admin":false},"created_at":"2015-05-26T13:50:47Z","updated_at":"2015-05-26T13:50:47Z","body":"Ok. I've also noticed that those Redis messages stopped after about seven minutes and that had occurred when the thread dump was taken.\r\n\r\nI'm going to try restarting Logstash with the same regex matched twice."}}