{"action":"closed","issue":{"url":"https://api.github.com/repos/logsearch/logsearch-for-aws/issues/3","labels_url":"https://api.github.com/repos/logsearch/logsearch-for-aws/issues/3/labels{/name}","comments_url":"https://api.github.com/repos/logsearch/logsearch-for-aws/issues/3/comments","events_url":"https://api.github.com/repos/logsearch/logsearch-for-aws/issues/3/events","html_url":"https://github.com/logsearch/logsearch-for-aws/issues/3","id":64301543,"number":3,"title":"Too many open files","user":{"login":"dpb587","id":207601,"avatar_url":"https://avatars.githubusercontent.com/u/207601?v=3","gravatar_id":"","url":"https://api.github.com/users/dpb587","html_url":"https://github.com/dpb587","followers_url":"https://api.github.com/users/dpb587/followers","following_url":"https://api.github.com/users/dpb587/following{/other_user}","gists_url":"https://api.github.com/users/dpb587/gists{/gist_id}","starred_url":"https://api.github.com/users/dpb587/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dpb587/subscriptions","organizations_url":"https://api.github.com/users/dpb587/orgs","repos_url":"https://api.github.com/users/dpb587/repos","events_url":"https://api.github.com/users/dpb587/events{/privacy}","received_events_url":"https://api.github.com/users/dpb587/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2015-03-25T15:41:15Z","updated_at":"2015-07-08T19:41:28Z","closed_at":"2015-07-08T19:41:28Z","body":"We get the following error about having too many open files after the ingestor receives a large backlog of events. Probably fixable with a ulimit command in job control.\r\n\r\n    {:timestamp=>\"2015-03-25T15:37:50.495000+0000\", :message=>\"Failed to flush outgoing items\", :outgoing_count=>182, :exception=>#<SocketError: initialize: java.net.SocketException: Too many open files>, :backtrace=>[\"org/jruby/ext/socket/RubySocket.java:190:in `initialize'\", \"org/jruby/RubyIO.java:852:in `new'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/connection.rb:146:in `connect'\", \"org/jruby/RubyArray.java:1613:in `each'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/connection.rb:139:in `connect'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/agent.rb:406:in `connect'\", \"org/jruby/RubyProc.java:271:in `call'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/pool.rb:48:in `fetch'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/agent.rb:403:in `connect'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/agent.rb:319:in `execute'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/ftw-0.0.39/lib/ftw/agent.rb:217:in `post!'\", \"/var/vcap/packages/logstash/logstash/lib/logstash/outputs/elasticsearch_http.rb:218:in `post'\", \"/var/vcap/packages/logstash/logstash/lib/logstash/outputs/elasticsearch_http.rb:213:in `flush'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:219:in `buffer_flush'\", \"org/jruby/RubyHash.java:1339:in `each'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:216:in `buffer_flush'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:193:in `buffer_flush'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:112:in `buffer_initialize'\", \"org/jruby/RubyKernel.java:1521:in `loop'\", \"/var/vcap/packages/logstash/logstash/vendor/bundle/jruby/1.9/gems/stud-0.0.17/lib/stud/buffer.rb:110:in `buffer_initialize'\"], :level=>:warn}"}}