{"action":"created","issue":{"url":"https://api.github.com/repos/jprante/elasticsearch-jdbc/issues/648","labels_url":"https://api.github.com/repos/jprante/elasticsearch-jdbc/issues/648/labels{/name}","comments_url":"https://api.github.com/repos/jprante/elasticsearch-jdbc/issues/648/comments","events_url":"https://api.github.com/repos/jprante/elasticsearch-jdbc/issues/648/events","html_url":"https://github.com/jprante/elasticsearch-jdbc/issues/648","id":108004594,"number":648,"title":"File descriptors not released","user":{"login":"feaster83","id":5092170,"avatar_url":"https://avatars.githubusercontent.com/u/5092170?v=3","gravatar_id":"","url":"https://api.github.com/users/feaster83","html_url":"https://github.com/feaster83","followers_url":"https://api.github.com/users/feaster83/followers","following_url":"https://api.github.com/users/feaster83/following{/other_user}","gists_url":"https://api.github.com/users/feaster83/gists{/gist_id}","starred_url":"https://api.github.com/users/feaster83/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/feaster83/subscriptions","organizations_url":"https://api.github.com/users/feaster83/orgs","repos_url":"https://api.github.com/users/feaster83/repos","events_url":"https://api.github.com/users/feaster83/events{/privacy}","received_events_url":"https://api.github.com/users/feaster83/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-09-23T20:56:49Z","updated_at":"2015-09-28T12:01:59Z","closed_at":null,"body":"I have a problem on our Linux system with the feeders. Our server is running out of resources when only a single feeder instance is active. Note: We have a limited amount of File Descriptors.\r\n\r\nI checked the count of file descriptors under /proc/\\<pid>/fd/ with the command:\r\n> ls /proc/\\<pid>/fd | wc -l\r\n\r\nand I see the the number of file descriptors is increasing. I think it will increased by 1 after each execution of the feeder. Most of the file descriptors are pipes between/in the same process. \r\n\r\nI debugged the code around the future/executors (Cron based), because pipes will be used between threads, but still can't find any issue in this part of the code. \r\n\r\nNote: we use a forked version of the elasticsearch-jdbc project and made some small changes (add some code to support a specific functionality). I think that the issue is in the original source and not related to our changes."},"comment":{"url":"https://api.github.com/repos/jprante/elasticsearch-jdbc/issues/comments/143724084","html_url":"https://github.com/jprante/elasticsearch-jdbc/issues/648#issuecomment-143724084","issue_url":"https://api.github.com/repos/jprante/elasticsearch-jdbc/issues/648","id":143724084,"user":{"login":"feaster83","id":5092170,"avatar_url":"https://avatars.githubusercontent.com/u/5092170?v=3","gravatar_id":"","url":"https://api.github.com/users/feaster83","html_url":"https://github.com/feaster83","followers_url":"https://api.github.com/users/feaster83/followers","following_url":"https://api.github.com/users/feaster83/following{/other_user}","gists_url":"https://api.github.com/users/feaster83/gists{/gist_id}","starred_url":"https://api.github.com/users/feaster83/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/feaster83/subscriptions","organizations_url":"https://api.github.com/users/feaster83/orgs","repos_url":"https://api.github.com/users/feaster83/repos","events_url":"https://api.github.com/users/feaster83/events{/privacy}","received_events_url":"https://api.github.com/users/feaster83/received_events","type":"User","site_admin":false},"created_at":"2015-09-28T12:01:59Z","updated_at":"2015-09-28T12:01:59Z","body":"There is still an issue with the Threading:\r\n\r\nReproduction:\r\n- Start Feeder with interval of 10 seconds but without starting an Elasticsearch cluster \r\n- Connect with VisualVM (or a tool like that) to the Feeder. Each 10 seconds it creates ES clients but never cleaned then up.  \r\n- Running threads is counting up. "}}