{"action":"created","issue":{"url":"https://api.github.com/repos/rancher/rancher/issues/1219","labels_url":"https://api.github.com/repos/rancher/rancher/issues/1219/labels{/name}","comments_url":"https://api.github.com/repos/rancher/rancher/issues/1219/comments","events_url":"https://api.github.com/repos/rancher/rancher/issues/1219/events","html_url":"https://github.com/rancher/rancher/issues/1219","id":88184977,"number":1219,"title":"too many open files?","user":{"login":"joshuacox","id":6137404,"avatar_url":"https://avatars.githubusercontent.com/u/6137404?v=3","gravatar_id":"","url":"https://api.github.com/users/joshuacox","html_url":"https://github.com/joshuacox","followers_url":"https://api.github.com/users/joshuacox/followers","following_url":"https://api.github.com/users/joshuacox/following{/other_user}","gists_url":"https://api.github.com/users/joshuacox/gists{/gist_id}","starred_url":"https://api.github.com/users/joshuacox/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/joshuacox/subscriptions","organizations_url":"https://api.github.com/users/joshuacox/orgs","repos_url":"https://api.github.com/users/joshuacox/repos","events_url":"https://api.github.com/users/joshuacox/events{/privacy}","received_events_url":"https://api.github.com/users/joshuacox/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/rancher/rancher/labels/area/agent","name":"area/agent","color":"FBCA04"},{"url":"https://api.github.com/repos/rancher/rancher/labels/kind/bug","name":"kind/bug","color":"fc2929"}],"state":"open","locked":false,"assignee":{"login":"ibuildthecloud","id":1754002,"avatar_url":"https://avatars.githubusercontent.com/u/1754002?v=3","gravatar_id":"","url":"https://api.github.com/users/ibuildthecloud","html_url":"https://github.com/ibuildthecloud","followers_url":"https://api.github.com/users/ibuildthecloud/followers","following_url":"https://api.github.com/users/ibuildthecloud/following{/other_user}","gists_url":"https://api.github.com/users/ibuildthecloud/gists{/gist_id}","starred_url":"https://api.github.com/users/ibuildthecloud/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ibuildthecloud/subscriptions","organizations_url":"https://api.github.com/users/ibuildthecloud/orgs","repos_url":"https://api.github.com/users/ibuildthecloud/repos","events_url":"https://api.github.com/users/ibuildthecloud/events{/privacy}","received_events_url":"https://api.github.com/users/ibuildthecloud/received_events","type":"User","site_admin":false},"milestone":null,"comments":9,"created_at":"2015-06-14T13:30:09Z","updated_at":"2015-09-04T20:44:30Z","closed_at":null,"body":"I know this sort of stuff has been discussed extensively in the past, but I feel that I don't have enough containers to have run into this issue.  I have four days uptime on a rancherOS node, and yet with just a handful of containers running I'm hitting the `too many open files` wall.  I can certainly fix things from here and get it working by doing some cleanup, but I feel very much that I am just treating the symptom of a larger issue.  I suspect the root cause is something with overlay itself piling up openfiles.\r\n\r\n```\r\nrancher@rancher:~$ docker run --name $OVPN_DATA -v /etc/openvpn busybox\r\nFATA[0000] Error response from daemon: open /var/lib/docker/repositories-overlay: too many open files \r\nrancher@rancher:~$ docker ps -a\r\nCONTAINER ID        IMAGE                             COMMAND                CREATED             STATUS                       PORTS                                          NAMES\r\nb50eb510e8ae        rancher/agent-instance:v0.3.1     \"/etc/init.d/agent-i   3 days ago          Up 3 days                                                                   a30d13a2-b6c0-4918-be81-4ddad1f91ead   \r\n216acc9c7ed9        nginx:latest                      \"nginx -g 'daemon of   3 days ago          Up 3 days                    80/tcp, 443/tcp                                9c042341-ee20-48f4-ba1c-fff2103cc0fe   \r\nd054276ff9da        mysql:latest                      \"/entrypoint.sh mysq   3 days ago          Up 3 days                    3306/tcp                                       00b0bb7e-315b-4ba4-902a-d5dfe7958e1d   \r\n1bdd4a1be033        rancher/agent:v0.7.9              \"/run.sh run\"          3 days ago          Up 3 days                                                                   rancher-agent                          \r\n8257cff9bb54        joshuacox/docker-icinga2:latest   \"/entrypoint.sh /usr   4 days ago          Up 4 days                    80/tcp                                         54a086b4-979b-4bcb-9053-938323279085   \r\nc913c04cc127        rancher/agent-instance:v0.3.1     \"/etc/init.d/agent-i   4 days ago          Up 4 days                    0.0.0.0:500->500/udp, 0.0.0.0:4500->4500/udp   74525b44-5a30-40dc-8f0d-37a9418de210   \r\ne9c18cc8e015        rancher/agent:v0.7.9              \"/run.sh state\"        4 days ago          Exited (0) 4 days ago                                                       rancher-agent-state                    \r\nbb5ca9d03bc1        rancher/agent:v0.7.9              \"/run.sh http://ranc   4 days ago          Restarting (-1) 2 days ago \r\n```"},"comment":{"url":"https://api.github.com/repos/rancher/rancher/issues/comments/137847896","html_url":"https://github.com/rancher/rancher/issues/1219#issuecomment-137847896","issue_url":"https://api.github.com/repos/rancher/rancher/issues/1219","id":137847896,"user":{"login":"EliSnow","id":714089,"avatar_url":"https://avatars.githubusercontent.com/u/714089?v=3","gravatar_id":"","url":"https://api.github.com/users/EliSnow","html_url":"https://github.com/EliSnow","followers_url":"https://api.github.com/users/EliSnow/followers","following_url":"https://api.github.com/users/EliSnow/following{/other_user}","gists_url":"https://api.github.com/users/EliSnow/gists{/gist_id}","starred_url":"https://api.github.com/users/EliSnow/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/EliSnow/subscriptions","organizations_url":"https://api.github.com/users/EliSnow/orgs","repos_url":"https://api.github.com/users/EliSnow/repos","events_url":"https://api.github.com/users/EliSnow/events{/privacy}","received_events_url":"https://api.github.com/users/EliSnow/received_events","type":"User","site_admin":false},"created_at":"2015-09-04T20:44:30Z","updated_at":"2015-09-04T20:44:30Z","body":"@imikushin, how can I change these settings in an existing, running RancherOS v0.3.3 server? I need to up the open file limit for a database container but `ulimit -n unlimited` gives me `ulimit: open files: cannot modify limit: Operation not permitted` and modifying `/etc/security/limit.conf` doesn't seem to have any affect."}}