{"action":"created","issue":{"url":"https://api.github.com/repos/rancher/rancher/issues/2339","labels_url":"https://api.github.com/repos/rancher/rancher/issues/2339/labels{/name}","comments_url":"https://api.github.com/repos/rancher/rancher/issues/2339/comments","events_url":"https://api.github.com/repos/rancher/rancher/issues/2339/events","html_url":"https://github.com/rancher/rancher/issues/2339","id":111296653,"number":2339,"title":"OutOfMemoryErrors when dealing with large scale environments","user":{"login":"gordontyler","id":13695544,"avatar_url":"https://avatars.githubusercontent.com/u/13695544?v=3","gravatar_id":"","url":"https://api.github.com/users/gordontyler","html_url":"https://github.com/gordontyler","followers_url":"https://api.github.com/users/gordontyler/followers","following_url":"https://api.github.com/users/gordontyler/following{/other_user}","gists_url":"https://api.github.com/users/gordontyler/gists{/gist_id}","starred_url":"https://api.github.com/users/gordontyler/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gordontyler/subscriptions","organizations_url":"https://api.github.com/users/gordontyler/orgs","repos_url":"https://api.github.com/users/gordontyler/repos","events_url":"https://api.github.com/users/gordontyler/events{/privacy}","received_events_url":"https://api.github.com/users/gordontyler/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":8,"created_at":"2015-10-14T00:08:24Z","updated_at":"2015-10-15T20:23:35Z","closed_at":null,"body":"I have a Rancher (v0.41.0) server with an environment that contains 7 hosts running 320 containers across 16 services in a single stack. I scale up the number of containers slowly but somewhere in the 250-300 range the Rancher server starts failing with GC errors:\r\n\r\njava.lang.OutOfMemoryError: GC overhead limit exceeded\r\n\r\nI grabbed the heap dump file from the container, if you're interested.  136MB gzipped.\r\n\r\nRestarting the Rancher Server container gets it going again but it's pretty fragile at this point. I'm guessing I need to increase the max heap size for the Rancher server, but I haven't figured that part out yet."},"comment":{"url":"https://api.github.com/repos/rancher/rancher/issues/comments/148510031","html_url":"https://github.com/rancher/rancher/issues/2339#issuecomment-148510031","issue_url":"https://api.github.com/repos/rancher/rancher/issues/2339","id":148510031,"user":{"login":"gordontyler","id":13695544,"avatar_url":"https://avatars.githubusercontent.com/u/13695544?v=3","gravatar_id":"","url":"https://api.github.com/users/gordontyler","html_url":"https://github.com/gordontyler","followers_url":"https://api.github.com/users/gordontyler/followers","following_url":"https://api.github.com/users/gordontyler/following{/other_user}","gists_url":"https://api.github.com/users/gordontyler/gists{/gist_id}","starred_url":"https://api.github.com/users/gordontyler/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gordontyler/subscriptions","organizations_url":"https://api.github.com/users/gordontyler/orgs","repos_url":"https://api.github.com/users/gordontyler/repos","events_url":"https://api.github.com/users/gordontyler/events{/privacy}","received_events_url":"https://api.github.com/users/gordontyler/received_events","type":"User","site_admin":false},"created_at":"2015-10-15T20:23:35Z","updated_at":"2015-10-15T20:23:35Z","body":"Doing any kind of significant rancher-compose action appears to cause significant processing in Rancher server. I just removed the 4 apps I added earlier so that I could re-add them with an updated image (I have to do it like this because in-place upgrade is not available yet) and although the `rancher-compose rm` command returned pretty quickly, the server process has been pegging the CPU and the UI has been unresponsive for a few minutes."}}