{"action":"created","issue":{"url":"https://api.github.com/repos/docker/swarm/issues/786","labels_url":"https://api.github.com/repos/docker/swarm/issues/786/labels{/name}","comments_url":"https://api.github.com/repos/docker/swarm/issues/786/comments","events_url":"https://api.github.com/repos/docker/swarm/issues/786/events","html_url":"https://github.com/docker/swarm/issues/786","id":76195710,"number":786,"title":"Overloaded swarm node breaks the rest of the cluster","user":{"login":"zstarer","id":8236771,"avatar_url":"https://avatars.githubusercontent.com/u/8236771?v=3","gravatar_id":"","url":"https://api.github.com/users/zstarer","html_url":"https://github.com/zstarer","followers_url":"https://api.github.com/users/zstarer/followers","following_url":"https://api.github.com/users/zstarer/following{/other_user}","gists_url":"https://api.github.com/users/zstarer/gists{/gist_id}","starred_url":"https://api.github.com/users/zstarer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zstarer/subscriptions","organizations_url":"https://api.github.com/users/zstarer/orgs","repos_url":"https://api.github.com/users/zstarer/repos","events_url":"https://api.github.com/users/zstarer/events{/privacy}","received_events_url":"https://api.github.com/users/zstarer/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/docker/swarm/labels/kind/bug","name":"kind/bug","color":"207de5"},{"url":"https://api.github.com/repos/docker/swarm/labels/priority/P1","name":"priority/P1","color":"e11d21"}],"state":"closed","locked":false,"assignee":{"login":"abronan","id":1655859,"avatar_url":"https://avatars.githubusercontent.com/u/1655859?v=3","gravatar_id":"","url":"https://api.github.com/users/abronan","html_url":"https://github.com/abronan","followers_url":"https://api.github.com/users/abronan/followers","following_url":"https://api.github.com/users/abronan/following{/other_user}","gists_url":"https://api.github.com/users/abronan/gists{/gist_id}","starred_url":"https://api.github.com/users/abronan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/abronan/subscriptions","organizations_url":"https://api.github.com/users/abronan/orgs","repos_url":"https://api.github.com/users/abronan/repos","events_url":"https://api.github.com/users/abronan/events{/privacy}","received_events_url":"https://api.github.com/users/abronan/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/docker/swarm/milestones/5","html_url":"https://github.com/docker/swarm/milestones/0.5.0","labels_url":"https://api.github.com/repos/docker/swarm/milestones/5/labels","id":1191592,"number":5,"title":"0.5.0","description":"","creator":{"login":"aluzzardi","id":179503,"avatar_url":"https://avatars.githubusercontent.com/u/179503?v=3","gravatar_id":"","url":"https://api.github.com/users/aluzzardi","html_url":"https://github.com/aluzzardi","followers_url":"https://api.github.com/users/aluzzardi/followers","following_url":"https://api.github.com/users/aluzzardi/following{/other_user}","gists_url":"https://api.github.com/users/aluzzardi/gists{/gist_id}","starred_url":"https://api.github.com/users/aluzzardi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aluzzardi/subscriptions","organizations_url":"https://api.github.com/users/aluzzardi/orgs","repos_url":"https://api.github.com/users/aluzzardi/repos","events_url":"https://api.github.com/users/aluzzardi/events{/privacy}","received_events_url":"https://api.github.com/users/aluzzardi/received_events","type":"User","site_admin":false},"open_issues":45,"closed_issues":30,"state":"open","created_at":"2015-07-02T21:20:49Z","updated_at":"2015-10-13T05:32:50Z","due_on":"2015-10-12T07:00:00Z","closed_at":null},"comments":3,"created_at":"2015-05-14T02:00:10Z","updated_at":"2015-10-13T05:32:50Z","closed_at":"2015-10-13T05:32:50Z","body":"Hi guys -\r\n\r\nWe've been experimenting (A LOT) with swarm lately. One issue we've just discovered is that overloading any particular node in the cluster can break certain functionality expected from the master.\r\n\r\nOn one node, we had ~150 containers running , and can no longer hit the docker daemon (on that node) to see what's running (I think there's just no resources left) however, we can still hit the swarm master to return some data:\r\n\r\n ip-10-0-.ec2.internal: 10.0.:2375\r\n  └ Containers: 169\r\n  └ Reserved CPUs: 0 / 2\r\n  └ Reserved Memory: 2.734 GiB / 15.69 GiB\r\n ip-10-0-.ec2.internal: 10.0.:2375\r\n  └ Containers: 35\r\n  └ Reserved CPUs: 0 / 2\r\n  └ Reserved Memory: 800 MiB / 15.69 GiB\r\n ip-10-0-.ec2.internal: 10.0.:2375\r\n  └ Containers: 35\r\n  └ Reserved CPUs: 0 / 2\r\n  └ Reserved Memory: 1.562 GiB / 15.69 GiB\r\n ip-10-0-.ec2.internal: 10.0.:2375\r\n  └ Containers: 35\r\n  └ Reserved CPUs: 0 / 2\r\n  └ Reserved Memory: 3.125 GiB / 15.69 GiB\r\n ip-10-0-.ec2.internal: 10.0.:2375\r\n  └ Containers: 65\r\n  └ Reserved CPUs: 0 / 2\r\n  └ Reserved Memory: 2.344 GiB / 15.69 GiB\r\n\r\nrunning a 'docker ps -a' from the master also returns data..however, we cannot run commands that then impact -any- slave in our pool.\r\n\r\nimagine container1 was running on the node with 169 containers, and container2 is elsewhere.\r\nI could not run 'docker rm -f container1' or 'docker rm -f container2'\r\n\r\nplease let me know if there are already open items for anything similar, I'd like to read more about this."},"comment":{"url":"https://api.github.com/repos/docker/swarm/issues/comments/147607839","html_url":"https://github.com/docker/swarm/issues/786#issuecomment-147607839","issue_url":"https://api.github.com/repos/docker/swarm/issues/786","id":147607839,"user":{"login":"abronan","id":1655859,"avatar_url":"https://avatars.githubusercontent.com/u/1655859?v=3","gravatar_id":"","url":"https://api.github.com/users/abronan","html_url":"https://github.com/abronan","followers_url":"https://api.github.com/users/abronan/followers","following_url":"https://api.github.com/users/abronan/following{/other_user}","gists_url":"https://api.github.com/users/abronan/gists{/gist_id}","starred_url":"https://api.github.com/users/abronan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/abronan/subscriptions","organizations_url":"https://api.github.com/users/abronan/orgs","repos_url":"https://api.github.com/users/abronan/repos","events_url":"https://api.github.com/users/abronan/events{/privacy}","received_events_url":"https://api.github.com/users/abronan/received_events","type":"User","site_admin":false},"created_at":"2015-10-13T05:32:50Z","updated_at":"2015-10-13T05:32:50Z","body":"This issue should be fixed now with #1261. Closing this one. Thanks and let us know if you encounter any more issue with master."}}