{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15716","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15716/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15716/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15716/events","html_url":"https://github.com/kubernetes/kubernetes/issues/15716","id":111667972,"number":15716,"title":"Profile Heapster on large clusters","user":{"login":"vishh","id":7063592,"avatar_url":"https://avatars.githubusercontent.com/u/7063592?v=3","gravatar_id":"","url":"https://api.github.com/users/vishh","html_url":"https://github.com/vishh","followers_url":"https://api.github.com/users/vishh/followers","following_url":"https://api.github.com/users/vishh/following{/other_user}","gists_url":"https://api.github.com/users/vishh/gists{/gist_id}","starred_url":"https://api.github.com/users/vishh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/vishh/subscriptions","organizations_url":"https://api.github.com/users/vishh/orgs","repos_url":"https://api.github.com/users/vishh/repos","events_url":"https://api.github.com/users/vishh/events{/privacy}","received_events_url":"https://api.github.com/users/vishh/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/priority/P1","name":"priority/P1","color":"eb6420"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/control-plane","name":"team/control-plane","color":"d2b48c"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/node","name":"team/node","color":"d2b48c"}],"state":"open","locked":false,"assignee":{"login":"gmarek","id":1703842,"avatar_url":"https://avatars.githubusercontent.com/u/1703842?v=3","gravatar_id":"","url":"https://api.github.com/users/gmarek","html_url":"https://github.com/gmarek","followers_url":"https://api.github.com/users/gmarek/followers","following_url":"https://api.github.com/users/gmarek/following{/other_user}","gists_url":"https://api.github.com/users/gmarek/gists{/gist_id}","starred_url":"https://api.github.com/users/gmarek/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/gmarek/subscriptions","organizations_url":"https://api.github.com/users/gmarek/orgs","repos_url":"https://api.github.com/users/gmarek/repos","events_url":"https://api.github.com/users/gmarek/events{/privacy}","received_events_url":"https://api.github.com/users/gmarek/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/kubernetes/kubernetes/milestones/13","html_url":"https://github.com/kubernetes/kubernetes/milestones/v1.1","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/milestones/13/labels","id":1220916,"number":13,"title":"v1.1","description":"Release 1.1.\r\n\r\nP1 features:\r\n* 250 nodes\r\n* kube-proxy perf. improvements (via IPTables)\r\n* Docker 1.8.x\r\n* Horizontal pod auto-scaling\r\n* Job Object\r\n* Schema validation in kubectl\r\n* Experimental API and API groups\r\n* Graceful pod termination\r\n","creator":{"login":"bgrant0607","id":7725777,"avatar_url":"https://avatars.githubusercontent.com/u/7725777?v=3","gravatar_id":"","url":"https://api.github.com/users/bgrant0607","html_url":"https://github.com/bgrant0607","followers_url":"https://api.github.com/users/bgrant0607/followers","following_url":"https://api.github.com/users/bgrant0607/following{/other_user}","gists_url":"https://api.github.com/users/bgrant0607/gists{/gist_id}","starred_url":"https://api.github.com/users/bgrant0607/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bgrant0607/subscriptions","organizations_url":"https://api.github.com/users/bgrant0607/orgs","repos_url":"https://api.github.com/users/bgrant0607/repos","events_url":"https://api.github.com/users/bgrant0607/events{/privacy}","received_events_url":"https://api.github.com/users/bgrant0607/received_events","type":"User","site_admin":false},"open_issues":38,"closed_issues":203,"state":"open","created_at":"2015-07-22T19:17:12Z","updated_at":"2015-10-21T17:26:00Z","due_on":"2015-09-21T07:00:00Z","closed_at":null},"comments":33,"created_at":"2015-10-15T17:32:01Z","updated_at":"2015-10-21T17:53:04Z","closed_at":null,"body":"Heapster is currently required for multiple autoscaling features in kubernetes - Horizontal pod, node and initial resource estimation. \r\nTo meet the scalability goals for kubernetes v1.1, we need to test heapster's stability on a large cluster (250 nodes) with lots of pods (30 per node). \r\n\r\nMeasuring compute resource overhead on a large cluster will be useful for users.\r\n\r\nProfiling heapster's cpu and memory usage will be useful to understand the potential bottlenecks under a scale scenario. \r\n\r\nOne thing to be aware is that the current resource `limits` on heapster are not applicable for cluster's greater than ~10 nodes.\r\n"},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/149976417","html_url":"https://github.com/kubernetes/kubernetes/issues/15716#issuecomment-149976417","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15716","id":149976417,"user":{"login":"fgrzadkowski","id":10820726,"avatar_url":"https://avatars.githubusercontent.com/u/10820726?v=3","gravatar_id":"","url":"https://api.github.com/users/fgrzadkowski","html_url":"https://github.com/fgrzadkowski","followers_url":"https://api.github.com/users/fgrzadkowski/followers","following_url":"https://api.github.com/users/fgrzadkowski/following{/other_user}","gists_url":"https://api.github.com/users/fgrzadkowski/gists{/gist_id}","starred_url":"https://api.github.com/users/fgrzadkowski/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/fgrzadkowski/subscriptions","organizations_url":"https://api.github.com/users/fgrzadkowski/orgs","repos_url":"https://api.github.com/users/fgrzadkowski/repos","events_url":"https://api.github.com/users/fgrzadkowski/events{/privacy}","received_events_url":"https://api.github.com/users/fgrzadkowski/received_events","type":"User","site_admin":false},"created_at":"2015-10-21T17:53:04Z","updated_at":"2015-10-21T17:53:04Z","body":"I don't understand why we discuss this in the context of HPA. It is a beta feature, so it does not have to scale to 100 or 250 nodes.\r\n\r\nI'm not arguing that it will not improve UX - for sure it would be better to have it. I'm just arguing that it is not a blocker for 1.1. As said before HPA is a beta feature so it does not have to scale in the same way as the rest of the cluster. For heapster itself we had exactly the same problem earlier (or to be precise it was much worse in 1.0). So why is it a blocker?\r\n\r\nInitially we created this issue as a P0 just to make sure that with the current default limits we can work in most cases. @gmarek verified that we can (we run with ~900 pods)\r\n\r\nIMHO we tend to push far too many things to 1.1 which delays the release."}}