{"action":"created","issue":{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/10451","labels_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/10451/labels{/name}","comments_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/10451/comments","events_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/10451/events","html_url":"https://github.com/GoogleCloudPlatform/kubernetes/issues/10451","id":91490559,"number":10451,"title":"Kubelet taking large amounts of cpu in v0.19.3","user":{"login":"r-tock","id":11711723,"avatar_url":"https://avatars.githubusercontent.com/u/11711723?v=3","gravatar_id":"","url":"https://api.github.com/users/r-tock","html_url":"https://github.com/r-tock","followers_url":"https://api.github.com/users/r-tock/followers","following_url":"https://api.github.com/users/r-tock/following{/other_user}","gists_url":"https://api.github.com/users/r-tock/gists{/gist_id}","starred_url":"https://api.github.com/users/r-tock/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/r-tock/subscriptions","organizations_url":"https://api.github.com/users/r-tock/orgs","repos_url":"https://api.github.com/users/r-tock/repos","events_url":"https://api.github.com/users/r-tock/events{/privacy}","received_events_url":"https://api.github.com/users/r-tock/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/labels/kind/support","name":"kind/support","color":"eb6420"},{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/labels/team/node","name":"team/node","color":"d2b48c"}],"state":"open","locked":false,"assignee":{"login":"dchen1107","id":7740897,"avatar_url":"https://avatars.githubusercontent.com/u/7740897?v=3","gravatar_id":"","url":"https://api.github.com/users/dchen1107","html_url":"https://github.com/dchen1107","followers_url":"https://api.github.com/users/dchen1107/followers","following_url":"https://api.github.com/users/dchen1107/following{/other_user}","gists_url":"https://api.github.com/users/dchen1107/gists{/gist_id}","starred_url":"https://api.github.com/users/dchen1107/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dchen1107/subscriptions","organizations_url":"https://api.github.com/users/dchen1107/orgs","repos_url":"https://api.github.com/users/dchen1107/repos","events_url":"https://api.github.com/users/dchen1107/events{/privacy}","received_events_url":"https://api.github.com/users/dchen1107/received_events","type":"User","site_admin":false},"milestone":null,"comments":10,"created_at":"2015-06-27T16:51:48Z","updated_at":"2015-06-28T05:48:32Z","closed_at":null,"body":"Ever since we spun on a new cluster the cpu has been slowly climbing\r\nThe cloud monitoring console is showing this climb\r\n\r\nThis shows the cpu usage increase over the course of 2 days.\r\n![screen shot 2015-06-27 at 11 49 53 am](https://cloud.githubusercontent.com/assets/11711723/8393011/ab28adc2-1cc2-11e5-807c-0624908137fa.png)\r\n\r\nOn sshing in to the node, I see that kubelet is taking most of the cpu.\r\n\r\n```\r\n PID USER      PR  NI  VIRT  RES  SHR S  %CPU %MEM    TIME+  COMMAND                                                                                                                                                                                                                                                         \r\n 3002 root      20   0  177m  85m  20m S  20.3  5.0 315:19.21 kubelet                                                                                                                                                                                                                                                         \r\n 3765 root      20   0  938m  81m  12m S   9.7  4.8  53:15.97 docker                                                                                                                                                                                                                                                          \r\n 9796 root      20   0  885m  96m 9476 S   1.0  5.6   1:11.19 nodejs                                                                                                                                                                                                                                                          \r\n 3046 root      20   0 80148  16m  11m S   0.3  0.9   5:59.90 kube-proxy           \r\n```\r\n\r\nLet me know if you would like traces to investigate this. I can easily restart the kubelet to solve this issue, however I will wait for getting you some traces before I do so."},"comment":{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/comments/116199739","html_url":"https://github.com/GoogleCloudPlatform/kubernetes/issues/10451#issuecomment-116199739","issue_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/10451","id":116199739,"user":{"login":"r-tock","id":11711723,"avatar_url":"https://avatars.githubusercontent.com/u/11711723?v=3","gravatar_id":"","url":"https://api.github.com/users/r-tock","html_url":"https://github.com/r-tock","followers_url":"https://api.github.com/users/r-tock/followers","following_url":"https://api.github.com/users/r-tock/following{/other_user}","gists_url":"https://api.github.com/users/r-tock/gists{/gist_id}","starred_url":"https://api.github.com/users/r-tock/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/r-tock/subscriptions","organizations_url":"https://api.github.com/users/r-tock/orgs","repos_url":"https://api.github.com/users/r-tock/repos","events_url":"https://api.github.com/users/r-tock/events{/privacy}","received_events_url":"https://api.github.com/users/r-tock/received_events","type":"User","site_admin":false},"created_at":"2015-06-28T05:48:32Z","updated_at":"2015-06-28T05:48:32Z","body":"That gives an error which to me sounds like the server is not returning the full certificate chain...\r\n```\r\n go tool pprof https://gke-home-page-2015-06-25-b2dabe4a-node-q9vq:10250/debug/pprof/profile\r\nFetching profile from https://gke-home-page-2015-06-25-b2dabe4a-node-q9vq:10250/debug/pprof/profile\r\nPlease wait... (30s)\r\nhttp fetch https://gke-home-page-2015-06-25-b2dabe4a-node-q9vq:10250/debug/pprof/profile: Get https://gke-home-page-2015-06-25-b2dabe4a-node-q9vq:10250/debug/pprof/profile: x509: certificate signed by unknown authority\r\n```"}}