{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/11543","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/11543/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/11543/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/11543/events","html_url":"https://github.com/kubernetes/kubernetes/issues/11543","id":95878287,"number":11543,"title":"Can't get --cloud-provider=aws to work (instance not found)","user":{"login":"philk","id":29562,"avatar_url":"https://avatars.githubusercontent.com/u/29562?v=3","gravatar_id":"","url":"https://api.github.com/users/philk","html_url":"https://github.com/philk","followers_url":"https://api.github.com/users/philk/followers","following_url":"https://api.github.com/users/philk/following{/other_user}","gists_url":"https://api.github.com/users/philk/gists{/gist_id}","starred_url":"https://api.github.com/users/philk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/philk/subscriptions","organizations_url":"https://api.github.com/users/philk/orgs","repos_url":"https://api.github.com/users/philk/repos","events_url":"https://api.github.com/users/philk/events{/privacy}","received_events_url":"https://api.github.com/users/philk/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/area/cluster-lifecycle","name":"area/cluster-lifecycle","color":"d4c5f9"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/area/platform/aws","name":"area/platform/aws","color":"d4c5f9"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/component/kubelet","name":"component/kubelet","color":"0052cc"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/priority/P1","name":"priority/P1","color":"eb6420"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/node","name":"team/node","color":"d2b48c"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2015-07-19T02:33:42Z","updated_at":"2015-09-16T16:38:48Z","closed_at":null,"body":"I'm trying to set up AWS ELB attach volume access and keep getting an error on the kubelet. I have some bad feeling it might be related to #9801 as these nodes are CoreOS that were brought up by Terraform with custom service files but everything else is working fine (we're running cluster monitoring, dns, and a number of our own pods without issues). I've run awscli on that instance and the privileges definitely work. What am I doing wrong?\r\n\r\nlogs from kubelet service\r\n\r\n```\r\nI0719 02:22:59.549444    9662 factory.go:234] Registering Docker factory\r\nI0719 02:22:59.549826    9662 factory.go:89] Registering Raw factory\r\nI0719 02:22:59.638468    9662 manager.go:946] Started watching for new ooms in manager\r\nI0719 02:22:59.639054    9662 oomparser.go:183] oomparser using systemd\r\nI0719 02:22:59.640589    9662 manager.go:243] Starting recovery of all containers\r\nE0719 02:22:59.679107    9662 kubelet.go:787] Unable to construct api.Node object for kubelet: failed to get external ID from cloud provider: instance not found\r\nI0719 02:22:59.753816    9662 manager.go:248] Recovery completed\r\nI0719 02:22:59.816369    9662 status_manager.go:76] Starting to sync pod status with apiserver\r\nI0719 02:22:59.816426    9662 kubelet.go:1725] Starting kubelet main sync loop.\r\nE0719 02:22:59.953337    9662 kubelet.go:787] Unable to construct api.Node object for kubelet: failed to get external ID from cloud provider: instance not found\r\nE0719 02:23:01.047929    9662 kubelet.go:787] Unable to construct api.Node object for kubelet: failed to get external ID from cloud provider: instance not found\r\nE0719 02:23:01.975409    9662 kubelet.go:787] Unable to construct api.Node object for kubelet: failed to get external ID from cloud provider: instance not found\r\nE0719 02:23:03.645707    9662 kubelet.go:787] Unable to construct api.Node object for kubelet: failed to get external ID from cloud provider: instance not found\r\nE0719 02:23:06.917503    9662 kubelet.go:787] Unable to construct api.Node object for kubelet: failed to get external ID from cloud provider: instance not found\r\nI0719 02:23:07.790941    9662 server.go:635] POST /stats/container/: (46.254087ms) 0 [[Go 1.1 package http] 10.0.39.222:45497]\r\n```\r\n\r\nkube-kubelet.service\r\n\r\n```\r\n[Unit]\r\nDescription=Kubernetes Kubelet\r\nDocumentation=https://github.com/GoogleCloudPlatform/kubernetes\r\n\r\n[Service]\r\nEnvironment=\"KUBERNETES_BINARY_VERSION=1.0.0\"\r\nEnvironmentFile=/etc/environment\r\nExecStartPre=/usr/bin/curl -L -o /opt/bin/kubelet https://storage.googleapis.com/kubernetes-release/release/v${KUBERNETES_BINARY_VERSION}/bin/linux/amd64\r\nExecStartPre=/usr/bin/chmod +x /opt/bin/kubelet\r\nExecStart=/opt/bin/kubelet \\\r\n  --address=0.0.0.0 \\\r\n  --port=10250 \\\r\n  --cloud-provider=aws \\\r\n  --hostname-override=${COREOS_PRIVATE_IPV4} \\\r\n  --api-servers=${KUBE_MASTER_IP}:8080 \\\r\n  --allow-privileged=false \\\r\n  --cluster_dns=10.2.0.2 \\\r\n  --cluster_domain=cluster.local \\\r\n  --cadvisor_port=4194 \\\r\n  --healthz_bind_address=0.0.0.0 \\\r\n  --healthz_port=10248 \\\r\n  --v=2 \\\r\n  --logtostderr=true\r\nRestart=always\r\nRestartSec=10\r\n\r\n[Install]\r\nWantedBy=multi-user.target\r\n```\r\n\r\niam policy\r\n\r\n```json\r\n{\r\n  \"Version\": \"2012-10-17\",\r\n  \"Statement\": [\r\n    {\r\n      \"Effect\": \"Allow\",\r\n      \"Action\": [\r\n        \"ec2:Describe*\"\r\n      ],\r\n      \"Resource\": [\r\n        \"*\"\r\n      ]\r\n    },\r\n    {\r\n      \"Effect\": \"Allow\",\r\n      \"Action\": [\r\n        \"ec2:AttachVolume\",\r\n        \"ec2:DetachVolume\"\r\n      ],\r\n      \"Resource\": [\r\n        \"arn:aws:ec2:*:*:instance/*\"\r\n      ]\r\n    },\r\n  ]\r\n}\r\n```"},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/140797276","html_url":"https://github.com/kubernetes/kubernetes/issues/11543#issuecomment-140797276","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/11543","id":140797276,"user":{"login":"bkeroackdsc","id":9576999,"avatar_url":"https://avatars.githubusercontent.com/u/9576999?v=3","gravatar_id":"","url":"https://api.github.com/users/bkeroackdsc","html_url":"https://github.com/bkeroackdsc","followers_url":"https://api.github.com/users/bkeroackdsc/followers","following_url":"https://api.github.com/users/bkeroackdsc/following{/other_user}","gists_url":"https://api.github.com/users/bkeroackdsc/gists{/gist_id}","starred_url":"https://api.github.com/users/bkeroackdsc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bkeroackdsc/subscriptions","organizations_url":"https://api.github.com/users/bkeroackdsc/orgs","repos_url":"https://api.github.com/users/bkeroackdsc/repos","events_url":"https://api.github.com/users/bkeroackdsc/events{/privacy}","received_events_url":"https://api.github.com/users/bkeroackdsc/received_events","type":"User","site_admin":false},"created_at":"2015-09-16T16:38:48Z","updated_at":"2015-09-16T16:38:48Z","body":"In fairness you *can* deploy k8s in an existing VPC w/ private DNS zones, you just can't use AWS cloud provider integration."}}