{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/14642","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/14642/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/14642/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/14642/events","html_url":"https://github.com/kubernetes/kubernetes/issues/14642","id":108616754,"number":14642,"title":"Problem rescheduling POD with GCE PD disk attached","user":{"login":"rvrignaud","id":525763,"avatar_url":"https://avatars.githubusercontent.com/u/525763?v=3","gravatar_id":"","url":"https://api.github.com/users/rvrignaud","html_url":"https://github.com/rvrignaud","followers_url":"https://api.github.com/users/rvrignaud/followers","following_url":"https://api.github.com/users/rvrignaud/following{/other_user}","gists_url":"https://api.github.com/users/rvrignaud/gists{/gist_id}","starred_url":"https://api.github.com/users/rvrignaud/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rvrignaud/subscriptions","organizations_url":"https://api.github.com/users/rvrignaud/orgs","repos_url":"https://api.github.com/users/rvrignaud/repos","events_url":"https://api.github.com/users/rvrignaud/events{/privacy}","received_events_url":"https://api.github.com/users/rvrignaud/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/area/storage","name":"area/storage","color":"006b75"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/area/volumes","name":"area/volumes","color":"bfe5bf"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/priority/P1","name":"priority/P1","color":"eb6420"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/cluster","name":"team/cluster","color":"d2b48c"}],"state":"open","locked":false,"assignee":{"login":"saad-ali","id":10052848,"avatar_url":"https://avatars.githubusercontent.com/u/10052848?v=3","gravatar_id":"","url":"https://api.github.com/users/saad-ali","html_url":"https://github.com/saad-ali","followers_url":"https://api.github.com/users/saad-ali/followers","following_url":"https://api.github.com/users/saad-ali/following{/other_user}","gists_url":"https://api.github.com/users/saad-ali/gists{/gist_id}","starred_url":"https://api.github.com/users/saad-ali/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/saad-ali/subscriptions","organizations_url":"https://api.github.com/users/saad-ali/orgs","repos_url":"https://api.github.com/users/saad-ali/repos","events_url":"https://api.github.com/users/saad-ali/events{/privacy}","received_events_url":"https://api.github.com/users/saad-ali/received_events","type":"User","site_admin":false},"milestone":null,"comments":16,"created_at":"2015-09-28T09:05:12Z","updated_at":"2015-12-02T19:47:09Z","closed_at":null,"body":"Hello,\r\n\r\nI'm using a GKE (1.0.6) cluster. Today, for a yet unknown reason, a node has rebooted. This node used to have a pod with a GCE PD attached. This pod is scheduled by a RC with only one replica.\r\nWhen the node rebooted, the pod has been rescheduled on an other node. However for some reason, the PD has not been detached from the old node.\r\nThe result was that Kubernetes tried multiple time to attach the disk to the new node. I got a lot of errors in GCE Operations Dashboard:\r\n```\r\nRESOURCE_IN_USE_BY_ANOTHER_RESOURCE: The disk resource 'projects/projectid/zones/europe-west1-c/disks/diskname' is already being used by 'projects/projectid/zones/europe-west1-c/instances/gke-nodename' \r\n```\r\nAt the end, the pod is in Waiting state with that reason:\r\n```\r\nImage: gcr.io/projectid/imagename:imagetag is not ready on the node\r\n```\r\n(which is not IMHO the right error message)\r\n\r\nAnd events:\r\n```\r\n  Mon, 28 Sep 2015 07:09:34 +0200\tMon, 28 Sep 2015 10:50:26 +0200\t124\t{kubelet nodename}\t\t\tfailedMount\tUnable to mount volumes for pod \"podname\": Could not attach GCE PD \"diskname\". Timeout waiting for mount paths to be created.\r\n  Mon, 28 Sep 2015 07:09:34 +0200\tMon, 28 Sep 2015 10:50:26 +0200\t124\t{kubelet nodename}\t\t\tfailedSync\tError syncing pod, skipping: Could not attach GCE PD \"diskname\". Timeout waiting for mount paths to be created.\r\n```\r\n\r\nAs this a not critical service, I'm happy to let it for a few days in this state, if that can help for debugging.\r\nIs there any other thing I could provide to help understand the problem ?"},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/161412132","html_url":"https://github.com/kubernetes/kubernetes/issues/14642#issuecomment-161412132","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/14642","id":161412132,"user":{"login":"saad-ali","id":10052848,"avatar_url":"https://avatars.githubusercontent.com/u/10052848?v=3","gravatar_id":"","url":"https://api.github.com/users/saad-ali","html_url":"https://github.com/saad-ali","followers_url":"https://api.github.com/users/saad-ali/followers","following_url":"https://api.github.com/users/saad-ali/following{/other_user}","gists_url":"https://api.github.com/users/saad-ali/gists{/gist_id}","starred_url":"https://api.github.com/users/saad-ali/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/saad-ali/subscriptions","organizations_url":"https://api.github.com/users/saad-ali/orgs","repos_url":"https://api.github.com/users/saad-ali/repos","events_url":"https://api.github.com/users/saad-ali/events{/privacy}","received_events_url":"https://api.github.com/users/saad-ali/received_events","type":"User","site_admin":false},"created_at":"2015-12-02T19:47:08Z","updated_at":"2015-12-02T19:47:08Z","body":"@chrislovecnm Can you send an email to me (email address in profile). I'd like to better understand why you guys are running into this so often, and if there's anything we can do in the immediate term to work around it. Thanks!"}}