{"action":"created","issue":{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/11335","labels_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/11335/labels{/name}","comments_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/11335/comments","events_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/11335/events","html_url":"https://github.com/GoogleCloudPlatform/kubernetes/issues/11335","id":95279162,"number":11335,"title":"Jenkins timeouts on LoadBalancer","user":{"login":"erictune","id":8105590,"avatar_url":"https://avatars.githubusercontent.com/u/8105590?v=3","gravatar_id":"","url":"https://api.github.com/users/erictune","html_url":"https://github.com/erictune","followers_url":"https://api.github.com/users/erictune/followers","following_url":"https://api.github.com/users/erictune/following{/other_user}","gists_url":"https://api.github.com/users/erictune/gists{/gist_id}","starred_url":"https://api.github.com/users/erictune/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/erictune/subscriptions","organizations_url":"https://api.github.com/users/erictune/orgs","repos_url":"https://api.github.com/users/erictune/repos","events_url":"https://api.github.com/users/erictune/events{/privacy}","received_events_url":"https://api.github.com/users/erictune/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-07-15T20:09:42Z","updated_at":"2015-07-16T14:21:01Z","closed_at":null,"body":"Last Jenkins run failed.  Appears to be a timeout creating LoadBalancers.  Taking 20min to create an LB. Was green last night and nothing merged today.  Has to be GCE.\r\n\r\n\r\nSnippet from http://kubekins.dls.corp.google.com/job/kubernetes-e2e-gce/7621/consoleFull#3342045390e74f2cb-3875-4db7-be7c-109bf2060372\r\nfollows\r\n```\r\nServices \r\n  should correctly serve identically named services in different namespaces on different external IP addresses\r\n  /go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/test/e2e/service.go:809\r\n[BeforeEach] Services\r\n  /go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/test/e2e/service.go:58\r\n>>> testContext.KubeConfig: /var/lib/jenkins/jobs/kubernetes-e2e-gce/workspace/.kube/config\r\nSTEP: Building a namespace api objects\r\nINFO: Waiting up to 2m0s for service account default to be provisioned in ns e2e-tests-service-0-evclu\r\nINFO: Get service account default in ns e2e-tests-service-0-evclu failed, ignoring for 5s: serviceaccounts \"default\" not found\r\nINFO: Service account default in ns e2e-tests-service-0-evclu with secrets found. (5.008456717s)\r\nINFO: Waiting up to 2m0s for service account default to be provisioned in ns e2e-tests-service-1-nnxb6\r\nINFO: Get service account default in ns e2e-tests-service-1-nnxb6 failed, ignoring for 5s: serviceaccounts \"default\" not found\r\nINFO: Service account default in ns e2e-tests-service-1-nnxb6 with secrets found. (5.006766671s)\r\n[It] should correctly serve identically named services in different namespaces on different external IP addresses\r\n  /go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/test/e2e/service.go:809\r\nSTEP: creating service s0 in namespace e2e-tests-service-0-evclu\r\nSTEP: creating service s0 in namespace e2e-tests-service-1-nnxb6\r\nSTEP: waiting up to 20m0s for service s0 in namespace e2e-tests-service-0-evclu to have a LoadBalancer ingress point\r\nINFO: Waiting for service s0 in namespace e2e-tests-service-0-evclu to have a LoadBalancer ingress point (5.531106ms)\r\nINFO: Waiting for service s0 in namespace e2e-tests-service-0-evclu to have a LoadBalancer ingress point (5.009560063s)\r\nINFO: Waiting for service s0 in namespace e2e-tests-service-0-evclu to have a LoadBalancer ingress point (10.014143404s)\r\nINFO: Waiting for service s0 in namespace e2e-tests-service-0-evclu to have a LoadBalancer ingress point (15.01897074s)\r\nINFO: Waiting for service s0 in namespace e2e-tests-service-0-evclu to have a LoadBalancer ingress point (20.022640736s)\r\n...\r\nINFO: Waiting for service s0 in namespace e2e-tests-service-0-evclu to have a LoadBalancer ingress point (18m0.983067246s)\r\nINFO: Waiting for service s0 in namespace e2e-tests-service-0-evclu to have a LoadBalancer ingress point (18m5.98715985s)\r\nSTEP: waiting up to 20m0s for service s0 in namespace e2e-tests-service-1-nnxb6 to have a LoadBalancer ingress point\r\nSTEP: validating unique: [104.197.56.174 104.154.59.232]\r\nSTEP: deleting service s0 in namespace e2e-tests-service-1-nnxb6\r\nSTEP: deleting service s0 in namespace e2e-tests-service-0-evclu\r\n[AfterEach] Services\r\n  /go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/test/e2e/service.go:67\r\nSTEP: Destroying namespace e2e-tests-service-0-evclu\r\nSTEP: Destroying namespace e2e-tests-service-1-nnxb6\r\n\r\n• [SLOW TEST:1111.520 seconds]\r\nServices\r\n/go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/test/e2e/service.go:810\r\n  should correctly serve identically named services in different namespaces on different external IP addresses\r\n  /go/src/github.com/GoogleCloudPlatform/kubernetes/_output/dockerized/go/src/github.com/GoogleCloudPlatform/kubernetes/test/e2e/service.go:809\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/comments/121970363","html_url":"https://github.com/GoogleCloudPlatform/kubernetes/issues/11335#issuecomment-121970363","issue_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/11335","id":121970363,"user":{"login":"justinsb","id":100893,"avatar_url":"https://avatars.githubusercontent.com/u/100893?v=3","gravatar_id":"","url":"https://api.github.com/users/justinsb","html_url":"https://github.com/justinsb","followers_url":"https://api.github.com/users/justinsb/followers","following_url":"https://api.github.com/users/justinsb/following{/other_user}","gists_url":"https://api.github.com/users/justinsb/gists{/gist_id}","starred_url":"https://api.github.com/users/justinsb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/justinsb/subscriptions","organizations_url":"https://api.github.com/users/justinsb/orgs","repos_url":"https://api.github.com/users/justinsb/repos","events_url":"https://api.github.com/users/justinsb/events{/privacy}","received_events_url":"https://api.github.com/users/justinsb/received_events","type":"User","site_admin":false},"created_at":"2015-07-16T14:21:01Z","updated_at":"2015-07-16T14:21:01Z","body":"I don't know if we have the kube-controller-manager logs here? I did spot something in one of my tests.... If one of the minion instances is deleted, but we haven't noticed that (i.e. the sync with cloud-instances is broken), then we will tell the cloud to add a host to the LB that no longer exists.  The cloud (AWS & I think GCE) will then fail that request.\r\n\r\nCollecting events in these tests might also be handy, e.g. #8905 although that PR is ancient."}}