{"action":"created","issue":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15389","labels_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15389/labels{/name}","comments_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15389/comments","events_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15389/events","html_url":"https://github.com/kubernetes/kubernetes/issues/15389","id":110708956,"number":15389,"title":"e2e flaky: Job should run a job to completion when tasks sometimes fail and are locally restarted","user":{"login":"dchen1107","id":7740897,"avatar_url":"https://avatars.githubusercontent.com/u/7740897?v=3","gravatar_id":"","url":"https://api.github.com/users/dchen1107","html_url":"https://github.com/dchen1107","followers_url":"https://api.github.com/users/dchen1107/followers","following_url":"https://api.github.com/users/dchen1107/following{/other_user}","gists_url":"https://api.github.com/users/dchen1107/gists{/gist_id}","starred_url":"https://api.github.com/users/dchen1107/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dchen1107/subscriptions","organizations_url":"https://api.github.com/users/dchen1107/orgs","repos_url":"https://api.github.com/users/dchen1107/repos","events_url":"https://api.github.com/users/dchen1107/events{/privacy}","received_events_url":"https://api.github.com/users/dchen1107/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/area/test","name":"area/test","color":"fad8c7"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/priority/P0","name":"priority/P0","color":"e11d21"},{"url":"https://api.github.com/repos/kubernetes/kubernetes/labels/team/control-plane","name":"team/control-plane","color":"d2b48c"}],"state":"open","locked":false,"assignee":{"login":"erictune","id":8105590,"avatar_url":"https://avatars.githubusercontent.com/u/8105590?v=3","gravatar_id":"","url":"https://api.github.com/users/erictune","html_url":"https://github.com/erictune","followers_url":"https://api.github.com/users/erictune/followers","following_url":"https://api.github.com/users/erictune/following{/other_user}","gists_url":"https://api.github.com/users/erictune/gists{/gist_id}","starred_url":"https://api.github.com/users/erictune/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/erictune/subscriptions","organizations_url":"https://api.github.com/users/erictune/orgs","repos_url":"https://api.github.com/users/erictune/repos","events_url":"https://api.github.com/users/erictune/events{/privacy}","received_events_url":"https://api.github.com/users/erictune/received_events","type":"User","site_admin":false},"milestone":null,"comments":19,"created_at":"2015-10-09T18:01:58Z","updated_at":"2015-10-22T20:36:41Z","closed_at":null,"body":"Job should run a job to completion when tasks sometimes fail and are locally restarted\r\n\r\n/go/src/k8s.io/kubernetes/_output/dockerized/go/src/k8s.io/kubernetes/test/e2e/job.go:75\r\nExpected error:\r\n    <*errors.errorString | 0xc20807c990>: {\r\n        s: \"timed out waiting for the condition\",\r\n    }\r\n    timed out waiting for the condition\r\nnot to have occurred\r\n"},"comment":{"url":"https://api.github.com/repos/kubernetes/kubernetes/issues/comments/150349215","html_url":"https://github.com/kubernetes/kubernetes/issues/15389#issuecomment-150349215","issue_url":"https://api.github.com/repos/kubernetes/kubernetes/issues/15389","id":150349215,"user":{"login":"erictune","id":8105590,"avatar_url":"https://avatars.githubusercontent.com/u/8105590?v=3","gravatar_id":"","url":"https://api.github.com/users/erictune","html_url":"https://github.com/erictune","followers_url":"https://api.github.com/users/erictune/followers","following_url":"https://api.github.com/users/erictune/following{/other_user}","gists_url":"https://api.github.com/users/erictune/gists{/gist_id}","starred_url":"https://api.github.com/users/erictune/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/erictune/subscriptions","organizations_url":"https://api.github.com/users/erictune/orgs","repos_url":"https://api.github.com/users/erictune/repos","events_url":"https://api.github.com/users/erictune/events{/privacy}","received_events_url":"https://api.github.com/users/erictune/received_events","type":"User","site_admin":false},"created_at":"2015-10-22T20:36:41Z","updated_at":"2015-10-22T20:36:41Z","body":"In all 3 cases, they relist immediately, but in 2 of 3 cases, they don't re-watch for about an hour.  That seems wrong, no?\r\n\r\nRelist at 3:56 and rewatch at 4:53\r\n```\r\nI1022 03:56:10.450825       7 handlers.go:131] GET /api/v1/watch/pods?fieldSelector=spec.nodeName%3Dkubernetes-minion-ms7t&resourceVersion=2963: (56m57.077164863s) 0 [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.4:34668]\r\nI1022 03:56:10.452318       7 handlers.go:131] GET /api/v1/watch/pods?fieldSelector=spec.nodeName%3Dkubernetes-minion-ms7t&resourceVersion=11784: (531.223µs) 500 <stacktrace omitted> [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.4:34668]\r\nI1022 03:56:11.457315       7 handlers.go:131] GET /api/v1/pods?fieldSelector=spec.nodeName%3Dkubernetes-minion-ms7t: (3.87358ms) 200 [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.4:34668]\r\nI1022 04:53:17.910532       7 handlers.go:131] GET /api/v1/watch/pods?fieldSelector=spec.nodeName%3Dkubernetes-minion-ms7t&resourceVersion=16321: (57m6.451233388s) 0 [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.4:34668]\r\n```\r\n\r\nRelist at 4:07 and rewatch at 5:00\r\n```\r\nI1022 04:07:07.944818       7 handlers.go:131] GET /api/v1/watch/pods?fieldSelector=spec.nodeName%3Dkubernetes-master&resourceVersion=36: (39m21.577389313s) 0 [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.2:55047]\r\nI1022 04:07:07.945868       7 handlers.go:131] GET /api/v1/watch/pods?fieldSelector=spec.nodeName%3Dkubernetes-master&resourceVersion=36: (670.064µs) 500 <stacktrace-omitted> [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.2:55047]\r\nI1022 04:07:08.951455       7 handlers.go:131] GET /api/v1/pods?fieldSelector=spec.nodeName%3Dkubernetes-master: (4.635415ms) 200 [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.2:55047]\r\nI1022 05:00:42.371760       7 handlers.go:131] GET /api/v1/watch/pods?fieldSelector=spec.nodeName%3Dkubernetes-master&resourceVersion=17137: (53m33.417427356s) 0 [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.2:55047]\r\n```\r\n\r\nWorking correctly.\r\n```\r\nI1022 16:08:28.277858       7 handlers.go:131] GET /api/v1/watch/pods?fieldSelector=spec.nodeName%3Dkubernetes-minion-svng&resourceVersion=17646: (46m58.192913613s) 0 [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.3:56484]\r\nI1022 16:08:28.279551       7 handlers.go:131] GET /api/v1/watch/pods?fieldSelector=spec.nodeName%3Dkubernetes-minion-svng&resourceVersion=17646: (482.612µs) 500 <stacktrace-omitted> [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.3:56484]\r\nI1022 16:08:29.277602       7 handlers.go:131] GET /api/v1/nodes/kubernetes-minion-svng: (1.381635ms) 200 [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.3:56484]\r\nI1022 16:08:29.284818       7 handlers.go:131] GET /api/v1/pods?fieldSelector=spec.nodeName%3Dkubernetes-minion-svng: (4.054121ms) 200 [[kubelet/v1.2.0 (linux/amd64) kubernetes/a5a9176] 10.240.0.3:56484]\r\n```"}}