{"action":"closed","issue":{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/10795","labels_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/10795/labels{/name}","comments_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/10795/comments","events_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/10795/events","html_url":"https://github.com/GoogleCloudPlatform/kubernetes/issues/10795","id":93407164,"number":10795,"title":"Fix shippable flake in contrib/mesos/pkg/scheduler","user":{"login":"davidopp","id":8264113,"avatar_url":"https://avatars.githubusercontent.com/u/8264113?v=3","gravatar_id":"","url":"https://api.github.com/users/davidopp","html_url":"https://github.com/davidopp","followers_url":"https://api.github.com/users/davidopp/followers","following_url":"https://api.github.com/users/davidopp/following{/other_user}","gists_url":"https://api.github.com/users/davidopp/gists{/gist_id}","starred_url":"https://api.github.com/users/davidopp/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/davidopp/subscriptions","organizations_url":"https://api.github.com/users/davidopp/orgs","repos_url":"https://api.github.com/users/davidopp/repos","events_url":"https://api.github.com/users/davidopp/events{/privacy}","received_events_url":"https://api.github.com/users/davidopp/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/labels/area/test","name":"area/test","color":"fad8c7"},{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/labels/priority/P1","name":"priority/P1","color":"eb6420"},{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/labels/team/mesosphere","name":"team/mesosphere","color":"d2b48c"}],"state":"closed","locked":false,"assignee":{"login":"karlkfi","id":3980984,"avatar_url":"https://avatars.githubusercontent.com/u/3980984?v=3","gravatar_id":"","url":"https://api.github.com/users/karlkfi","html_url":"https://github.com/karlkfi","followers_url":"https://api.github.com/users/karlkfi/followers","following_url":"https://api.github.com/users/karlkfi/following{/other_user}","gists_url":"https://api.github.com/users/karlkfi/gists{/gist_id}","starred_url":"https://api.github.com/users/karlkfi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/karlkfi/subscriptions","organizations_url":"https://api.github.com/users/karlkfi/orgs","repos_url":"https://api.github.com/users/karlkfi/repos","events_url":"https://api.github.com/users/karlkfi/events{/privacy}","received_events_url":"https://api.github.com/users/karlkfi/received_events","type":"User","site_admin":false},"milestone":null,"comments":4,"created_at":"2015-07-07T00:26:20Z","updated_at":"2015-07-24T16:35:29Z","closed_at":"2015-07-24T16:35:29Z","body":"Example:\r\nhttps://app.shippable.com/builds/559b0c6a8469020c00c6b9e3\r\n\r\n```\r\nok github.com/GoogleCloudPlatform/kubernetes/examples\t2.523s\tcoverage: 0.0% of statements\r\nI0707 00:02:22.257292 8725 ha.go:132] scheduler process entered standby stage\r\nI0707 00:02:22.259786 8725 plugin.go:439] Watching for newly created pods\r\nI0707 00:02:22.274393 8725 ha.go:154] scheduler process entered master stage\r\nI0707 00:02:22.274682 8725 ha.go:164] driver started successfully and is running\r\nI0707 00:02:22.275120 8725 scheduler.go:301] Scheduler registered with the master: &MasterInfo{Id:*master-id,Ip:*3232235521,Port:*5050,Pid:nil,Hostname:nil,XXX_unrecognized:[],} with frameworkId: &FrameworkID{Value:*kubernetes-id,XXX_unrecognized:[],}\r\nI0707 00:02:22.277224 8725 scheduler.go:777] explicit reconcile tasks\r\nI0707 00:02:22.664044 8725 plugin.go:243] Try to schedule pod pod1\r\nI0707 00:02:22.673593 8725 plugin.go:558] Error scheduling pod1: No suitable offers for pod/task; retrying\r\nI0707 00:02:23.283341 8725 scheduler.go:777] explicit reconcile tasks\r\nI0707 00:02:23.988836 8725 plugin.go:243] Try to schedule pod pod1\r\nI0707 00:02:26.670830 8725 scheduler.go:424] task status update \"TASK_STAGING\" from \"SOURCE_EXECUTOR\" for task \"pod.7145055a-243b-11e5-b078-0242ac1145f5\" on slave \"h1\" executor \"executor-id\" for reason \"none\"\r\nE0707 00:02:26.689211 8725 registry.go:204] received STAGING for task pod.7145055a-243b-11e5-b078-0242ac1145f5 with unexpected source: SOURCE_EXECUTOR\r\nI0707 00:02:26.693439 8725 scheduler.go:424] task status update \"TASK_RUNNING\" from \"SOURCE_EXECUTOR\" for task \"pod.7145055a-243b-11e5-b078-0242ac1145f5\" on slave \"h1\" executor \"executor-id\" for reason \"none\"\r\nI0707 00:02:26.697790 8725 registry.go:231] Received running status for pending task: pod.7145055a-243b-11e5-b078-0242ac1145f5\r\nI0707 00:02:26.706267 8725 registry.go:263] received pod status for task pod.7145055a-243b-11e5-b078-0242ac1145f5: {Phase: Conditions:[{Type:Ready Status:True}] Message: Reason: HostIP: PodIP:1.2.3.5 StartTime:<nil> ContainerStatuses:[]}\r\nI0707 00:02:26.706847 8725 scheduler.go:424] task status update \"TASK_LOST\" from \"SOURCE_EXECUTOR\" for task \"pod.7145055a-243b-11e5-b078-0242ac1145f5\" on slave \"h1\" executor \"executor-id\" for reason \"none\"\r\nI0707 00:02:27.090636 8725 plugin.go:243] Try to schedule pod pod2\r\nI0707 00:02:27.093274 8725 scheduler.go:424] task status update \"TASK_STAGING\" from \"SOURCE_EXECUTOR\" for task \"pod.73e7c9b1-243b-11e5-b078-0242ac1145f5\" on slave \"h1\" executor \"executor-id\" for reason \"none\"\r\nE0707 00:02:27.093449 8725 registry.go:204] received STAGING for task pod.73e7c9b1-243b-11e5-b078-0242ac1145f5 with unexpected source: SOURCE_EXECUTOR\r\nI0707 00:02:27.093614 8725 scheduler.go:424] task status update \"TASK_RUNNING\" from \"SOURCE_EXECUTOR\" for task \"pod.73e7c9b1-243b-11e5-b078-0242ac1145f5\" on slave \"h1\" executor \"executor-id\" for reason \"none\"\r\nI0707 00:02:27.093761 8725 registry.go:231] Received running status for pending task: pod.73e7c9b1-243b-11e5-b078-0242ac1145f5\r\nI0707 00:02:27.096140 8725 registry.go:263] received pod status for task pod.73e7c9b1-243b-11e5-b078-0242ac1145f5: {Phase: Conditions:[{Type:Ready Status:True}] Message: Reason: HostIP: PodIP:1.2.3.6 StartTime:<nil> ContainerStatuses:[]}\r\nI0707 00:02:27.098349 8725 scheduler.go:424] task status update \"TASK_FINISHED\" from \"SOURCE_EXECUTOR\" for task \"pod.73e7c9b1-243b-11e5-b078-0242ac1145f5\" on slave \"h1\" executor \"executor-id\" for reason \"none\"\r\nI0707 00:02:27.309180 8725 plugin.go:243] Try to schedule pod pod3\r\nI0707 00:02:27.310916 8725 scheduler.go:424] task status update \"TASK_STAGING\" from \"SOURCE_EXECUTOR\" for task \"pod.740920ba-243b-11e5-b078-0242ac1145f5\" on slave \"h1\" executor \"executor-id\" for reason \"none\"\r\nE0707 00:02:27.311029 8725 registry.go:204] received STAGING for task pod.740920ba-243b-11e5-b078-0242ac1145f5 with unexpected source: SOURCE_EXECUTOR\r\nI0707 00:02:27.311147 8725 scheduler.go:424] task status update \"TASK_RUNNING\" from \"SOURCE_EXECUTOR\" for task \"pod.740920ba-243b-11e5-b078-0242ac1145f5\" on slave \"h1\" executor \"executor-id\" for reason \"none\"\r\nI0707 00:02:27.311304 8725 registry.go:231] Received running status for pending task: pod.740920ba-243b-11e5-b078-0242ac1145f5\r\nI0707 00:02:27.311970 8725 registry.go:263] received pod status for task pod.740920ba-243b-11e5-b078-0242ac1145f5: {Phase: Conditions:[{Type:Ready Status:True}] Message: Reason: HostIP: PodIP:1.2.3.7 StartTime:<nil> ContainerStatuses:[]}\r\nI0707 00:02:27.320790 8725 scheduler.go:424] task status update \"TASK_FAILED\" from \"SOURCE_EXECUTOR\" for task \"pod.740920ba-243b-11e5-b078-0242ac1145f5\" on slave \"h1\" executor \"executor-id\" for reason \"none\"\r\nE0707 00:02:27.679418 8725 util.go:69] Recovered from panic: runtime.errorCString{cstr:0x1af46fc} (runtime error: index out of range)\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/util/util.go:63\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/pkg/util/util.go:54\r\n/root/.gvm/gos/go1.3/src/pkg/runtime/panic.c:248\r\n/root/.gvm/gos/go1.3/src/pkg/runtime/panic.c:552\r\n/root/.gvm/gos/go1.3/src/pkg/runtime/panic.c:466\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/Godeps/_workspace/src/github.com/stretchr/testify/assert/assertions.go:88\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/Godeps/_workspace/src/github.com/stretchr/testify/mock/mock.go:268\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/scheduler/mock_test.go:187\r\n<autogenerated>:146\r\ngithub.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/scheduler/_test/_obj_test/scheduler.go:178\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/scheduler/ha/ha.go:100\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/scheduler/ha/ha.go:218\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/proc/proc.go:364\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/proc/proc.go:321\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/proc/proc.go:161\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/proc/proc.go:139\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/runtime/util.go:115\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/runtime/util.go:116\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/proc/proc.go:142\r\n/root/workspace/src/github.com/GoogleCloudPlatform/kubernetes/_output/local/go/src/github.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/runtime/util.go:95\r\n/root/.gvm/gos/go1.3/src/pkg/runtime/proc.c:1445\r\nI0707 00:02:27.819981 8725 plugin.go:243] Try to schedule pod pod4\r\nI0707 00:02:27.820666 8725 plugin.go:558] Error scheduling pod4: No suitable offers for pod/task; retrying\r\nI0707 00:02:29.133035 8725 plugin.go:243] Try to schedule pod pod4\r\nI0707 00:02:29.133329 8725 plugin.go:558] Error scheduling pod4: No suitable offers for pod/task; retrying\r\nI0707 00:02:31.656224 8725 plugin.go:243] Try to schedule pod pod4\r\nI0707 00:02:31.656512 8725 plugin.go:558] Error scheduling pod4: No suitable offers for pod/task; retrying\r\nI0707 00:02:32.978178 8725 plugin.go:243] Try to schedule pod pod4\r\nI0707 00:02:32.978422 8725 plugin.go:558] Error scheduling pod4: No suitable offers for pod/task; retrying\r\nI0707 00:02:34.383310 8725 plugin.go:243] Try to schedule pod pod4\r\nI0707 00:02:34.383583 8725 plugin.go:558] Error scheduling pod4: No suitable offers for pod/task; retrying\r\nI0707 00:02:34.432826 8725 ha.go:141] scheduler process entered fin stage\r\n--- FAIL: TestPlugin_LifeCycle (12.19 seconds)\r\n<autogenerated>:31:\r\nError Trace:\tplugin_test.go:321\r\nplugin_test.go:327\r\nplugin_test.go:507\r\nplugin_test.go:568\r\nError:\tevent not received\r\nplugin_test.go:517: timed out waiting for launchTasks\r\nI0707 00:02:34.446136 8725 scheduler.go:394] Offer rescinded &OfferID{Value:*test1,XXX_unrecognized:[],}\r\nI0707 00:02:34.469137 8725 scheduler.go:394] Offer rescinded &OfferID{Value:*test2,XXX_unrecognized:[],}\r\nI0707 00:02:34.469637 8725 scheduler.go:394] Offer rescinded &OfferID{Value:*notExist,XXX_unrecognized:[],}\r\nI0707 00:02:34.470344 8725 scheduler.go:610] Slave &SlaveID{Value:*h1,XXX_unrecognized:[],} is lost\r\nI0707 00:02:34.470561 8725 scheduler.go:610] Slave &SlaveID{Value:*h2,XXX_unrecognized:[],} is lost\r\nI0707 00:02:34.470720 8725 scheduler.go:610] Slave &SlaveID{Value:*notExist,XXX_unrecognized:[],} is lost\r\nI0707 00:02:34.540849 8725 scheduler.go:373] Master disconnected!\r\nI0707 00:02:34.544280 8725 scheduler.go:424] task status update \"TASK_RUNNING\" from \"none\" for task \"test-task-001\" on slave \"\" executor \"\" for reason \"none\"\r\nW0707 00:02:34.544639 8725 registry.go:240] Ignore status TASK_RUNNING because the task test-task-001 is discarded\r\nE0707 00:02:34.544984 8725 scheduler.go:530] possible rogue pod; illegal task status data for task test-task-001, expected an api.PodStatusResult: missing TaskStatus.Data\r\nI0707 00:02:34.545697 8725 scheduler.go:424] task status update \"TASK_RUNNING\" from \"none\" for task \"test-task-001\" on slave \"\" executor \"\" for reason \"none\"\r\nW0707 00:02:34.546593 8725 registry.go:240] Ignore status TASK_RUNNING because the task test-task-001 is discarded\r\nE0707 00:02:34.546948 8725 scheduler.go:530] possible rogue pod; illegal task status data for task test-task-001, expected an api.PodStatusResult: missing TaskStatus.Data\r\nI0707 00:02:34.549055 8725 scheduler.go:424] task status update \"TASK_FAILED\" from \"none\" for task \"test-task-001\" on slave \"\" executor \"\" for reason \"none\"\r\nFAIL\r\ncoverage: 60.1% of statements\r\nFAIL\tgithub.com/GoogleCloudPlatform/kubernetes/contrib/mesos/pkg/scheduler\t14.052s\r\n```"}}