{"action":"created","issue":{"url":"https://api.github.com/repos/mesosphere/kubernetes-mesos/issues/661","labels_url":"https://api.github.com/repos/mesosphere/kubernetes-mesos/issues/661/labels{/name}","comments_url":"https://api.github.com/repos/mesosphere/kubernetes-mesos/issues/661/comments","events_url":"https://api.github.com/repos/mesosphere/kubernetes-mesos/issues/661/events","html_url":"https://github.com/mesosphere/kubernetes-mesos/issues/661","id":119890440,"number":661,"title":"Pending tasks after grace period is over","user":{"login":"sttts","id":730123,"avatar_url":"https://avatars.githubusercontent.com/u/730123?v=3","gravatar_id":"","url":"https://api.github.com/users/sttts","html_url":"https://github.com/sttts","followers_url":"https://api.github.com/users/sttts/followers","following_url":"https://api.github.com/users/sttts/following{/other_user}","gists_url":"https://api.github.com/users/sttts/gists{/gist_id}","starred_url":"https://api.github.com/users/sttts/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sttts/subscriptions","organizations_url":"https://api.github.com/users/sttts/orgs","repos_url":"https://api.github.com/users/sttts/repos","events_url":"https://api.github.com/users/sttts/events{/privacy}","received_events_url":"https://api.github.com/users/sttts/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/mesosphere/kubernetes-mesos/labels/area/scheduler","name":"area/scheduler","color":"409dff"},{"url":"https://api.github.com/repos/mesosphere/kubernetes-mesos/labels/class/bug","name":"class/bug","color":"fc2929"},{"url":"https://api.github.com/repos/mesosphere/kubernetes-mesos/labels/PTAL","name":"PTAL","color":"00ff00"}],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/mesosphere/kubernetes-mesos/milestones/31","html_url":"https://github.com/mesosphere/kubernetes-mesos/milestones/v0.7.0","labels_url":"https://api.github.com/repos/mesosphere/kubernetes-mesos/milestones/31/labels","id":1372943,"number":31,"title":"v0.7.0","description":"This will be based on Kubernetes release-1.1","creator":{"login":"karlkfi","id":3980984,"avatar_url":"https://avatars.githubusercontent.com/u/3980984?v=3","gravatar_id":"","url":"https://api.github.com/users/karlkfi","html_url":"https://github.com/karlkfi","followers_url":"https://api.github.com/users/karlkfi/followers","following_url":"https://api.github.com/users/karlkfi/following{/other_user}","gists_url":"https://api.github.com/users/karlkfi/gists{/gist_id}","starred_url":"https://api.github.com/users/karlkfi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/karlkfi/subscriptions","organizations_url":"https://api.github.com/users/karlkfi/orgs","repos_url":"https://api.github.com/users/karlkfi/repos","events_url":"https://api.github.com/users/karlkfi/events{/privacy}","received_events_url":"https://api.github.com/users/karlkfi/received_events","type":"User","site_admin":false},"open_issues":3,"closed_issues":20,"state":"open","created_at":"2015-10-23T17:41:03Z","updated_at":"2015-12-02T08:24:34Z","due_on":"2015-11-27T05:00:00Z","closed_at":null},"comments":1,"created_at":"2015-12-02T08:24:05Z","updated_at":"2015-12-02T13:08:28Z","closed_at":null,"body":"From https://github.com/mesosphere/kubernetes/pull/51#issuecomment-161214143:\n\n\"i think there is one more scenario of terminal task state not properly handled by scheduler: when the pod task launch grace period expires, kubelet executor sends task lost status. \nhttps://github.com/mesosphere/kubernetes/blob/v0.7.0-v1.1.1/contrib/mesos/pkg/executor/executor.go#L673\n\nI've seen the scheduler not handling that case properly in our cluster. the pod remains in pending state until the scheduler is restarted. For pods launched through rc, it is expected that scheduler deletes the pod since it is reported as lost to mesos, so that replication controller recreates a new pod immediately.\n\nperhaps, https://github.com/mesosphere/kubernetes/blob/v0.7.0-v1.1.1/contrib/mesos/pkg/scheduler/components/framework/framework.go#L423\ncould be modified as below ?\n(taskStatus.GetSource() == mesos.TaskStatus_SOURCE_EXECUTOR && (taskStatus.GetMessage() == messages.ContainersDisappeared || taskStatus.GetMessage() == messages.LaunchTaskFailed))\""},"comment":{"url":"https://api.github.com/repos/mesosphere/kubernetes-mesos/issues/comments/161285819","html_url":"https://github.com/mesosphere/kubernetes-mesos/issues/661#issuecomment-161285819","issue_url":"https://api.github.com/repos/mesosphere/kubernetes-mesos/issues/661","id":161285819,"user":{"login":"sttts","id":730123,"avatar_url":"https://avatars.githubusercontent.com/u/730123?v=3","gravatar_id":"","url":"https://api.github.com/users/sttts","html_url":"https://github.com/sttts","followers_url":"https://api.github.com/users/sttts/followers","following_url":"https://api.github.com/users/sttts/following{/other_user}","gists_url":"https://api.github.com/users/sttts/gists{/gist_id}","starred_url":"https://api.github.com/users/sttts/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sttts/subscriptions","organizations_url":"https://api.github.com/users/sttts/orgs","repos_url":"https://api.github.com/users/sttts/repos","events_url":"https://api.github.com/users/sttts/events{/privacy}","received_events_url":"https://api.github.com/users/sttts/received_events","type":"User","site_admin":false},"created_at":"2015-12-02T13:08:28Z","updated_at":"2015-12-02T13:08:28Z","body":"Fixed in https://github.com/mesosphere/kubernetes/pull/52 for the release branch."}}