{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/8848","labels_url":"https://api.github.com/repos/apache/spark/issues/8848/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/8848/comments","events_url":"https://api.github.com/repos/apache/spark/issues/8848/events","html_url":"https://github.com/apache/spark/pull/8848","id":107501850,"number":8848,"title":"[SPARK-10726] When task starting, executor should be in busy state","user":{"login":"KaiXinXiaoLei","id":9440626,"avatar_url":"https://avatars.githubusercontent.com/u/9440626?v=3","gravatar_id":"","url":"https://api.github.com/users/KaiXinXiaoLei","html_url":"https://github.com/KaiXinXiaoLei","followers_url":"https://api.github.com/users/KaiXinXiaoLei/followers","following_url":"https://api.github.com/users/KaiXinXiaoLei/following{/other_user}","gists_url":"https://api.github.com/users/KaiXinXiaoLei/gists{/gist_id}","starred_url":"https://api.github.com/users/KaiXinXiaoLei/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/KaiXinXiaoLei/subscriptions","organizations_url":"https://api.github.com/users/KaiXinXiaoLei/orgs","repos_url":"https://api.github.com/users/KaiXinXiaoLei/repos","events_url":"https://api.github.com/users/KaiXinXiaoLei/events{/privacy}","received_events_url":"https://api.github.com/users/KaiXinXiaoLei/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-09-21T12:35:22Z","updated_at":"2015-11-10T23:03:02Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/8848","html_url":"https://github.com/apache/spark/pull/8848","diff_url":"https://github.com/apache/spark/pull/8848.diff","patch_url":"https://github.com/apache/spark/pull/8848.patch"},"body":"I run jobs parallelly, exectors are removed before tasks finish because executors are idle timeout. I set \"spark.dynamicAllocation.executorIdleTimeout=60s\". But I find interval between last task finished in the executor and this executor removed is 10s. \r\nI read the dirver log and code, and find the tasks start and the SparkListenerTaskStart event does run.(In SparkListenerTaskStart  event, the executor state is set busy.)  And the tasks finish, and execuotor is removed  before this SparkListenerTaskStart  run.\r\nSo, I think when tasks will be running, the state of executor should be set busy."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/155595723","html_url":"https://github.com/apache/spark/pull/8848#issuecomment-155595723","issue_url":"https://api.github.com/repos/apache/spark/issues/8848","id":155595723,"user":{"login":"andrewor14","id":2133137,"avatar_url":"https://avatars.githubusercontent.com/u/2133137?v=3","gravatar_id":"","url":"https://api.github.com/users/andrewor14","html_url":"https://github.com/andrewor14","followers_url":"https://api.github.com/users/andrewor14/followers","following_url":"https://api.github.com/users/andrewor14/following{/other_user}","gists_url":"https://api.github.com/users/andrewor14/gists{/gist_id}","starred_url":"https://api.github.com/users/andrewor14/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andrewor14/subscriptions","organizations_url":"https://api.github.com/users/andrewor14/orgs","repos_url":"https://api.github.com/users/andrewor14/repos","events_url":"https://api.github.com/users/andrewor14/events{/privacy}","received_events_url":"https://api.github.com/users/andrewor14/received_events","type":"User","site_admin":false},"created_at":"2015-11-10T23:03:02Z","updated_at":"2015-11-10T23:03:02Z","body":"@KaiXinXiaoLei let's close this one because there's a better solution in #7888"}}