{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/3962","labels_url":"https://api.github.com/repos/apache/spark/issues/3962/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/3962/comments","events_url":"https://api.github.com/repos/apache/spark/issues/3962/events","html_url":"https://github.com/apache/spark/pull/3962","id":53827161,"number":3962,"title":"[SPARK-4955]With executor dynamic scaling enabled,executor shoude be added or killed in yarn-cluster mode.","user":{"login":"lianhuiwang","id":545478,"avatar_url":"https://avatars.githubusercontent.com/u/545478?v=3","gravatar_id":"","url":"https://api.github.com/users/lianhuiwang","html_url":"https://github.com/lianhuiwang","followers_url":"https://api.github.com/users/lianhuiwang/followers","following_url":"https://api.github.com/users/lianhuiwang/following{/other_user}","gists_url":"https://api.github.com/users/lianhuiwang/gists{/gist_id}","starred_url":"https://api.github.com/users/lianhuiwang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lianhuiwang/subscriptions","organizations_url":"https://api.github.com/users/lianhuiwang/orgs","repos_url":"https://api.github.com/users/lianhuiwang/repos","events_url":"https://api.github.com/users/lianhuiwang/events{/privacy}","received_events_url":"https://api.github.com/users/lianhuiwang/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":30,"created_at":"2015-01-09T02:28:31Z","updated_at":"2015-01-26T03:04:58Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/3962","html_url":"https://github.com/apache/spark/pull/3962","diff_url":"https://github.com/apache/spark/pull/3962.diff","patch_url":"https://github.com/apache/spark/pull/3962.patch"},"body":"With executor dynamic scaling enabled, executor number shoude be added or killed in yarn-cluster mode.so in yarn-cluster mode, ApplicationMaster start a AMActor that add or kill a executor. then YarnSchedulerActor  in YarnSchedulerBackend send message to am's AMActor.\r\n@andrewor14 @ChengXiangLi @tdas "},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/71409528","html_url":"https://github.com/apache/spark/pull/3962#issuecomment-71409528","issue_url":"https://api.github.com/repos/apache/spark/issues/3962","id":71409528,"user":{"login":"andrewor14","id":2133137,"avatar_url":"https://avatars.githubusercontent.com/u/2133137?v=3","gravatar_id":"","url":"https://api.github.com/users/andrewor14","html_url":"https://github.com/andrewor14","followers_url":"https://api.github.com/users/andrewor14/followers","following_url":"https://api.github.com/users/andrewor14/following{/other_user}","gists_url":"https://api.github.com/users/andrewor14/gists{/gist_id}","starred_url":"https://api.github.com/users/andrewor14/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andrewor14/subscriptions","organizations_url":"https://api.github.com/users/andrewor14/orgs","repos_url":"https://api.github.com/users/andrewor14/repos","events_url":"https://api.github.com/users/andrewor14/events{/privacy}","received_events_url":"https://api.github.com/users/andrewor14/received_events","type":"User","site_admin":false},"created_at":"2015-01-26T03:04:58Z","updated_at":"2015-01-26T03:04:58Z","body":"@lianhuiwang I still don't understand why we don't want to subscribe to disassociated event in cluster mode. What would happen if we subscribed to disassociated events in both modes? Is it not needed, or is it incorrect to do so in cluster mode? Right now there's some complexity introduced here that I don't find necessary, but maybe there's something I'm missing. My understanding is that all that is required here is to also start the same actors (`YarnSchedulerActor` and `AMActor`) in cluster mode as we do in client mode."}}