{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/5491","labels_url":"https://api.github.com/repos/apache/spark/issues/5491/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/5491/comments","events_url":"https://api.github.com/repos/apache/spark/issues/5491/events","html_url":"https://github.com/apache/spark/pull/5491","id":68087498,"number":5491,"title":"[SPARK-6879][HistoryServer]check if app is completed before clean it up","user":{"login":"WangTaoTheTonic","id":5276001,"avatar_url":"https://avatars.githubusercontent.com/u/5276001?v=3","gravatar_id":"","url":"https://api.github.com/users/WangTaoTheTonic","html_url":"https://github.com/WangTaoTheTonic","followers_url":"https://api.github.com/users/WangTaoTheTonic/followers","following_url":"https://api.github.com/users/WangTaoTheTonic/following{/other_user}","gists_url":"https://api.github.com/users/WangTaoTheTonic/gists{/gist_id}","starred_url":"https://api.github.com/users/WangTaoTheTonic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/WangTaoTheTonic/subscriptions","organizations_url":"https://api.github.com/users/WangTaoTheTonic/orgs","repos_url":"https://api.github.com/users/WangTaoTheTonic/repos","events_url":"https://api.github.com/users/WangTaoTheTonic/events{/privacy}","received_events_url":"https://api.github.com/users/WangTaoTheTonic/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":38,"created_at":"2015-04-13T12:40:48Z","updated_at":"2015-04-21T02:51:26Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/5491","html_url":"https://github.com/apache/spark/pull/5491","diff_url":"https://github.com/apache/spark/pull/5491.diff","patch_url":"https://github.com/apache/spark/pull/5491.patch"},"body":"https://issues.apache.org/jira/browse/SPARK-6879\r\n\r\nUse `applications` to replace `FileStatus`, and check if the app is completed before clean it up.\r\nIf an exception was throwed, add it to `applications` to wait for the next loop."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/94621686","html_url":"https://github.com/apache/spark/pull/5491#issuecomment-94621686","issue_url":"https://api.github.com/repos/apache/spark/issues/5491","id":94621686,"user":{"login":"WangTaoTheTonic","id":5276001,"avatar_url":"https://avatars.githubusercontent.com/u/5276001?v=3","gravatar_id":"","url":"https://api.github.com/users/WangTaoTheTonic","html_url":"https://github.com/WangTaoTheTonic","followers_url":"https://api.github.com/users/WangTaoTheTonic/followers","following_url":"https://api.github.com/users/WangTaoTheTonic/following{/other_user}","gists_url":"https://api.github.com/users/WangTaoTheTonic/gists{/gist_id}","starred_url":"https://api.github.com/users/WangTaoTheTonic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/WangTaoTheTonic/subscriptions","organizations_url":"https://api.github.com/users/WangTaoTheTonic/orgs","repos_url":"https://api.github.com/users/WangTaoTheTonic/repos","events_url":"https://api.github.com/users/WangTaoTheTonic/events{/privacy}","received_events_url":"https://api.github.com/users/WangTaoTheTonic/received_events","type":"User","site_admin":false},"created_at":"2015-04-21T02:51:26Z","updated_at":"2015-04-21T02:51:26Z","body":"If we changed the way to iterate like you said, the delete operations may cost too much time here (even be stuck) in case DFS client throw IOException often (though with a very low possibility). So I'd keep it like now.\r\n\r\nTreating ACE specially is good and I did it like in `checkForLogs`."}}