{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/9273","labels_url":"https://api.github.com/repos/apache/spark/issues/9273/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/9273/comments","events_url":"https://api.github.com/repos/apache/spark/issues/9273/events","html_url":"https://github.com/apache/spark/pull/9273","id":113263196,"number":9273,"title":"[SPARK-11306] Fix hang when JVM exits.","user":{"login":"kayousterhout","id":1108612,"avatar_url":"https://avatars.githubusercontent.com/u/1108612?v=3","gravatar_id":"","url":"https://api.github.com/users/kayousterhout","html_url":"https://github.com/kayousterhout","followers_url":"https://api.github.com/users/kayousterhout/followers","following_url":"https://api.github.com/users/kayousterhout/following{/other_user}","gists_url":"https://api.github.com/users/kayousterhout/gists{/gist_id}","starred_url":"https://api.github.com/users/kayousterhout/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kayousterhout/subscriptions","organizations_url":"https://api.github.com/users/kayousterhout/orgs","repos_url":"https://api.github.com/users/kayousterhout/repos","events_url":"https://api.github.com/users/kayousterhout/events{/privacy}","received_events_url":"https://api.github.com/users/kayousterhout/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-10-25T23:59:19Z","updated_at":"2015-10-26T02:04:46Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/9273","html_url":"https://github.com/apache/spark/pull/9273","diff_url":"https://github.com/apache/spark/pull/9273.diff","patch_url":"https://github.com/apache/spark/pull/9273.patch"},"body":"This commit fixes a bug where, in Standalone mode, if a task fails and crashes the JVM, the\r\nfailure is considered a \"normal failure\" (meaning it's considered unrelated to the task), so\r\nthe failure isn't counted against the task's maximum number of failures:\r\nhttps://github.com/apache/spark/commit/af3bc59d1f5d9d952c2d7ad1af599c49f1dbdaf0#diff-a755f3d892ff2506a7aa7db52022d77cL138.\r\nAs a result, if a task fails in a way that results in it crashing the JVM, it will continuously be\r\nre-launched, resulting in a hang. This commit fixes that problem.\r\n\r\nThis bug was introduced by #8007; @andrewor14 @mcchea @vanzin can you take a look at this?\r\n\r\nThis error is hard to trigger because we handle executor losses through 2 code paths (the second is via Akka, where Akka notices that the executor endpoint is disconnected).  In my setup, the Akka code path completes first, and doesn't have this bug, so things work fine (see my recent email to the dev list about this).  If I manually disable the Akka code path, I can see the hang (and this commit fixes the issue)."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/151001763","html_url":"https://github.com/apache/spark/pull/9273#issuecomment-151001763","issue_url":"https://api.github.com/repos/apache/spark/issues/9273","id":151001763,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2015-10-26T02:04:46Z","updated_at":"2015-10-26T02:04:46Z","body":"Merged build finished. Test PASSed."}}