{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/9942","labels_url":"https://api.github.com/repos/apache/spark/issues/9942/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/9942/comments","events_url":"https://api.github.com/repos/apache/spark/issues/9942/events","html_url":"https://github.com/apache/spark/pull/9942","id":118679128,"number":9942,"title":"[SPARK-11382] [SQL] Improve error message when hitting this issue.","user":{"login":"nongli","id":242468,"avatar_url":"https://avatars.githubusercontent.com/u/242468?v=3","gravatar_id":"","url":"https://api.github.com/users/nongli","html_url":"https://github.com/nongli","followers_url":"https://api.github.com/users/nongli/followers","following_url":"https://api.github.com/users/nongli/following{/other_user}","gists_url":"https://api.github.com/users/nongli/gists{/gist_id}","starred_url":"https://api.github.com/users/nongli/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nongli/subscriptions","organizations_url":"https://api.github.com/users/nongli/orgs","repos_url":"https://api.github.com/users/nongli/repos","events_url":"https://api.github.com/users/nongli/events{/privacy}","received_events_url":"https://api.github.com/users/nongli/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-11-24T18:56:01Z","updated_at":"2015-11-24T19:17:44Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/9942","html_url":"https://github.com/apache/spark/pull/9942","diff_url":"https://github.com/apache/spark/pull/9942.diff","patch_url":"https://github.com/apache/spark/pull/9942.patch"},"body":"The issue is that the output commiter is not idempotent and retry attempts will\r\nfail because the output file already exists. It is not safe to clean up the file\r\nas this output committer is by design not retryable. Currently, the job fails\r\nwith a confusing file exists error. This patch is a stop gap to tell the user\r\nto look at the top of the error log for the proper message.\r\n\r\nThis is difficult to test locally as Spark is hardcoded not to retry. Manually\r\nverified by upping the retry attempts."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/159377805","html_url":"https://github.com/apache/spark/pull/9942#issuecomment-159377805","issue_url":"https://api.github.com/repos/apache/spark/issues/9942","id":159377805,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2015-11-24T19:17:43Z","updated_at":"2015-11-24T19:17:43Z","body":"Test FAILed.\nRefer to this link for build results (access rights to CI server needed): \nhttps://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/46620/\nTest FAILed."}}