{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/7028","labels_url":"https://api.github.com/repos/apache/spark/issues/7028/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/7028/comments","events_url":"https://api.github.com/repos/apache/spark/issues/7028/events","html_url":"https://github.com/apache/spark/pull/7028","id":91081465,"number":7028,"title":"[SPARK-8644] Include call site in SparkException stack traces thrown by job failures","user":{"login":"aarondav","id":1400247,"avatar_url":"https://avatars.githubusercontent.com/u/1400247?v=3","gravatar_id":"","url":"https://api.github.com/users/aarondav","html_url":"https://github.com/aarondav","followers_url":"https://api.github.com/users/aarondav/followers","following_url":"https://api.github.com/users/aarondav/following{/other_user}","gists_url":"https://api.github.com/users/aarondav/gists{/gist_id}","starred_url":"https://api.github.com/users/aarondav/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/aarondav/subscriptions","organizations_url":"https://api.github.com/users/aarondav/orgs","repos_url":"https://api.github.com/users/aarondav/repos","events_url":"https://api.github.com/users/aarondav/events{/privacy}","received_events_url":"https://api.github.com/users/aarondav/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":53,"created_at":"2015-06-25T21:31:56Z","updated_at":"2015-07-13T01:16:45Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/7028","html_url":"https://github.com/apache/spark/pull/7028","diff_url":"https://github.com/apache/spark/pull/7028.diff","patch_url":"https://github.com/apache/spark/pull/7028.patch"},"body":"Example exception (new part at bottom, clearly demarcated):\r\n\r\n```\r\norg.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0, localhost): java.lang.RuntimeException: uh-oh!\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite$$anonfun$37$$anonfun$38$$anonfun$apply$mcJ$sp$2.apply(DAGSchedulerSuite.scala:880)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite$$anonfun$37$$anonfun$38$$anonfun$apply$mcJ$sp$2.apply(DAGSchedulerSuite.scala:880)\r\n\tat scala.collection.Iterator$$anon$11.next(Iterator.scala:328)\r\n\tat org.apache.spark.util.Utils$.getIteratorSize(Utils.scala:1640)\r\n\tat org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1099)\r\n\tat org.apache.spark.rdd.RDD$$anonfun$count$1.apply(RDD.scala:1099)\r\n\tat org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1777)\r\n\tat org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1777)\r\n\tat org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:63)\r\n\tat org.apache.spark.scheduler.Task.run(Task.scala:70)\r\n\tat org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)\r\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\r\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\r\n\tat java.lang.Thread.run(Thread.java:744)\r\n\r\nDriver stacktrace:\r\n\tat org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1298)\r\n\tat org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1289)\r\n\tat org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1288)\r\n\tat scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)\r\n\tat scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)\r\n\tat org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1288)\r\n\tat org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:755)\r\n\tat org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:755)\r\n\tat scala.Option.foreach(Option.scala:236)\r\n\tat org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:755)\r\n\tat org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1509)\r\n\tat org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1470)\r\n\tat org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1459)\r\n\tat org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)\r\n\tat org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:560)\r\n\tat org.apache.spark.SparkContext.runJob(SparkContext.scala:1744)\r\n\tat org.apache.spark.SparkContext.runJob(SparkContext.scala:1762)\r\n\tat org.apache.spark.SparkContext.runJob(SparkContext.scala:1777)\r\n\tat org.apache.spark.SparkContext.runJob(SparkContext.scala:1791)\r\n\tat org.apache.spark.rdd.RDD.count(RDD.scala:1099)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite$$anonfun$37$$anonfun$38.apply$mcJ$sp(DAGSchedulerSuite.scala:880)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite$$anonfun$37$$anonfun$38.apply(DAGSchedulerSuite.scala:880)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite$$anonfun$37$$anonfun$38.apply(DAGSchedulerSuite.scala:880)\r\n\tat org.scalatest.Assertions$class.intercept(Assertions.scala:997)\r\n\tat org.scalatest.FunSuite.intercept(FunSuite.scala:1555)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite$$anonfun$37.apply$mcV$sp(DAGSchedulerSuite.scala:879)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite$$anonfun$37.apply(DAGSchedulerSuite.scala:878)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite$$anonfun$37.apply(DAGSchedulerSuite.scala:878)\r\n\tat org.scalatest.Transformer$$anonfun$apply$1.apply$mcV$sp(Transformer.scala:22)\r\n\tat org.scalatest.OutcomeOf$class.outcomeOf(OutcomeOf.scala:85)\r\n\tat org.scalatest.OutcomeOf$.outcomeOf(OutcomeOf.scala:104)\r\n\tat org.scalatest.Transformer.apply(Transformer.scala:22)\r\n\tat org.scalatest.Transformer.apply(Transformer.scala:20)\r\n\tat org.scalatest.FunSuiteLike$$anon$1.apply(FunSuiteLike.scala:166)\r\n\tat org.apache.spark.SparkFunSuite.withFixture(SparkFunSuite.scala:42)\r\n\tat org.scalatest.FunSuiteLike$class.invokeWithFixture$1(FunSuiteLike.scala:163)\r\n\tat org.scalatest.FunSuiteLike$$anonfun$runTest$1.apply(FunSuiteLike.scala:175)\r\n\tat org.scalatest.FunSuiteLike$$anonfun$runTest$1.apply(FunSuiteLike.scala:175)\r\n\tat org.scalatest.SuperEngine.runTestImpl(Engine.scala:306)\r\n\tat org.scalatest.FunSuiteLike$class.runTest(FunSuiteLike.scala:175)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite.org$scalatest$BeforeAndAfter$$super$runTest(DAGSchedulerSuite.scala:70)\r\n\tat org.scalatest.BeforeAndAfter$class.runTest(BeforeAndAfter.scala:200)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite.org$scalatest$BeforeAndAfterEach$$super$runTest(DAGSchedulerSuite.scala:70)\r\n\tat org.scalatest.BeforeAndAfterEach$class.runTest(BeforeAndAfterEach.scala:255)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite.runTest(DAGSchedulerSuite.scala:70)\r\n\tat org.scalatest.FunSuiteLike$$anonfun$runTests$1.apply(FunSuiteLike.scala:208)\r\n\tat org.scalatest.FunSuiteLike$$anonfun$runTests$1.apply(FunSuiteLike.scala:208)\r\n\tat org.scalatest.SuperEngine$$anonfun$traverseSubNodes$1$1.apply(Engine.scala:413)\r\n\tat org.scalatest.SuperEngine$$anonfun$traverseSubNodes$1$1.apply(Engine.scala:401)\r\n\tat scala.collection.immutable.List.foreach(List.scala:318)\r\n\tat org.scalatest.SuperEngine.traverseSubNodes$1(Engine.scala:401)\r\n\tat org.scalatest.SuperEngine.org$scalatest$SuperEngine$$runTestsInBranch(Engine.scala:396)\r\n\tat org.scalatest.SuperEngine.runTestsImpl(Engine.scala:483)\r\n\tat org.scalatest.FunSuiteLike$class.runTests(FunSuiteLike.scala:208)\r\n\tat org.scalatest.FunSuite.runTests(FunSuite.scala:1555)\r\n\tat org.scalatest.Suite$class.run(Suite.scala:1424)\r\n\tat org.scalatest.FunSuite.org$scalatest$FunSuiteLike$$super$run(FunSuite.scala:1555)\r\n\tat org.scalatest.FunSuiteLike$$anonfun$run$1.apply(FunSuiteLike.scala:212)\r\n\tat org.scalatest.FunSuiteLike$$anonfun$run$1.apply(FunSuiteLike.scala:212)\r\n\tat org.scalatest.SuperEngine.runImpl(Engine.scala:545)\r\n\tat org.scalatest.FunSuiteLike$class.run(FunSuiteLike.scala:212)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite.org$scalatest$BeforeAndAfter$$super$run(DAGSchedulerSuite.scala:70)\r\n\tat org.scalatest.BeforeAndAfter$class.run(BeforeAndAfter.scala:241)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite.org$scalatest$BeforeAndAfterAll$$super$run(DAGSchedulerSuite.scala:70)\r\n\tat org.scalatest.BeforeAndAfterAll$class.liftedTree1$1(BeforeAndAfterAll.scala:257)\r\n\tat org.scalatest.BeforeAndAfterAll$class.run(BeforeAndAfterAll.scala:256)\r\n\tat org.apache.spark.scheduler.DAGSchedulerSuite.run(DAGSchedulerSuite.scala:70)\r\n\tat org.scalatest.tools.Framework.org$scalatest$tools$Framework$$runSuite(Framework.scala:462)\r\n\tat org.scalatest.tools.Framework$ScalaTestTask.execute(Framework.scala:671)\r\n\tat sbt.ForkMain$Run$2.call(ForkMain.java:294)\r\n\tat sbt.ForkMain$Run$2.call(ForkMain.java:284)\r\n\tat java.util.concurrent.FutureTask.run(FutureTask.java:262)\r\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\r\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\r\n\tat java.lang.Thread.run(Thread.java:744)\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/120779285","html_url":"https://github.com/apache/spark/pull/7028#issuecomment-120779285","issue_url":"https://api.github.com/repos/apache/spark/issues/7028","id":120779285,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2015-07-13T01:16:45Z","updated_at":"2015-07-13T01:16:45Z","body":"  [Test build #37107 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/37107/consoleFull) for   PR 7028 at commit [`4714664`](https://github.com/apache/spark/commit/47146644e704a3d15661340a598c29b622cee28f)."}}