{"action":"created","issue":{"url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/272","labels_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/272/labels{/name}","comments_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/272/comments","events_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/272/events","html_url":"https://github.com/andypetrella/spark-notebook/issues/272","id":96466180,"number":272,"title":"Null pointer exception when intializing s3 textFile","user":{"login":"tmandry","id":2280544,"avatar_url":"https://avatars.githubusercontent.com/u/2280544?v=3","gravatar_id":"","url":"https://api.github.com/users/tmandry","html_url":"https://github.com/tmandry","followers_url":"https://api.github.com/users/tmandry/followers","following_url":"https://api.github.com/users/tmandry/following{/other_user}","gists_url":"https://api.github.com/users/tmandry/gists{/gist_id}","starred_url":"https://api.github.com/users/tmandry/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tmandry/subscriptions","organizations_url":"https://api.github.com/users/tmandry/orgs","repos_url":"https://api.github.com/users/tmandry/repos","events_url":"https://api.github.com/users/tmandry/events{/privacy}","received_events_url":"https://api.github.com/users/tmandry/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-07-22T03:20:17Z","updated_at":"2015-07-22T05:57:24Z","closed_at":null,"body":"Trying to run this line:\r\n\r\n`val events = sparkContext.textFile(\"s3n://<bucket-name>/mixpanel/utexas/monthly/*.json.gz\")`\r\n\r\nWhere `<bucket-name>` is the name of my bucket. It's the first line in the notebook. This line works every night in production. Here's what I get.\r\n\r\n```\r\n[debug] application - Sending info to websockets List() in notebook.server.CalcWebSocketService$CalcActor$$anon$4@53416011\r\n[debug] application - Sending info to websockets List() in notebook.server.CalcWebSocketService$CalcActor$$anon$4@53416011\r\n[error] a.a.OneForOneStrategy - null\r\njava.lang.NullPointerException: null\r\n\tat notebook.server.CalcWebSocketService$CalcActor$$anonfun$receive$1.applyOrElse(CalcWebSocketService.scala:132) ~[noootsab.spark-notebook-0.6.0-scala-2.10.4-spark-1.4.1-hadoop-2.5.0-with-hive-with-parquet.jar:0.6.0-scala-2.10.4-spark-1.4.1-hadoop-2.5.0-with-hive-with-parquet]\r\n\tat akka.actor.Actor$class.aroundReceive(Actor.scala:465) ~[org.spark-project.akka.akka-actor_2.10-2.3.4-spark.jar:na]\r\n\tat notebook.server.CalcWebSocketService$CalcActor.aroundReceive(CalcWebSocketService.scala:37) ~[noootsab.spark-notebook-0.6.0-scala-2.10.4-spark-1.4.1-hadoop-2.5.0-with-hive-with-parquet.jar:0.6.0-scala-2.10.4-spark-1.4.1-hadoop-2.5.0-with-hive-with-parquet]\r\n\tat akka.actor.ActorCell.receiveMessage(ActorCell.scala:516) [org.spark-project.akka.akka-actor_2.10-2.3.4-spark.jar:na]\r\n\tat akka.actor.ActorCell.invoke(ActorCell.scala:487) [org.spark-project.akka.akka-actor_2.10-2.3.4-spark.jar:na]\r\n[info] application - SAVE ? Untitled1.snb\r\n```\r\n\r\nHere's my build:\r\n```\r\nnotebook: 0.6.0\r\nscala: 2.10.4\r\nspark: 1.4.1\r\nhadoop: 2.5.0\r\nwith hive: true\r\nwith parquet: true\r\npackage: docker\r\n```"},"comment":{"url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/comments/123571835","html_url":"https://github.com/andypetrella/spark-notebook/issues/272#issuecomment-123571835","issue_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/272","id":123571835,"user":{"login":"andypetrella","id":663344,"avatar_url":"https://avatars.githubusercontent.com/u/663344?v=3","gravatar_id":"","url":"https://api.github.com/users/andypetrella","html_url":"https://github.com/andypetrella","followers_url":"https://api.github.com/users/andypetrella/followers","following_url":"https://api.github.com/users/andypetrella/following{/other_user}","gists_url":"https://api.github.com/users/andypetrella/gists{/gist_id}","starred_url":"https://api.github.com/users/andypetrella/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andypetrella/subscriptions","organizations_url":"https://api.github.com/users/andypetrella/orgs","repos_url":"https://api.github.com/users/andypetrella/repos","events_url":"https://api.github.com/users/andypetrella/events{/privacy}","received_events_url":"https://api.github.com/users/andypetrella/received_events","type":"User","site_admin":false},"created_at":"2015-07-22T05:57:23Z","updated_at":"2015-07-22T05:57:23Z","body":"mmmmh, looks like a web socket problem, could you try another kind a build maybe? a tar for instance, in case the docker has a problem with that -- but would surprise me\r\n\r\nFor S3 access, you exported the two AWS_ variables and adapted the sparkContext conf with the s3 credentials (including hadoopConfiguration) I guess right?"}}