{"action":"created","issue":{"url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/249","labels_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/249/labels{/name}","comments_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/249/comments","events_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/249/events","html_url":"https://github.com/andypetrella/spark-notebook/issues/249","id":94916294,"number":249,"title":"Error in the new Ehanced Dataframe widget","user":{"login":"jarutis","id":3201415,"avatar_url":"https://avatars.githubusercontent.com/u/3201415?v=3","gravatar_id":"","url":"https://api.github.com/users/jarutis","html_url":"https://github.com/jarutis","followers_url":"https://api.github.com/users/jarutis/followers","following_url":"https://api.github.com/users/jarutis/following{/other_user}","gists_url":"https://api.github.com/users/jarutis/gists{/gist_id}","starred_url":"https://api.github.com/users/jarutis/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jarutis/subscriptions","organizations_url":"https://api.github.com/users/jarutis/orgs","repos_url":"https://api.github.com/users/jarutis/repos","events_url":"https://api.github.com/users/jarutis/events{/privacy}","received_events_url":"https://api.github.com/users/jarutis/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/andypetrella/spark-notebook/labels/bug","name":"bug","color":"fc2929"}],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/andypetrella/spark-notebook/milestones/7","html_url":"https://github.com/andypetrella/spark-notebook/milestones/0.6.0","labels_url":"https://api.github.com/repos/andypetrella/spark-notebook/milestones/7/labels","id":1085090,"number":7,"title":"0.6.0","description":null,"creator":{"login":"andypetrella","id":663344,"avatar_url":"https://avatars.githubusercontent.com/u/663344?v=3","gravatar_id":"","url":"https://api.github.com/users/andypetrella","html_url":"https://github.com/andypetrella","followers_url":"https://api.github.com/users/andypetrella/followers","following_url":"https://api.github.com/users/andypetrella/following{/other_user}","gists_url":"https://api.github.com/users/andypetrella/gists{/gist_id}","starred_url":"https://api.github.com/users/andypetrella/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andypetrella/subscriptions","organizations_url":"https://api.github.com/users/andypetrella/orgs","repos_url":"https://api.github.com/users/andypetrella/repos","events_url":"https://api.github.com/users/andypetrella/events{/privacy}","received_events_url":"https://api.github.com/users/andypetrella/received_events","type":"User","site_admin":false},"open_issues":1,"closed_issues":23,"state":"open","created_at":"2015-04-27T12:49:10Z","updated_at":"2015-07-20T18:43:32Z","due_on":null,"closed_at":null},"comments":6,"created_at":"2015-07-14T10:36:15Z","updated_at":"2015-07-20T20:08:54Z","closed_at":null,"body":"I got the following error trying to use the new dataframe renderer.\r\n\r\n``` \r\nLost task 0.0 in stage 0.0 (TID 0, hz-bd-hdp32.vinted.net): java.lang.ClassNotFoundException: notebook.front.widgets.DataFrameView$$anonfun$3\r\n\tat org.apache.spark.repl.ExecutorClassLoader.findClass(ExecutorClassLoader.scala:69)\r\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:425)\r\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:358)\r\n\tat java.lang.Class.forName0(Native Method)\r\n\tat java.lang.Class.forName(Class.java:274)\r\n\tat org.apache.spark.serializer.JavaDeserializationStream$$anon$1.resolveClass(JavaSerializer.scala:66)\r\n\tat java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1612)\r\n\tat java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1517)\r\n\tat java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1771)\r\n\tat java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)\r\n\tat java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)\r\n\tat java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)\r\n\tat java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)\r\n\tat java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)\r\n\tat java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1990)\r\n\tat java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1915)\r\n\tat java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1798)\r\n\tat java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1350)\r\n\tat java.io.ObjectInputStream.readObject(ObjectInputStream.java:370)\r\n\tat org.apache.spark.serializer.JavaDeserializationStream.readObject(JavaSerializer.scala:69)\r\n\tat org.apache.spark.serializer.JavaSerializerInstance.deserialize(JavaSerializer.scala:95)\r\n\tat org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:58)\r\n\tat org.apache.spark.scheduler.Task.run(Task.scala:70)\r\n\tat org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)\r\n\tat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)\r\n\tat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)\r\n\tat java.lang.Thread.run(Thread.java:745)\r\nCaused by: java.lang.ClassNotFoundException: notebook.front.widgets.DataFrameView$$anonfun$3\r\n\tat java.lang.ClassLoader.findClass(ClassLoader.java:531)\r\n\tat org.apache.spark.util.ParentClassLoader.findClass(ParentClassLoader.scala:26)\r\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:425)\r\n\tat org.apache.spark.util.ParentClassLoader.loadClass(ParentClassLoader.scala:34)\r\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:358)\r\n\tat org.apache.spark.util.ParentClassLoader.loadClass(ParentClassLoader.scala:30)\r\n\tat org.apache.spark.repl.ExecutorClassLoader.findClass(ExecutorClassLoader.scala:64)\r\n```"},"comment":{"url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/comments/123014197","html_url":"https://github.com/andypetrella/spark-notebook/issues/249#issuecomment-123014197","issue_url":"https://api.github.com/repos/andypetrella/spark-notebook/issues/249","id":123014197,"user":{"login":"andypetrella","id":663344,"avatar_url":"https://avatars.githubusercontent.com/u/663344?v=3","gravatar_id":"","url":"https://api.github.com/users/andypetrella","html_url":"https://github.com/andypetrella","followers_url":"https://api.github.com/users/andypetrella/followers","following_url":"https://api.github.com/users/andypetrella/following{/other_user}","gists_url":"https://api.github.com/users/andypetrella/gists{/gist_id}","starred_url":"https://api.github.com/users/andypetrella/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/andypetrella/subscriptions","organizations_url":"https://api.github.com/users/andypetrella/orgs","repos_url":"https://api.github.com/users/andypetrella/repos","events_url":"https://api.github.com/users/andypetrella/events{/privacy}","received_events_url":"https://api.github.com/users/andypetrella/received_events","type":"User","site_admin":false},"created_at":"2015-07-20T20:08:54Z","updated_at":"2015-07-20T20:08:54Z","body":"Okay, found a **hack**, that sanitizes my brain's health.\r\n\r\nInjecting the `commons.commons_2.1....jar` works using either\r\n\r\n* `:cp`\r\n* `spark.jars` in the metadata\r\n\r\nBloody closures...\r\n\r\nThe quickest option I find for now is to always inject this jar in the spark context, using a distro it's rather easy, the problem will be when using the `spark-notebook` from SBT :-/.\r\n\r\nIt's a price I'd pay for that, since the impact is limited to only automatic display.\r\n\r\nHowever, there is branch I started some days ago that is (aslo) meant for this kind of problems, the `clean-cp` one that creates cleaner modules that could be deployed.\r\n\r\nHaving modules deployable, and image, a distro will contain a default maven/ivy repository that is always included in the look up path we'll can refer the jars directly from there using artifact defs.\r\n\r\nSo for, now I'll put it dirty in the `spark.jars` until we split the jars into more granular libraries (not shipping the whole #!)"}}