{"action":"created","issue":{"url":"https://api.github.com/repos/NFLabs/zeppelin/issues/292","labels_url":"https://api.github.com/repos/NFLabs/zeppelin/issues/292/labels{/name}","comments_url":"https://api.github.com/repos/NFLabs/zeppelin/issues/292/comments","events_url":"https://api.github.com/repos/NFLabs/zeppelin/issues/292/events","html_url":"https://github.com/NFLabs/zeppelin/issues/292","id":54924743,"number":292,"title":"Spark Cluster - BlockManagerId local class incompatible: stream classdesc serialVersionUID","user":{"login":"tsindot","id":4061201,"avatar_url":"https://avatars.githubusercontent.com/u/4061201?v=3","gravatar_id":"","url":"https://api.github.com/users/tsindot","html_url":"https://github.com/tsindot","followers_url":"https://api.github.com/users/tsindot/followers","following_url":"https://api.github.com/users/tsindot/following{/other_user}","gists_url":"https://api.github.com/users/tsindot/gists{/gist_id}","starred_url":"https://api.github.com/users/tsindot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tsindot/subscriptions","organizations_url":"https://api.github.com/users/tsindot/orgs","repos_url":"https://api.github.com/users/tsindot/repos","events_url":"https://api.github.com/users/tsindot/events{/privacy}","received_events_url":"https://api.github.com/users/tsindot/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/NFLabs/zeppelin/labels/bug","name":"bug","color":"fc2929"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-01-20T19:06:10Z","updated_at":"2015-01-23T17:55:19Z","closed_at":null,"body":"First thanks for all the time an effort on the project, it is a great tool. Second I apologize in advance for the length of this post.\r\n\r\nEnvironment:\r\n* JDK 8, version 1.8.0_25-b17\r\n* Macbook Pro (OS X 10.9.5)\r\n* Spark 1.1.1\r\n* Zeppelin - git clone of master and built with:\r\n    * ```mvn install -DskipTests -Dspark.version=1.1.1 -Dhadoop.version=2.4.0```\r\n\r\nI’m going through the [tutorial](http://zeppelin-project.org/docs/tutorial/tutorial.html) and when I run it in a standalone mode, i.e. no separate Spark Master / Cluster, everything seem works fine. \r\n\r\nHowever, if I startup a standalone spark cluster as follows:\r\n\r\n* Master:  ```$SPARK_HOME/sbin/start-master.sh```\r\n* Worker1: ```$SPARK_HOME//bin/spark-class org.apache.spark.deploy.worker.Worker spark://radtech.io:7077 --webui-port 8081 --cores 2 --memory 1G```\r\n* Worker2: ```$SPARK_HOME//bin/spark-class org.apache.spark.deploy.worker.Worker spark://radtech.io:7077 --webui-port 8082 --cores 2 --memory 1G``\r\n\r\nThen modify the conf/zeppelin-enf.conf to attach to the cluster:\r\n```\r\n#!/bin/bash\r\n\r\n# export JAVA_HOME=\r\n export MASTER=spark://radtech.io:7077 # spark master\r\n\r\n# export ZEPPELIN_JAVA_OPTS      # additional jvm options. for example, export ZEPPELIN_JAVA_OPTS=\"-Dspark.executor.memory=8g -Dspark.cores.max=16\"\r\n# export ZEPPELIN_MEM            # zeppelin jvm mem options Defualt -Xmx1024m -XX:MaxPermSize=512m\r\n\r\n# export ZEPPELIN_CONF_DIR       # Alternate zeppelin conf dir. Default is ${HBASE_HOME}/conf.\r\n# export ZEPPELIN_LOG_DIR        # Where log files are stored.  PWD by default.\r\n# export ZEPPELIN_PID_DIR        # The pid files are stored. /tmp by default.\r\n# export ZEPPELIN_NOTEBOOK_DIR   # Where notebook saved\r\n# export ZEPPELIN_IDENT_STRING   # A string representing this instance of zeppelin. $USER by default\r\n# export ZEPPELIN_NICENESS       # The scheduling priority for daemons. Defaults to 0.\r\n```\r\n\r\n I start to experience problems, specifically ```serialVersionUID``` incompatibility  issues.  It appears that there may be 2 instances of ```org.apache.spark.storage.BlockManagerId``` based on this exception below.\r\n\r\nNow when I execute this example from the tutorial, \r\n```\r\nval bankText = sc.textFile(\"/Users/work/zeppelin_test_data/bank/bank-full.csv\")\r\n\r\ncase class Bank(age:Integer, job:String, marital : String, education : String, balance : Integer)\r\n\r\nval bank = bankText.map(s=>s.split(\";\")).filter(s=>s(0)!=\"\\\"age\\\"\").map(\r\n    s=>Bank(s(0).toInt, \r\n            s(1).replaceAll(\"\\\"\", \"\"),\r\n            s(2).replaceAll(\"\\\"\", \"\"),\r\n            s(3).replaceAll(\"\\\"\", \"\"),\r\n            s(5).replaceAll(\"\\\"\", \"\").toInt\r\n        )\r\n)\r\n\r\nbank.registerTempTable(\"bank”)\r\n```\r\nI see the following in the log after it is \"Finished\" in the UI:\r\n\r\n```\r\n INFO [2015-01-20 13:12:06,085] ({sparkDriver-akka.actor.default-dispatcher-3} Slf4jLogger.scala[applyOrElse]:80) - Slf4jLogger started\r\n INFO [2015-01-20 13:12:06,180] ({sparkDriver-akka.actor.default-dispatcher-2} Slf4jLogger.scala[apply$mcV$sp]:74) - Starting remoting\r\n INFO [2015-01-20 13:12:06,609] ({sparkDriver-akka.actor.default-dispatcher-3} Slf4jLogger.scala[apply$mcV$sp]:74) - Remoting started; listening on addresses :[akka.tcp://sparkDriver@192.168.1.3:50413]\r\n INFO [2015-01-20 13:12:06,614] ({sparkDriver-akka.actor.default-dispatcher-5} Slf4jLogger.scala[apply$mcV$sp]:74) - Remoting now listens on addresses: [akka.tcp://sparkDriver@192.168.1.3:50413]\r\n INFO [2015-01-20 13:12:06,627] ({Thread-25} Logging.scala[logInfo]:59) - Successfully started service 'sparkDriver' on port 50413.\r\n INFO [2015-01-20 13:12:06,660] ({Thread-25} Logging.scala[logInfo]:59) - Registering MapOutputTracker\r\n INFO [2015-01-20 13:12:06,675] ({Thread-25} Logging.scala[logInfo]:59) - Registering BlockManagerMaster\r\n INFO [2015-01-20 13:12:06,714] ({Thread-25} Logging.scala[logInfo]:59) - Created local directory at /var/folders/kv/t9dpl73124l4hbk5kbxjl_y40000gn/T/spark-local-20150120131206-ae57\r\n INFO [2015-01-20 13:12:06,946] ({Thread-25} Logging.scala[logInfo]:59) - Successfully started service 'Connection manager for block manager' on port 50414.\r\n INFO [2015-01-20 13:12:06,949] ({Thread-25} Logging.scala[logInfo]:59) - Bound socket to port 50414 with id = ConnectionManagerId(192.168.1.3,50414)\r\n INFO [2015-01-20 13:12:06,954] ({Thread-25} Logging.scala[logInfo]:59) - MemoryStore started with capacity 491.7 MB\r\n INFO [2015-01-20 13:12:06,964] ({Thread-25} Logging.scala[logInfo]:59) - Trying to register BlockManager\r\n INFO [2015-01-20 13:12:06,969] ({sparkDriver-akka.actor.default-dispatcher-3} Logging.scala[logInfo]:59) - Registering block manager 192.168.1.3:50414 with 491.7 MB RAM, BlockManagerId(<driver>, 192.168.1.3, 50414, 0)\r\n INFO [2015-01-20 13:12:06,973] ({Thread-25} Logging.scala[logInfo]:59) - Registered BlockManager\r\n INFO [2015-01-20 13:12:07,009] ({Thread-25} Logging.scala[logInfo]:59) - HTTP File server directory is /var/folders/kv/t9dpl73124l4hbk5kbxjl_y40000gn/T/spark-aacd8b91-610e-452c-976b-19b765dffa9d\r\n INFO [2015-01-20 13:12:07,009] ({Thread-25} Logging.scala[logInfo]:59) - Starting HTTP Server\r\n INFO [2015-01-20 13:12:07,011] ({Thread-25} Server.java[doStart]:272) - jetty-8.1.14.v20131031\r\n INFO [2015-01-20 13:12:07,013] ({Thread-25} AbstractConnector.java[doStart]:338) - Started SocketConnector@0.0.0.0:50415\r\n INFO [2015-01-20 13:12:07,015] ({Thread-25} Logging.scala[logInfo]:59) - Successfully started service 'HTTP file server' on port 50415.\r\n INFO [2015-01-20 13:12:07,382] ({Thread-25} Server.java[doStart]:272) - jetty-8.1.14.v20131031\r\n INFO [2015-01-20 13:12:07,396] ({Thread-25} AbstractConnector.java[doStart]:338) - Started SelectChannelConnector@0.0.0.0:4040\r\n INFO [2015-01-20 13:12:07,398] ({Thread-25} Logging.scala[logInfo]:59) - Successfully started service 'SparkUI' on port 4040.\r\n INFO [2015-01-20 13:12:07,405] ({Thread-25} Logging.scala[logInfo]:59) - Started SparkUI at http://192.168.1.3:4040\r\n WARN [2015-01-20 13:12:07,697] ({Thread-25} NativeCodeLoader.java[<clinit>]:62) - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable\r\n INFO [2015-01-20 13:12:08,027] ({Thread-25} Logging.scala[logInfo]:59) - Created default pool default, schedulingMode: FIFO, minShare: 0, weight: 1\r\n INFO [2015-01-20 13:12:08,082] ({sparkDriver-akka.actor.default-dispatcher-3} Logging.scala[logInfo]:59) - Connecting to master spark://radtech.io:7077...\r\n INFO [2015-01-20 13:12:08,103] ({Thread-25} Logging.scala[logInfo]:59) - SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.0\r\n INFO [2015-01-20 13:12:08,774] ({sparkDriver-akka.actor.default-dispatcher-2} Logging.scala[logInfo]:59) - Connected to Spark cluster with app ID app-20150120131208-0001\r\n INFO [2015-01-20 13:12:08,778] ({sparkDriver-akka.actor.default-dispatcher-2} Logging.scala[logInfo]:59) - Executor added: app-20150120131208-0001/0 on worker-20150120125923-192.168.1.3-50327 (192.168.1.3:50327) with 2 cores\r\n INFO [2015-01-20 13:12:08,781] ({sparkDriver-akka.actor.default-dispatcher-2} Logging.scala[logInfo]:59) - Granted executor ID app-20150120131208-0001/0 on hostPort 192.168.1.3:50327 with 2 cores, 512.0 MB RAM\r\n INFO [2015-01-20 13:12:08,782] ({sparkDriver-akka.actor.default-dispatcher-2} Logging.scala[logInfo]:59) - Executor added: app-20150120131208-0001/1 on worker-20150120125930-192.168.1.3-50329 (192.168.1.3:50329) with 2 cores\r\n INFO [2015-01-20 13:12:08,783] ({sparkDriver-akka.actor.default-dispatcher-2} Logging.scala[logInfo]:59) - Granted executor ID app-20150120131208-0001/1 on hostPort 192.168.1.3:50329 with 2 cores, 512.0 MB RAM\r\n INFO [2015-01-20 13:12:08,804] ({sparkDriver-akka.actor.default-dispatcher-2} Logging.scala[logInfo]:59) - Executor updated: app-20150120131208-0001/0 is now LOADING\r\n INFO [2015-01-20 13:12:08,806] ({sparkDriver-akka.actor.default-dispatcher-2} Logging.scala[logInfo]:59) - Executor updated: app-20150120131208-0001/1 is now LOADING\r\n INFO [2015-01-20 13:12:10,988] ({sparkDriver-akka.actor.default-dispatcher-5} Logging.scala[logInfo]:59) - Executor updated: app-20150120131208-0001/0 is now RUNNING\r\n INFO [2015-01-20 13:12:11,153] ({sparkDriver-akka.actor.default-dispatcher-5} Logging.scala[logInfo]:59) - Executor updated: app-20150120131208-0001/1 is now RUNNING\r\n INFO [2015-01-20 13:12:15,957] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:16,459] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:16,960] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:17,461] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:17,858] ({pool-2-thread-2} Paragraph.java[jobRun]:182) - RUN : val bankText = sc.textFile(\"/Users/tnist/zeppelin_test_data/bank/bank-full.csv\")\r\n\r\ncase class Bank(age:Integer, job:String, marital : String, education : String, balance : Integer)\r\n\r\nval bank = bankText.map(s=>s.split(\";\")).filter(s=>s(0)!=\"\\\"age\\\"\").map(\r\n    s=>Bank(s(0).toInt,\r\n            s(1).replaceAll(\"\\\"\", \"\"),\r\n            s(2).replaceAll(\"\\\"\", \"\"),\r\n            s(3).replaceAll(\"\\\"\", \"\"),\r\n            s(5).replaceAll(\"\\\"\", \"\").toInt\r\n        )\r\n)\r\n\r\nbank.registerTempTable(\"bank\")\r\n INFO [2015-01-20 13:12:17,964] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:17,977] ({sparkDriver-akka.actor.default-dispatcher-14} Logging.scala[logInfo]:59) - Registered executor: Actor[akka.tcp://sparkExecutor@192.168.1.3:50420/user/Executor#-425896573] with ID 0\r\n INFO [2015-01-20 13:12:18,465] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:18,639] ({sparkDriver-akka.actor.default-dispatcher-17} Logging.scala[logInfo]:59) - Registered executor: Actor[akka.tcp://sparkExecutor@192.168.1.3:50426/user/Executor#-2008077853] with ID 1\r\n INFO [2015-01-20 13:12:18,966] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:18,977] ({pool-2-thread-2} Logging.scala[logInfo]:59) - ensureFreeSpace(159118) called with curMem=0, maxMem=515553361\r\n INFO [2015-01-20 13:12:18,986] ({pool-2-thread-2} Logging.scala[logInfo]:59) - Block broadcast_0 stored as values in memory (estimated size 155.4 KB, free 491.5 MB)\r\n INFO [2015-01-20 13:12:19,174] ({pool-2-thread-2} Logging.scala[logInfo]:59) - ensureFreeSpace(12633) called with curMem=159118, maxMem=515553361\r\n INFO [2015-01-20 13:12:19,179] ({pool-2-thread-2} Logging.scala[logInfo]:59) - Block broadcast_0_piece0 stored as bytes in memory (estimated size 12.3 KB, free 491.5 MB)\r\n INFO [2015-01-20 13:12:19,184] ({sparkDriver-akka.actor.default-dispatcher-15} Logging.scala[logInfo]:59) - Added broadcast_0_piece0 in memory on 192.168.1.3:50414 (size: 12.3 KB, free: 491.7 MB)\r\n INFO [2015-01-20 13:12:19,188] ({pool-2-thread-2} Logging.scala[logInfo]:59) - Updated info of block broadcast_0_piece0\r\n INFO [2015-01-20 13:12:19,467] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:19,968] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:20,469] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:20,971] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:21,473] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:21,974] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:22,476] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:22,978] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:23,480] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:23,980] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:24,484] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:24,985] ({Thread-25} NotebookServer.java[broadcast]:204) - SEND >> PROGRESS\r\n INFO [2015-01-20 13:12:25,006] ({pool-2-thread-2} NotebookServer.java[afterStatusChange]:456) - Job 20150120-124755_719929768 is finished\r\n INFO [2015-01-20 13:12:25,006] ({pool-2-thread-2} Note.java[persist]:262) - Persist note 2AE6RR7YA into /Users/tnist/projects/radtech.io/zeppelin/notebook/2AE6RR7YA/note.json\r\n INFO [2015-01-20 13:12:25,015] ({pool-2-thread-2} NotebookServer.java[broadcast]:204) - SEND >> NOTE\r\n INFO [2015-01-20 13:12:25,018] ({pool-2-thread-2} SchedulerFactory.java[jobFinished]:99) - Job paragraph_1421776075682_-56845921 finished by scheduler com.nflabs.zeppelin.spark.SparkInterpreter1551788863\r\nERROR [2015-01-20 13:12:51,607] ({sparkDriver-akka.actor.default-dispatcher-17} Slf4jLogger.scala[apply$mcV$sp]:66) - org.apache.spark.storage.BlockManagerId; local class incompatible: stream classdesc serialVersionUID = -7366074099953117729, local class serialVersionUID = 1677335532749418220\r\njava.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; local class incompatible: stream classdesc serialVersionUID = -7366074099953117729, local class serialVersionUID = 1677335532749418220\r\nat java.io.ObjectStreamClass.initNonProxy(ObjectStreamClass.java:621)\r\nat java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1623)\r\nat java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1518)\r\nat java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1774)\r\nat java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)\r\nat java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:1993)\r\nat java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1918)\r\nat java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1801)\r\nat java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1351)\r\nat java.io.ObjectInputStream.readObject(ObjectInputStream.java:371)\r\nat akka.serialization.JavaSerializer$$anonfun$1.apply(Serializer.scala:136)\r\nat scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)\r\nat akka.serialization.JavaSerializer.fromBinary(Serializer.scala:136)\r\nat akka.serialization.Serialization$$anonfun$deserialize$1.apply(Serialization.scala:104)\r\nat scala.util.Try$.apply(Try.scala:161)\r\nat akka.serialization.Serialization.deserialize(Serialization.scala:98)\r\nat akka.remote.MessageSerializer$.deserialize(MessageSerializer.scala:23)\r\nat akka.remote.DefaultMessageDispatcher.payload$lzycompute$1(Endpoint.scala:55)\r\nat akka.remote.DefaultMessageDispatcher.payload$1(Endpoint.scala:55)\r\nat akka.remote.DefaultMessageDispatcher.dispatch(Endpoint.scala:73)\r\nat akka.remote.EndpointReader$$anonfun$receive$2.applyOrElse(Endpoint.scala:764)\r\nat akka.actor.ActorCell.receiveMessage(ActorCell.scala:498)\r\nat akka.actor.ActorCell.invoke(ActorCell.scala:456)\r\nat akka.dispatch.Mailbox.processMailbox(Mailbox.scala:237)\r\nat akka.dispatch.Mailbox.run(Mailbox.scala:219)\r\nat akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)\r\nat scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)\r\nat scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)\r\nat scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)\r\nat scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)\r\nERROR [2015-01-20 13:12:51,990] ({sparkDriver-akka.actor.default-dispatcher-14} Slf4jLogger.scala[apply$mcV$sp]:66) - org.apache.spark.storage.BlockManagerId; local class incompatible: stream classdesc serialVersionUID = -7366074099953117729, local class serialVersionUID = 1677335532749418220\r\njava.io.InvalidClassException: org.apache.spark.storage.BlockManagerId; local class incompatible: stream classdesc serialVersionUID = -7366074099953117729, local class serialVersionUID = 1677335532749418220\r\n...\r\n```\r\nFrom that point on the system is pretty much useless until restarted.  Seems like I’m missing something in the configuration here that needs to be set for this to work but it is not obvious to me what it is.\r\n\r\nAs I read through this again it seems like I have two different versions of Spark coming into play here, the one Zeppelin is using and the one the cluster is running, this is the only way I can see this being a problem.  I did the build as shown above, am I missing something else?  I see in the $ZEPPELIN_HOME/interpreter/spark directory that all the spark artifacts are of version 1.1.1 so that seems right; somewhere else I should be looking?\r\n\r\nAny guidance on configuration for Zeppelin in Spark Standalone Cluster would be appreciated or is this a bigger issue?  TIA for the assistance.  \r\n\r\n-Todd"},"comment":{"url":"https://api.github.com/repos/NFLabs/zeppelin/issues/comments/71234227","html_url":"https://github.com/NFLabs/zeppelin/issues/292#issuecomment-71234227","issue_url":"https://api.github.com/repos/NFLabs/zeppelin/issues/292","id":71234227,"user":{"login":"tsindot","id":4061201,"avatar_url":"https://avatars.githubusercontent.com/u/4061201?v=3","gravatar_id":"","url":"https://api.github.com/users/tsindot","html_url":"https://github.com/tsindot","followers_url":"https://api.github.com/users/tsindot/followers","following_url":"https://api.github.com/users/tsindot/following{/other_user}","gists_url":"https://api.github.com/users/tsindot/gists{/gist_id}","starred_url":"https://api.github.com/users/tsindot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tsindot/subscriptions","organizations_url":"https://api.github.com/users/tsindot/orgs","repos_url":"https://api.github.com/users/tsindot/repos","events_url":"https://api.github.com/users/tsindot/events{/privacy}","received_events_url":"https://api.github.com/users/tsindot/received_events","type":"User","site_admin":false},"created_at":"2015-01-23T17:55:19Z","updated_at":"2015-01-23T17:55:19Z","body":"After doing some additional testing yesterday I found the problem, it was in fact self inflicted :(  I had upgraded to spark-1.1.1-hadoop2.4 to test it quickly.  Usually I create a link to symbolic link, ```ln -s /usr/local/spark-1.1.1-hadoop2.4 /usr/local/spark```.  I did not do that but had an ```$SPARK_HOME``` set to ```/usr/local/spark``` which was linked to ```spark-1.1.0-hadoop2.4``` thus the error.\r\n\r\nI believe it is ok to close this one as I do not see it being related in anyway to #272. \r\n\r\nThanks for the help and sorry for the noise.\r\n\r\n- Todd"}}