{"action":"created","issue":{"url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/138","labels_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/138/labels{/name}","comments_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/138/comments","events_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/138/events","html_url":"https://github.com/spark-jobserver/spark-jobserver/issues/138","id":71977890,"number":138,"title":"server crashed using mllib (java.lang.NoClassDefFoundError)","user":{"login":"villafana1981","id":9038313,"avatar_url":"https://avatars.githubusercontent.com/u/9038313?v=3","gravatar_id":"","url":"https://api.github.com/users/villafana1981","html_url":"https://github.com/villafana1981","followers_url":"https://api.github.com/users/villafana1981/followers","following_url":"https://api.github.com/users/villafana1981/following{/other_user}","gists_url":"https://api.github.com/users/villafana1981/gists{/gist_id}","starred_url":"https://api.github.com/users/villafana1981/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/villafana1981/subscriptions","organizations_url":"https://api.github.com/users/villafana1981/orgs","repos_url":"https://api.github.com/users/villafana1981/repos","events_url":"https://api.github.com/users/villafana1981/events{/privacy}","received_events_url":"https://api.github.com/users/villafana1981/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-04-29T20:16:49Z","updated_at":"2015-05-20T16:03:51Z","closed_at":null,"body":"hi,\r\nwe have the spark job server run together with the standalone spark cluster on one machine, \r\nwe tried to run jobs that uses mllib, but we got a error(in the server).\r\n\r\njob-server[ERROR] Uncaught error from thread [JobServer-akka.actor.default-dispatcher-3] shutting down JVM since 'akka.jvm-exit-on-fatal-error' is enabled for ActorSystem[JobServer]\r\njob-server[ERROR] java.lang.NoClassDefFoundError: org/apache/spark/mllib/stat/Statistics$\r\njob-server[ERROR] \tat SparkCorrelation$.getCorrelation(SparkCorrelation.scala:50)\r\njob-server[ERROR] \tat SparkCorrelation$.runJob(SparkCorrelation.scala:28)\r\njob-server[ERROR] \tat SparkCorrelation$.runJob(SparkCorrelation.scala:11)\r\njob-server[ERROR] \tat spark.jobserver.JobManagerActor$$anonfun$spark$jobserver$JobManagerActor$$getJobFuture$4.apply(JobManagerActor.scala:234)\r\n\r\n\r\ndo you have any idea about it?\r\n-using spark 1.2 and jobserver 0.5.0\r\n\r\nthanks"},"comment":{"url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/comments/103940106","html_url":"https://github.com/spark-jobserver/spark-jobserver/issues/138#issuecomment-103940106","issue_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/138","id":103940106,"user":{"login":"villafana1981","id":9038313,"avatar_url":"https://avatars.githubusercontent.com/u/9038313?v=3","gravatar_id":"","url":"https://api.github.com/users/villafana1981","html_url":"https://github.com/villafana1981","followers_url":"https://api.github.com/users/villafana1981/followers","following_url":"https://api.github.com/users/villafana1981/following{/other_user}","gists_url":"https://api.github.com/users/villafana1981/gists{/gist_id}","starred_url":"https://api.github.com/users/villafana1981/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/villafana1981/subscriptions","organizations_url":"https://api.github.com/users/villafana1981/orgs","repos_url":"https://api.github.com/users/villafana1981/repos","events_url":"https://api.github.com/users/villafana1981/events{/privacy}","received_events_url":"https://api.github.com/users/villafana1981/received_events","type":"User","site_admin":false},"created_at":"2015-05-20T16:03:51Z","updated_at":"2015-05-20T16:03:51Z","body":"Spark job server works fine (running the test), but when i use mllib it crashes.\r\ni run the jobserver using :\r\nsbt reStart\r\n\r\nI create the fat jar for the job and the job works correctly (the fat jar its big)\r\n\r\nis there another way to correct this situation?\r\n\r\ni running job server alone.\r\nstart_server,sh? "}}