{"action":"created","issue":{"url":"https://api.github.com/repos/yieldbot/flambo/issues/78","labels_url":"https://api.github.com/repos/yieldbot/flambo/issues/78/labels{/name}","comments_url":"https://api.github.com/repos/yieldbot/flambo/issues/78/comments","events_url":"https://api.github.com/repos/yieldbot/flambo/issues/78/events","html_url":"https://github.com/yieldbot/flambo/issues/78","id":97243093,"number":78,"title":"Flambo Stand-Alone Applications Broken","user":{"login":"senor-hadoop","id":7775472,"avatar_url":"https://avatars.githubusercontent.com/u/7775472?v=3","gravatar_id":"","url":"https://api.github.com/users/senor-hadoop","html_url":"https://github.com/senor-hadoop","followers_url":"https://api.github.com/users/senor-hadoop/followers","following_url":"https://api.github.com/users/senor-hadoop/following{/other_user}","gists_url":"https://api.github.com/users/senor-hadoop/gists{/gist_id}","starred_url":"https://api.github.com/users/senor-hadoop/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/senor-hadoop/subscriptions","organizations_url":"https://api.github.com/users/senor-hadoop/orgs","repos_url":"https://api.github.com/users/senor-hadoop/repos","events_url":"https://api.github.com/users/senor-hadoop/events{/privacy}","received_events_url":"https://api.github.com/users/senor-hadoop/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":12,"created_at":"2015-07-25T17:55:40Z","updated_at":"2015-07-26T00:24:26Z","closed_at":null,"body":"Flambo applications run in stand-alone mode, whether in YARN(--master yarn-cluster, --master yarn-client), stand-alone cluster (--master spark://...) or locally (--master local[*]), all fail with the nearly the same stacktrace found below. Essentially, nothing with 'spark-submit' works. For those wanting to try YARN mode, an out-of-the-box YARN cluster can be found within the Hortonworks sandbox (a virtual machine): http://hortonworks.com/products/hortonworks-sandbox/\r\n\r\nSLF4J: Class path contains multiple SLF4J bindings.\r\nSLF4J: Found binding in [jar:file:/hadoop/yarn/local/usercache/snunez/filecache/10/spark-assembly-1.2.1.2.2.4.2-2-hadoop2.6.0.2.2.4.2-2.jar!/org/slf4j/impl/StaticLoggerBinder.class]\r\nSLF4J: Found binding in [jar:file:/usr/hdp/2.2.4.2-2/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]\r\nSLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.\r\nSLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]\r\n15/07/25 03:05:38 INFO yarn.ApplicationMaster: Registered signal handlers for [TERM, HUP, INT]\r\n15/07/25 03:05:39 INFO yarn.ApplicationMaster: ApplicationAttemptId: appattempt_1437781501203_0001_000001\r\n15/07/25 03:05:40 INFO spark.SecurityManager: Changing view acls to: yarn,snunez\r\n15/07/25 03:05:40 INFO spark.SecurityManager: Changing modify acls to: yarn,snunez\r\n15/07/25 03:05:40 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, snunez); users with modify permissions: Set(yarn, snunez)\r\n15/07/25 03:05:40 INFO yarn.ApplicationMaster: Starting the user JAR in a separate Thread\r\n15/07/25 03:05:40 INFO yarn.ApplicationMaster: Waiting for spark context initialization\r\n15/07/25 03:05:40 INFO yarn.ApplicationMaster: Waiting for spark context initialization ... 0\r\nException in thread \"Driver\" java.lang.ExceptionInInitializerError\r\n\tat java.lang.Class.forName0(Native Method)\r\n\tat java.lang.Class.forName(Class.java:278)\r\n\tat clojure.lang.RT.loadClassForName(RT.java:2093)\r\n\tat clojure.lang.RT.load(RT.java:430)\r\n\tat clojure.lang.RT.load(RT.java:411)\r\n\tat clojure.core$load$fn__5066.invoke(core.clj:5641)\r\n\tat clojure.core$load.doInvoke(core.clj:5640)\r\n\tat clojure.lang.RestFn.invoke(RestFn.java:408)\r\n\tat clojure.core$load_one.invoke(core.clj:5446)\r\n\tat clojure.core$load_lib$fn__5015.invoke(core.clj:5486)\r\n\tat clojure.core$load_lib.doInvoke(core.clj:5485)\r\n\tat clojure.lang.RestFn.applyTo(RestFn.java:142)\r\n\tat clojure.core$apply.invoke(core.clj:626)\r\n\tat clojure.core$load_libs.doInvoke(core.clj:5524)\r\n\tat clojure.lang.RestFn.applyTo(RestFn.java:137)\r\n\tat clojure.core$apply.invoke(core.clj:626)\r\n\tat clojure.core$require.doInvoke(core.clj:5607)\r\n\tat clojure.lang.RestFn.invoke(RestFn.java:551)\r\n\tat flambo.api$loading__4958__auto__.invoke(api.clj:12)\r\n\tat flambo.api__init.load(Unknown Source)\r\n\tat flambo.api__init.<clinit>(Unknown Source)\r\n\tat java.lang.Class.forName0(Native Method)\r\n\tat java.lang.Class.forName(Class.java:278)\r\n\tat clojure.lang.RT.loadClassForName(RT.java:2093)\r\n\tat clojure.lang.RT.load(RT.java:430)\r\n\tat clojure.lang.RT.load(RT.java:411)\r\n\tat clojure.core$load$fn__5066.invoke(core.clj:5641)\r\n\tat clojure.core$load.doInvoke(core.clj:5640)\r\n\tat clojure.lang.RestFn.invoke(RestFn.java:408)\r\n\tat clojure.core$load_one.invoke(core.clj:5446)\r\n\tat clojure.core$load_lib$fn__5015.invoke(core.clj:5486)\r\n\tat clojure.core$load_lib.doInvoke(core.clj:5485)\r\n\tat clojure.lang.RestFn.applyTo(RestFn.java:142)\r\n\tat clojure.core$apply.invoke(core.clj:626)\r\n\tat clojure.core$load_libs.doInvoke(core.clj:5524)\r\n\tat clojure.lang.RestFn.applyTo(RestFn.java:137)\r\n\tat clojure.core$apply.invoke(core.clj:626)\r\n\tat clojure.core$require.doInvoke(core.clj:5607)\r\n\tat clojure.lang.RestFn.invoke(RestFn.java:512)\r\n\tat ict.core$loading__4958__auto__.invoke(core.clj:1)\r\n\tat ict.core__init.load(Unknown Source)\r\n\tat ict.core__init.<clinit>(Unknown Source)\r\n\tat java.lang.Class.forName0(Native Method)\r\n\tat java.lang.Class.forName(Class.java:278)\r\n\tat clojure.lang.RT.loadClassForName(RT.java:2093)\r\n\tat clojure.lang.RT.load(RT.java:430)\r\n\tat clojure.lang.RT.load(RT.java:411)\r\n\tat clojure.core$load$fn__5066.invoke(core.clj:5641)\r\n\tat clojure.core$load.doInvoke(core.clj:5640)\r\n\tat clojure.lang.RestFn.invoke(RestFn.java:408)\r\n\tat clojure.lang.Var.invoke(Var.java:379)\r\n\tat ict.core.<clinit>(Unknown Source)\r\n\tat sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)\r\n\tat sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)\r\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\r\n\tat java.lang.reflect.Method.invoke(Method.java:606)\r\n\tat org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:445)\r\nCaused by: java.lang.ClassNotFoundException: flambo.WriterOutputStream\r\n\tat java.net.URLClassLoader$1.run(URLClassLoader.java:366)\r\n\tat java.net.URLClassLoader$1.run(URLClassLoader.java:355)\r\n\tat java.security.AccessController.doPrivileged(Native Method)\r\n\tat java.net.URLClassLoader.findClass(URLClassLoader.java:354)\r\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:425)\r\n\tat sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)\r\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:358)\r\n\tat java.lang.Class.forName0(Native Method)\r\n\tat java.lang.Class.forName(Class.java:195)\r\n\tat flambo.utils$loading__4958__auto__.invoke(utils.clj:1)\r\n\tat flambo.utils__init.load(Unknown Source)\r\n\tat flambo.utils__init.<clinit>(Unknown Source)\r\n\t... 57 more\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/yieldbot/flambo/issues/comments/124920432","html_url":"https://github.com/yieldbot/flambo/issues/78#issuecomment-124920432","issue_url":"https://api.github.com/repos/yieldbot/flambo/issues/78","id":124920432,"user":{"login":"sorenmacbeth","id":130043,"avatar_url":"https://avatars.githubusercontent.com/u/130043?v=3","gravatar_id":"","url":"https://api.github.com/users/sorenmacbeth","html_url":"https://github.com/sorenmacbeth","followers_url":"https://api.github.com/users/sorenmacbeth/followers","following_url":"https://api.github.com/users/sorenmacbeth/following{/other_user}","gists_url":"https://api.github.com/users/sorenmacbeth/gists{/gist_id}","starred_url":"https://api.github.com/users/sorenmacbeth/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sorenmacbeth/subscriptions","organizations_url":"https://api.github.com/users/sorenmacbeth/orgs","repos_url":"https://api.github.com/users/sorenmacbeth/repos","events_url":"https://api.github.com/users/sorenmacbeth/events{/privacy}","received_events_url":"https://api.github.com/users/sorenmacbeth/received_events","type":"User","site_admin":false},"created_at":"2015-07-26T00:24:26Z","updated_at":"2015-07-26T00:24:26Z","body":"fwiw, I am unable to replicate the ever-increasing uberjar issue using a checkouts dir as described in the link I provided above. "}}