{"action":"created","issue":{"url":"https://api.github.com/repos/gorillalabs/sparkling-getting-started/issues/3","labels_url":"https://api.github.com/repos/gorillalabs/sparkling-getting-started/issues/3/labels{/name}","comments_url":"https://api.github.com/repos/gorillalabs/sparkling-getting-started/issues/3/comments","events_url":"https://api.github.com/repos/gorillalabs/sparkling-getting-started/issues/3/events","html_url":"https://github.com/gorillalabs/sparkling-getting-started/issues/3","id":118057978,"number":3,"title":"how to submit tf-idf example to cluster","user":{"login":"BenMacKenzie","id":1110151,"avatar_url":"https://avatars.githubusercontent.com/u/1110151?v=3","gravatar_id":"","url":"https://api.github.com/users/BenMacKenzie","html_url":"https://github.com/BenMacKenzie","followers_url":"https://api.github.com/users/BenMacKenzie/followers","following_url":"https://api.github.com/users/BenMacKenzie/following{/other_user}","gists_url":"https://api.github.com/users/BenMacKenzie/gists{/gist_id}","starred_url":"https://api.github.com/users/BenMacKenzie/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/BenMacKenzie/subscriptions","organizations_url":"https://api.github.com/users/BenMacKenzie/orgs","repos_url":"https://api.github.com/users/BenMacKenzie/repos","events_url":"https://api.github.com/users/BenMacKenzie/events{/privacy}","received_events_url":"https://api.github.com/users/BenMacKenzie/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-11-20T14:59:48Z","updated_at":"2015-11-20T19:41:09Z","closed_at":null,"body":"this doesn't work:\r\n\r\nedit tf_idf/core.clj and delete the line:\r\n(conf/master \"local\")\r\n\r\n\r\n> lein uberjar\r\n> spark-submit --class tf_idf.core --master yarn target/sparkling-getting-started-1.0.0-SNAPSHOT-standalone.jar "},"comment":{"url":"https://api.github.com/repos/gorillalabs/sparkling-getting-started/issues/comments/158505044","html_url":"https://github.com/gorillalabs/sparkling-getting-started/issues/3#issuecomment-158505044","issue_url":"https://api.github.com/repos/gorillalabs/sparkling-getting-started/issues/3","id":158505044,"user":{"login":"chrisbetz","id":1052643,"avatar_url":"https://avatars.githubusercontent.com/u/1052643?v=3","gravatar_id":"","url":"https://api.github.com/users/chrisbetz","html_url":"https://github.com/chrisbetz","followers_url":"https://api.github.com/users/chrisbetz/followers","following_url":"https://api.github.com/users/chrisbetz/following{/other_user}","gists_url":"https://api.github.com/users/chrisbetz/gists{/gist_id}","starred_url":"https://api.github.com/users/chrisbetz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chrisbetz/subscriptions","organizations_url":"https://api.github.com/users/chrisbetz/orgs","repos_url":"https://api.github.com/users/chrisbetz/repos","events_url":"https://api.github.com/users/chrisbetz/events{/privacy}","received_events_url":"https://api.github.com/users/chrisbetz/received_events","type":"User","site_admin":false},"created_at":"2015-11-20T19:41:09Z","updated_at":"2015-11-20T19:41:09Z","body":"Great. Love those bugs, too.\n\nWould love to hear from you again with a successful (sparkling) project, or otherwise I will try to help you again :)\n\nHappy hacking!\n\nChris\n\n> Am 20.11.2015 um 20:38 schrieb BenMacKenzie <notifications@github.com>:\n> \n> Funny…i had tried that (not calling _$main) but it didn’t seem to work, so i just started from scratch and it worked fine!\n> \n> Thanks for your help! Look forward to using sparkling.\n> \n> Ben\n> \n> From: chris_betz <notifications@github.com<mailto:notifications@github.com>>\n> Reply-To: gorillalabs/sparkling-getting-started <reply@reply.github.com<mailto:reply@reply.github.com>>\n> Date: Friday, November 20, 2015 at 2:24 PM\n> To: gorillalabs/sparkling-getting-started <sparkling-getting-started@noreply.github.com<mailto:sparkling-getting-started@noreply.github.com>>\n> Cc: \"MacKenzie, Ben\" <ben.mackenzie@thinkbiganalytics.com<mailto:ben.mackenzie@thinkbiganalytics.com>>\n> Subject: Re: [sparkling-getting-started] how to submit tf-idf example to cluster (#3)\n> \n> Ah, now I get it :)\n> \n> no problem, I’ve always pushed my stuff to yarn, so I know it’s doable.\n> \n> I do not have my cluster at hand right now, but I think that’s a pretty easy one:\n> \n> You must call the main-class directly, not the -$main-\"sub\"class\n> \n> (as was in the mail I got from github, but not visible in the github web UI, I’m really puzzled now).\n> \n> \n> So\n> \n> lein uberjar\n> spark-submit --class tf_idf.core --master yarn target/sparkling-getting-started-1.0.0-SNAPSHOT-standalone.jar\n> \n> should do the trick instead of\n> \n> … —class tf_idf.core$_main …\n> \n> Hope this helps, and if it does, you may close the ticket. Otherwise I’d have to try on monday morning.\n> \n> Cheers,\n> \n> Chris\n> \n> \n> > Am 20.11.2015 um 20:08 schrieb BenMacKenzie <notifications@github.com<mailto:notifications@github.com>>:\n> >\n> > Hi Chris,\n> >\n> > I just want to submit the sparkling example tf-idf to an actual cluster. The cluster in question is just standard AWS EMR with Spark. I’ve been able to do it with Flambo but not sparkling. I believe the problem relates to AOT compiling. To you have an example project file for using an actual cluster?\n> >\n> > Thanks!\n> >\n> >\n> >\n> >\n> >\n> > From: chris_betz <notifications@github.com<mailto:notifications@github.com><mailto:notifications@github.com>>\n> > Reply-To: gorillalabs/sparkling-getting-started <reply@reply.github.com<mailto:reply@reply.github.com><mailto:reply@reply.github.com>>\n> > Date: Friday, November 20, 2015 at 2:04 PM\n> > To: gorillalabs/sparkling-getting-started <sparkling-getting-started@noreply.github.com<mailto:sparkling-getting-started@noreply.github.com><mailto:sparkling-getting-started@noreply.github.com>>\n> > Cc: \"MacKenzie, Ben\" <ben.mackenzie@thinkbiganalytics.com<mailto:ben.mackenzie@thinkbiganalytics.com><mailto:ben.mackenzie@thinkbiganalytics.com>>\n> > Subject: Re: [sparkling-getting-started] how to submit tf-idf example to cluster (#3)\n> >\n> >\n> > Hi,\n> >\n> > sorry, I just don't get what's the thing and what's not working. To avoid guesswork, could you please\n> > a) tell me what you want to achieve and\n> > b) attach an error message or a little more details?\n> >\n> > Thanks,\n> >\n> > Chris\n> >\n> > —\n> > Reply to this email directly or view it on GitHub<https://github.com/gorillalabs/sparkling-getting-started/issues/3#issuecomment-158495957>.\n> > —\n> > Reply to this email directly or view it on GitHub <https://github.com/gorillalabs/sparkling-getting-started/issues/3#issuecomment-158496830>.\n> >\n> \n> \n> —\n> Reply to this email directly or view it on GitHub<https://github.com/gorillalabs/sparkling-getting-started/issues/3#issuecomment-158500693>.\n> —\n> Reply to this email directly or view it on GitHub <https://github.com/gorillalabs/sparkling-getting-started/issues/3#issuecomment-158504487>.\n> \n\n"}}