{"action":"created","issue":{"url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/57","labels_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/57/labels{/name}","comments_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/57/comments","events_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/57/events","html_url":"https://github.com/spark-jobserver/spark-jobserver/issues/57","id":55920784,"number":57,"title":"Spark-jobserver running over Standalone HA cluster","user":{"login":"zujorv","id":4068716,"avatar_url":"https://avatars.githubusercontent.com/u/4068716?v=3","gravatar_id":"","url":"https://api.github.com/users/zujorv","html_url":"https://github.com/zujorv","followers_url":"https://api.github.com/users/zujorv/followers","following_url":"https://api.github.com/users/zujorv/following{/other_user}","gists_url":"https://api.github.com/users/zujorv/gists{/gist_id}","starred_url":"https://api.github.com/users/zujorv/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zujorv/subscriptions","organizations_url":"https://api.github.com/users/zujorv/orgs","repos_url":"https://api.github.com/users/zujorv/repos","events_url":"https://api.github.com/users/zujorv/events{/privacy}","received_events_url":"https://api.github.com/users/zujorv/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":14,"created_at":"2015-01-29T16:22:08Z","updated_at":"2015-09-14T23:01:54Z","closed_at":"2015-09-02T15:31:31Z","body":"Hi, \r\n\r\nI have configured a Spark's Standalone cluster, using Zookeeper to provide HA. That is, I have 2 Spark master nodes connected to a Zookeeper quorum, one of them is ACTIVE and the other one is in STANDBY mode. So, if Node1 (active node) goes down, Node2 (standby node) becomes the active node. When Node 1 recovers, detects there is another active node (through Zookeeper) and stays in standby mode.\r\n\r\nI am trying to connect Spark-Jobserver to this configuration, but I can't set \"spark.master\" property in conf file to point the whole cluster (that is spark.master = \"spark://node1:7077,node2:7077\")\r\nIf I run this configuration, server_start fails:\r\nERROR ka.actor.OneForOneStrategy [] [akka://JobServer/user/IO-HTTP/host-connector-0] - Il\r\nlegal URI host, unexpected character ':' at position 5: node1:7077,node2\r\nakka.actor.ActorInitializationException: exception during creation\r\n        at akka.actor.ActorInitializationException$.apply(Actor.scala:164)\r\nCaused by: spray.http.IllegalUriException: Illegal URI host, unexpected character ':' at position 5: node1:7077,node2\r\n        at spray.http.Uri$.fail(Uri.scala:775)\r\n\r\nI have also tried to set it without spark's master port number (that is spark.master = \"spark://node1,node2\"), but I get:\r\nakka.actor.ActorInitializationException: exception during creation\r\n        at akka.actor.ActorInitializationException$.apply(Actor.scala:164)\r\nCaused by: java.lang.RuntimeException: Could not parse Master URL: 'node1,node2'\r\n        at spark.jobserver.SparkWebUiActor.getSparkHostName(SparkWebUiActor.scala:86)\r\n\r\n\r\nIs there any way I can do that?\r\n\r\nI have tried to set just one of both masters (that is spark.master = \"spark://node1:7077\") and it works great, but if Node1 goes down, then spark-jobserver can't reassign itself to Node2 (the new active master)\r\n\r\nThanks in advance"},"comment":{"url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/comments/140228997","html_url":"https://github.com/spark-jobserver/spark-jobserver/issues/57#issuecomment-140228997","issue_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/57","id":140228997,"user":{"login":"velvia","id":1062875,"avatar_url":"https://avatars.githubusercontent.com/u/1062875?v=3","gravatar_id":"","url":"https://api.github.com/users/velvia","html_url":"https://github.com/velvia","followers_url":"https://api.github.com/users/velvia/followers","following_url":"https://api.github.com/users/velvia/following{/other_user}","gists_url":"https://api.github.com/users/velvia/gists{/gist_id}","starred_url":"https://api.github.com/users/velvia/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/velvia/subscriptions","organizations_url":"https://api.github.com/users/velvia/orgs","repos_url":"https://api.github.com/users/velvia/repos","events_url":"https://api.github.com/users/velvia/events{/privacy}","received_events_url":"https://api.github.com/users/velvia/received_events","type":"User","site_admin":false},"created_at":"2015-09-14T23:01:54Z","updated_at":"2015-09-14T23:01:54Z","body":"zseedg, could you describe in more detail what you're looking for?\n\nOn Tue, Sep 8, 2015 at 10:56 PM, zseedg <notifications@github.com> wrote:\n\n> Hi, i met the same issue. Is it fixed in the version 0.5.2?\n>\n> —\n> Reply to this email directly or view it on GitHub\n> <https://github.com/spark-jobserver/spark-jobserver/issues/57#issuecomment-138793145>\n> .\n>\n\n\n\n-- \nIf you are free, you need to free somebody else.\nIf you have some power, then your job is to empower somebody else.\n   --- Toni Morrison\n"}}