{"action":"created","issue":{"url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/158","labels_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/158/labels{/name}","comments_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/158/comments","events_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/158/events","html_url":"https://github.com/spark-jobserver/spark-jobserver/issues/158","id":81489024,"number":158,"title":"Multiple spark-jobserver's with the same spark cluster","user":{"login":"kavuri","id":2538487,"avatar_url":"https://avatars.githubusercontent.com/u/2538487?v=3","gravatar_id":"","url":"https://api.github.com/users/kavuri","html_url":"https://github.com/kavuri","followers_url":"https://api.github.com/users/kavuri/followers","following_url":"https://api.github.com/users/kavuri/following{/other_user}","gists_url":"https://api.github.com/users/kavuri/gists{/gist_id}","starred_url":"https://api.github.com/users/kavuri/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kavuri/subscriptions","organizations_url":"https://api.github.com/users/kavuri/orgs","repos_url":"https://api.github.com/users/kavuri/repos","events_url":"https://api.github.com/users/kavuri/events{/privacy}","received_events_url":"https://api.github.com/users/kavuri/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-05-27T15:13:51Z","updated_at":"2015-05-28T07:17:09Z","closed_at":null,"body":"I would like to run multiple spark-jobserver behind a load balancer (to enable high availability), but with the same spark cluster. Each of the jobserver's will have its own context created (with the REST API call). Each of the incoming trigger for the algorithm can go to either of the jobservers. I have setup a spark cluster of 5 nodes (1 Master and 4 workers). Is this configuration something that is possible? What will happen if the two jobservers get the requests at the same time? Will the requests be queued at the spark cluster?\r\nAny inputs are appreciated"},"comment":{"url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/comments/106205762","html_url":"https://github.com/spark-jobserver/spark-jobserver/issues/158#issuecomment-106205762","issue_url":"https://api.github.com/repos/spark-jobserver/spark-jobserver/issues/158","id":106205762,"user":{"login":"velvia","id":1062875,"avatar_url":"https://avatars.githubusercontent.com/u/1062875?v=3","gravatar_id":"","url":"https://api.github.com/users/velvia","html_url":"https://github.com/velvia","followers_url":"https://api.github.com/users/velvia/followers","following_url":"https://api.github.com/users/velvia/following{/other_user}","gists_url":"https://api.github.com/users/velvia/gists{/gist_id}","starred_url":"https://api.github.com/users/velvia/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/velvia/subscriptions","organizations_url":"https://api.github.com/users/velvia/orgs","repos_url":"https://api.github.com/users/velvia/repos","events_url":"https://api.github.com/users/velvia/events{/privacy}","received_events_url":"https://api.github.com/users/velvia/received_events","type":"User","site_admin":false},"created_at":"2015-05-28T07:17:09Z","updated_at":"2015-05-28T07:17:09Z","body":"@kavuri  you might want to see #120 which is one step towards true job server HA.\r\n\r\nJob server uploads the jar and stores it in the database.  When it's time to load the app it retrieves it from the database, saving the jar bytes in a local file.   Therefore if multiple job servers point to the same database they can retrieve the same jar and it only has to be loaded once."}}