{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/7739","labels_url":"https://api.github.com/repos/apache/spark/issues/7739/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/7739/comments","events_url":"https://api.github.com/repos/apache/spark/issues/7739/events","html_url":"https://github.com/apache/spark/pull/7739","id":97826330,"number":7739,"title":"[WIP] SPARK-9384: Easier setting of executor and driver classpath","user":{"login":"markgrover","id":1709451,"avatar_url":"https://avatars.githubusercontent.com/u/1709451?v=3","gravatar_id":"","url":"https://api.github.com/users/markgrover","html_url":"https://github.com/markgrover","followers_url":"https://api.github.com/users/markgrover/followers","following_url":"https://api.github.com/users/markgrover/following{/other_user}","gists_url":"https://api.github.com/users/markgrover/gists{/gist_id}","starred_url":"https://api.github.com/users/markgrover/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/markgrover/subscriptions","organizations_url":"https://api.github.com/users/markgrover/orgs","repos_url":"https://api.github.com/users/markgrover/repos","events_url":"https://api.github.com/users/markgrover/events{/privacy}","received_events_url":"https://api.github.com/users/markgrover/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":39,"created_at":"2015-07-28T23:59:10Z","updated_at":"2015-08-03T21:49:43Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/7739","html_url":"https://github.com/apache/spark/pull/7739","diff_url":"https://github.com/apache/spark/pull/7739.diff","patch_url":"https://github.com/apache/spark/pull/7739.patch"},"body":"Adding new property spark.common.extraClassPath for adding to both the driver and executor classpath.\r\n\r\nMore testing needs to be done.\r\n\r\nCurrently one can set extra jars in the driver classpath using spark.driver.extraClassPath property. Similarly, the executor's extra classpath can be set using spark.executor.extraClassPath property.\r\nHowever, many users (myself) included have often suffered from the dogma of setting one and missing the other. Causing a lot of wasted time. And, this JIRA is an effort to see if the status quo can be made better.\r\n\r\n--jars sets the classpath set by the classloader but there is no such way of setting the system classpath of the driver and the executor. This change would allow users to override libraries shipped with Spark, or add jars like some JDBC driver, that don't work unless they are adding to the system classpath."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/127415848","html_url":"https://github.com/apache/spark/pull/7739#issuecomment-127415848","issue_url":"https://api.github.com/repos/apache/spark/issues/7739","id":127415848,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2015-08-03T21:49:43Z","updated_at":"2015-08-03T21:49:43Z","body":"  [Test build #39591 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/39591/console) for   PR 7739 at commit [`8ebf8e1`](https://github.com/apache/spark/commit/8ebf8e1d0f4cb4f75f5ea5b77b9c72feb7b19207).\n * This patch **fails Scala style tests**.\n * This patch **does not merge cleanly**.\n * This patch adds no public classes."}}