{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/5580","labels_url":"https://api.github.com/repos/apache/spark/issues/5580/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/5580/comments","events_url":"https://api.github.com/repos/apache/spark/issues/5580/events","html_url":"https://github.com/apache/spark/pull/5580","id":69430452,"number":5580,"title":"[SPARK-6869][PySpark] Add pyspark archives path to PYTHONPATH","user":{"login":"lianhuiwang","id":545478,"avatar_url":"https://avatars.githubusercontent.com/u/545478?v=3","gravatar_id":"","url":"https://api.github.com/users/lianhuiwang","html_url":"https://github.com/lianhuiwang","followers_url":"https://api.github.com/users/lianhuiwang/followers","following_url":"https://api.github.com/users/lianhuiwang/following{/other_user}","gists_url":"https://api.github.com/users/lianhuiwang/gists{/gist_id}","starred_url":"https://api.github.com/users/lianhuiwang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lianhuiwang/subscriptions","organizations_url":"https://api.github.com/users/lianhuiwang/orgs","repos_url":"https://api.github.com/users/lianhuiwang/repos","events_url":"https://api.github.com/users/lianhuiwang/events{/privacy}","received_events_url":"https://api.github.com/users/lianhuiwang/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":23,"created_at":"2015-04-19T14:31:39Z","updated_at":"2015-04-29T19:13:26Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/5580","html_url":"https://github.com/apache/spark/pull/5580","diff_url":"https://github.com/apache/spark/pull/5580.diff","patch_url":"https://github.com/apache/spark/pull/5580.patch"},"body":"Based on https://github.com/apache/spark/pull/5478 that provide a PYSPARK_ARCHIVES_PATH env. within this PR, we just should export PYSPARK_ARCHIVES_PATH=/user/spark/pyspark.zip,/user/spark/python/lib/py4j-0.8.2.1-src.zip in conf/spark-env.sh when we don't install PySpark on each node of Yarn. i run python application successfully on yarn-client and yarn-cluster with this PR.\r\n@andrewor14 @sryza @Sephiroth-Lin Can you take a look at this?thanks."},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/97547542","html_url":"https://github.com/apache/spark/pull/5580#issuecomment-97547542","issue_url":"https://api.github.com/repos/apache/spark/issues/5580","id":97547542,"user":{"login":"lianhuiwang","id":545478,"avatar_url":"https://avatars.githubusercontent.com/u/545478?v=3","gravatar_id":"","url":"https://api.github.com/users/lianhuiwang","html_url":"https://github.com/lianhuiwang","followers_url":"https://api.github.com/users/lianhuiwang/followers","following_url":"https://api.github.com/users/lianhuiwang/following{/other_user}","gists_url":"https://api.github.com/users/lianhuiwang/gists{/gist_id}","starred_url":"https://api.github.com/users/lianhuiwang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/lianhuiwang/subscriptions","organizations_url":"https://api.github.com/users/lianhuiwang/orgs","repos_url":"https://api.github.com/users/lianhuiwang/repos","events_url":"https://api.github.com/users/lianhuiwang/events{/privacy}","received_events_url":"https://api.github.com/users/lianhuiwang/received_events","type":"User","site_admin":false},"created_at":"2015-04-29T19:13:26Z","updated_at":"2015-04-29T19:13:26Z","body":"@Sephiroth-Lin @tgravescs  i have updated it and zip pyspark archives in mvn's pom.xml and sbt's build.scala."}}