{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/5096","labels_url":"https://api.github.com/repos/apache/spark/issues/5096/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/5096/comments","events_url":"https://api.github.com/repos/apache/spark/issues/5096/events","html_url":"https://github.com/apache/spark/pull/5096","id":63116166,"number":5096,"title":"[SPARK-5654] Integrate SparkR","user":{"login":"shivaram","id":143893,"avatar_url":"https://avatars.githubusercontent.com/u/143893?v=3","gravatar_id":"","url":"https://api.github.com/users/shivaram","html_url":"https://github.com/shivaram","followers_url":"https://api.github.com/users/shivaram/followers","following_url":"https://api.github.com/users/shivaram/following{/other_user}","gists_url":"https://api.github.com/users/shivaram/gists{/gist_id}","starred_url":"https://api.github.com/users/shivaram/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/shivaram/subscriptions","organizations_url":"https://api.github.com/users/shivaram/orgs","repos_url":"https://api.github.com/users/shivaram/repos","events_url":"https://api.github.com/users/shivaram/events{/privacy}","received_events_url":"https://api.github.com/users/shivaram/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":39,"created_at":"2015-03-19T23:35:13Z","updated_at":"2015-03-31T04:07:42Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/5096","html_url":"https://github.com/apache/spark/pull/5096","diff_url":"https://github.com/apache/spark/pull/5096.diff","patch_url":"https://github.com/apache/spark/pull/5096.patch"},"body":"This pull requests integrates SparkR, an R frontend for Spark. The SparkR package contains both RDD and DataFrame APIs in R and is integrated with Spark's submission scripts to work on different cluster managers.\r\n\r\nSome integration points that would be great to get feedback on:\r\n\r\n1. Build procedure: SparkR requires R to be installed on the machine to be built. Right now we have a new Maven profile `-PsparkR` that can be used to enable SparkR builds\r\n\r\n2. YARN cluster mode: The R package that is built needs to be present on the driver and all the worker nodes during execution. The R package location is currently set using SPARK_HOME, but this might not work on YARN cluster mode.\r\n\r\nThe SparkR package represents the work of many contributors and attached below is a list of people along with areas they worked on\r\n\r\nedwardt (@edwart) - Documentation improvements\r\nFelix Cheung (@felixcheung) - Documentation improvements\r\nHossein Falaki (@falaki)  - Documentation improvements\r\nChris Freeman (@cafreeman) - DataFrame API, Programming Guide\r\nTodd Gao (@7c00) - R worker Internals\r\nRyan Hafen (@hafen) - SparkR Internals\r\nQian Huang (@hqzizania) - RDD API\r\nHao Lin (@hlin09) - RDD API, Closure cleaner\r\nEvert Lammerts (@evertlammerts) - DataFrame API\r\nDavies Liu (@davies) - DataFrame API, R worker internals, Merging with Spark \r\nYi Lu (@lythesia) - RDD API, Worker internals\r\nMatt Massie (@massie) - Jenkins build\r\nHarihar Nahak (@hnahak87) - SparkR examples\r\nOscar Olmedo (@oscaroboto) - Spark configuration\r\nAntonio Piccolboni (@piccolbo) - SparkR examples, Namespace bug fixes\r\nDan Putler (@dputler) - Dataframe API, SparkR Install Guide\r\nAshutosh Raina (@ashutoshraina) - Build improvements\r\nJosh Rosen (@joshrosen) - Travis CI build\r\nSun Rui (@sun-rui)- RDD API, JVM Backend, Shuffle improvements\r\nShivaram Venkataraman (@shivaram) - RDD API, JVM Backend, Worker Internals\r\nZongheng Yang (@concretevitamin) - RDD API, Pipelined RDDs, Examples and EC2 guide"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/87927735","html_url":"https://github.com/apache/spark/pull/5096#issuecomment-87927735","issue_url":"https://api.github.com/repos/apache/spark/issues/5096","id":87927735,"user":{"login":"SparkQA","id":8108735,"avatar_url":"https://avatars.githubusercontent.com/u/8108735?v=3","gravatar_id":"","url":"https://api.github.com/users/SparkQA","html_url":"https://github.com/SparkQA","followers_url":"https://api.github.com/users/SparkQA/followers","following_url":"https://api.github.com/users/SparkQA/following{/other_user}","gists_url":"https://api.github.com/users/SparkQA/gists{/gist_id}","starred_url":"https://api.github.com/users/SparkQA/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SparkQA/subscriptions","organizations_url":"https://api.github.com/users/SparkQA/orgs","repos_url":"https://api.github.com/users/SparkQA/repos","events_url":"https://api.github.com/users/SparkQA/events{/privacy}","received_events_url":"https://api.github.com/users/SparkQA/received_events","type":"User","site_admin":false},"created_at":"2015-03-31T04:07:42Z","updated_at":"2015-03-31T04:07:42Z","body":"  [Test build #29444 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/29444/consoleFull) for   PR 5096 at commit [`0e788c0`](https://github.com/apache/spark/commit/0e788c08f3b418acc05d4d27298b65de8b6f8407)."}}