{"push_id":625089059,"size":3,"distinct_size":3,"ref":"refs/heads/rpc-rewrite-part3","head":"b776817a25dde88796e7ac13ba9a3912c4da0abd","before":"6594d11e70a105488d52bed10451f549a4a1264c","commits":[{"sha":"ae980eb41c00b5f1f64c650f267b884e864693f0","author":{"email":"93406da1fa8ebf4406b5d741093e2ccfc7f09e95@nttdata.co.jp","name":"Sasaki Toru"},"message":"[SPARK-6736][GraphX][Doc]Example of Graph#aggregateMessages has error\n\nExample of Graph#aggregateMessages has error.\nSince aggregateMessages is a method of Graph, It should be written \"rawGraph.aggregateMessages\"\n\nAuthor: Sasaki Toru <sasakitoa@nttdata.co.jp>\n\nCloses #5388 from sasakitoa/aggregateMessagesExample and squashes the following commits:\n\nb1d631b [Sasaki Toru] Example of Graph#aggregateMessages has error","distinct":true,"url":"https://api.github.com/repos/zsxwing/spark/commits/ae980eb41c00b5f1f64c650f267b884e864693f0"},{"sha":"b65bad65c3500475b974ca0219f218eef296db2c","author":{"email":"7ea8d8bc92d239699affc4b9ea1759f960ddbaa7@huawei.com","name":"WangTaoTheTonic"},"message":"[SPARK-3591][YARN]fire and forget for YARN cluster mode\n\nhttps://issues.apache.org/jira/browse/SPARK-3591\n\nThe output after this patch:\n>doggie153:/opt/oss/spark-1.3.0-bin-hadoop2.4/bin # ./spark-submit  --class org.apache.spark.examples.SparkPi --master yarn-cluster ../lib/spark-examples*.jar\n15/03/31 21:15:25 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable\n15/03/31 21:15:25 INFO RMProxy: Connecting to ResourceManager at doggie153/10.177.112.153:8032\n15/03/31 21:15:25 INFO Client: Requesting a new application from cluster with 4 NodeManagers\n15/03/31 21:15:25 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (8192 MB per container)\n15/03/31 21:15:25 INFO Client: Will allocate AM container, with 896 MB memory including 384 MB overhead\n15/03/31 21:15:25 INFO Client: Setting up container launch context for our AM\n15/03/31 21:15:25 INFO Client: Preparing resources for our AM container\n15/03/31 21:15:26 INFO Client: Uploading resource file:/opt/oss/spark-1.3.0-bin-hadoop2.4/lib/spark-assembly-1.4.0-SNAPSHOT-hadoop2.4.1.jar -> hdfs://doggie153:9000/user/root/.sparkStaging/application_1427257505534_0016/spark-assembly-1.4.0-SNAPSHOT-hadoop2.4.1.jar\n15/03/31 21:15:27 INFO Client: Uploading resource file:/opt/oss/spark-1.3.0-bin-hadoop2.4/lib/spark-examples-1.3.0-hadoop2.4.0.jar -> hdfs://doggie153:9000/user/root/.sparkStaging/application_1427257505534_0016/spark-examples-1.3.0-hadoop2.4.0.jar\n15/03/31 21:15:28 INFO Client: Setting up the launch environment for our AM container\n15/03/31 21:15:28 INFO SecurityManager: Changing view acls to: root\n15/03/31 21:15:28 INFO SecurityManager: Changing modify acls to: root\n15/03/31 21:15:28 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(root); users with modify permissions: Set(root)\n15/03/31 21:15:28 INFO Client: Submitting application 16 to ResourceManager\n15/03/31 21:15:28 INFO YarnClientImpl: Submitted application application_1427257505534_0016\n15/03/31 21:15:28 INFO Client: ... waiting before polling ResourceManager for application state\n15/03/31 21:15:33 INFO Client: ... polling ResourceManager for application state\n15/03/31 21:15:33 INFO Client: Application report for application_1427257505534_0016 (state: RUNNING)\n15/03/31 21:15:33 INFO Client:\n         client token: N/A\n         diagnostics: N/A\n         ApplicationMaster host: doggie157\n         ApplicationMaster RPC port: 0\n         queue: default\n         start time: 1427807728307\n         final status: UNDEFINED\n         tracking URL: http://doggie153:8088/proxy/application_1427257505534_0016/\n         user: root\n\n/cc andrewor14\n\nAuthor: WangTaoTheTonic <wangtao111@huawei.com>\n\nCloses #5297 from WangTaoTheTonic/SPARK-3591 and squashes the following commits:\n\nc76d232 [WangTaoTheTonic] wrap lines\n16c90a8 [WangTaoTheTonic] move up lines to avoid duplicate\nfea390d [WangTaoTheTonic] log failed/killed report, style and comment\nbe1cc2e [WangTaoTheTonic] reword\nf0bc54f [WangTaoTheTonic] minor: expose appid in excepiton messages\nba9b22b [WangTaoTheTonic] wrong config name\ne1a4013 [WangTaoTheTonic] revert to the old version and do some robust\n19706c0 [WangTaoTheTonic] add a config to control whether to forget\n0cbdce8 [WangTaoTheTonic] fire and forget for YARN cluster mode","distinct":true,"url":"https://api.github.com/repos/zsxwing/spark/commits/b65bad65c3500475b974ca0219f218eef296db2c"},{"sha":"b776817a25dde88796e7ac13ba9a3912c4da0abd","author":{"email":"5d14e010a5b345b784fd604efcc6cebb79f97468@gmail.com","name":"zsxwing"},"message":"Update Master, Worker, Client, AppClient and related classes to use RpcEndpoint","distinct":true,"url":"https://api.github.com/repos/zsxwing/spark/commits/b776817a25dde88796e7ac13ba9a3912c4da0abd"}]}