{"push_id":636824700,"size":4,"distinct_size":4,"ref":"refs/heads/branch-1.3","head":"c9b1ba4b16a7afe93d45bf75b128cc0dd287ded0","before":"6d3c4d8b04b2738a821dfcc3df55a5635b89e506","commits":[{"sha":"47fb78c62405af360995305847aed12c9a2d649e","author":{"email":"29e05320a613faa71033b8bf4c133bf8ae9edea8@palantir.com","name":"Punya Biswal"},"message":"[SPARK-6952] Handle long args when detecting PID reuse\n\nsbin/spark-daemon.sh used\n\n    ps -p \"$TARGET_PID\" -o args=\n\nto figure out whether the process running with the expected PID is actually a Spark\ndaemon. When running with a large classpath, the output of ps gets\ntruncated and the check fails spuriously.\n\nThis weakens the check to see if it's a java command (which is something\nwe do in other parts of the script) rather than looking for the specific\nmain class name. This means that SPARK-4832 might happen under a\nslightly broader range of circumstances (a java program happened to\nreuse the same PID), but it seems worthwhile compared to failing\nconsistently with a large classpath.\n\nAuthor: Punya Biswal <pbiswal@palantir.com>\n\nCloses #5535 from punya/feature/SPARK-6952 and squashes the following commits:\n\n7ea12d1 [Punya Biswal] Handle long args when detecting PID reuse","distinct":true,"url":"https://api.github.com/repos/mapr/spark/commits/47fb78c62405af360995305847aed12c9a2d649e"},{"sha":"6b528dc139da594ef2e651d84bd91fe0f738a39d","author":{"email":"c43522d98ec09bb312019761aae81416e0ca1a6b@lateral-thoughts.com","name":"Olivier Girardot"},"message":"SPARK-6988 : Fix documentation regarding DataFrames using the Java API\n\nThis patch includes :\n * adding how to use map after an sql query using javaRDD\n * fixing the first few java examples that were written in Scala\n\nThank you for your time,\n\nOlivier.\n\nAuthor: Olivier Girardot <o.girardot@lateral-thoughts.com>\n\nCloses #5564 from ogirardot/branch-1.3 and squashes the following commits:\n\n9f8d60e [Olivier Girardot] SPARK-6988 : Fix documentation regarding DataFrames using the Java API","distinct":true,"url":"https://api.github.com/repos/mapr/spark/commits/6b528dc139da594ef2e651d84bd91fe0f738a39d"},{"sha":"7d0ab55538be4138df1750b0aa73d3066d61fb9b","author":{"email":"79478dbbc8641d1d6545f348f655464aefbda99b@intel.com","name":"jerryshao"},"message":"[SPARK-6975][Yarn] Fix argument validation error\n\n`numExecutors` checking is failed when dynamic allocation is enabled with default configuration. Details can be seen is [SPARK-6975](https://issues.apache.org/jira/browse/SPARK-6975). sryza, please help me to review this, not sure is this the correct way, I think previous you change this part :)\n\nAuthor: jerryshao <saisai.shao@intel.com>\n\nCloses #5551 from jerryshao/SPARK-6975 and squashes the following commits:\n\n4335da1 [jerryshao] Change according to the comments\n77bdcbd [jerryshao] Fix argument validation error\n\n(cherry picked from commit d850b4bd3a294dd245881e03f7f94bf970a7ee79)\nSigned-off-by: Andrew Or <andrew@databricks.com>","distinct":true,"url":"https://api.github.com/repos/mapr/spark/commits/7d0ab55538be4138df1750b0aa73d3066d61fb9b"},{"sha":"c9b1ba4b16a7afe93d45bf75b128cc0dd287ded0","author":{"email":"c43522d98ec09bb312019761aae81416e0ca1a6b@lateral-thoughts.com","name":"Olivier Girardot"},"message":"SPARK-6992 : Fix documentation example for Spark SQL on StructType\n\nThis patch is fixing the Java examples for Spark SQL when defining\nprogrammatically a Schema and mapping Rows.\n\nAuthor: Olivier Girardot <o.girardot@lateral-thoughts.com>\n\nCloses #5569 from ogirardot/branch-1.3 and squashes the following commits:\n\nc29e58d [Olivier Girardot] SPARK-6992 : Fix documentation example for Spark SQL on StructType","distinct":true,"url":"https://api.github.com/repos/mapr/spark/commits/c9b1ba4b16a7afe93d45bf75b128cc0dd287ded0"}]}