{"push_id":914886757,"size":4,"distinct_size":4,"ref":"refs/heads/master","head":"ea4aab7e87fbcf9ac90f93af79cc892b56508aa0","before":"ead6abf7e7fc14b451214951d4991d497aa65e63","commits":[{"sha":"9e85bb71ad2d7d3a9da0cb8853f3216d37e6ff47","author":{"email":"409019bab0e07036ad6abfa289bcfe098eb16317@jp.ibm.com","name":"Kazuaki Ishizaki"},"message":"[SPARK-12502][BUILD][PYTHON] Script /dev/run-tests fails when IBM Java is used\n\nfix an exception with IBM JDK by removing update field from a JavaVersion tuple. This is because IBM JDK does not have information on update '_xx'\n\nAuthor: Kazuaki Ishizaki <ishizaki@jp.ibm.com>\n\nCloses #10463 from kiszk/SPARK-12502.","distinct":true,"url":"https://api.github.com/repos/taishi-oss/spark/commits/9e85bb71ad2d7d3a9da0cb8853f3216d37e6ff47"},{"sha":"392046611837a3a740ff97fa8177ca7c12316fb7","author":{"email":"409019bab0e07036ad6abfa289bcfe098eb16317@jp.ibm.com","name":"Kazuaki Ishizaki"},"message":"[SPARK-12311][CORE] Restore previous value of \"os.arch\" property in test suites after forcing to set specific value to \"os.arch\" property\n\nRestore the original value of os.arch property after each test\n\nSince some of tests forced to set the specific value to os.arch property, we need to set the original value.\n\nAuthor: Kazuaki Ishizaki <ishizaki@jp.ibm.com>\n\nCloses #10289 from kiszk/SPARK-12311.","distinct":true,"url":"https://api.github.com/repos/taishi-oss/spark/commits/392046611837a3a740ff97fa8177ca7c12316fb7"},{"sha":"502476e45c314a1229b3bce1c61f5cb94a9fc04b","author":{"email":"74bab60ee07bbc7c6e7ece9bc76c048745a2c533@oracle.com","name":"CK50"},"message":"[SPARK-12010][SQL] Spark JDBC requires support for column-name-free INSERT syntax\n\nIn the past Spark JDBC write only worked with technologies which support the following INSERT statement syntax (JdbcUtils.scala: insertStatement()):\n\nINSERT INTO $table VALUES ( ?, ?, ..., ? )\n\nBut some technologies require a list of column names:\n\nINSERT INTO $table ( $colNameList ) VALUES ( ?, ?, ..., ? )\n\nThis was blocking the use of e.g. the Progress JDBC Driver for Cassandra.\n\nAnother limitation is that syntax 1 relies no the dataframe field ordering match that of the target table. This works fine, as long as the target table has been created by writer.jdbc().\n\nIf the target table contains more columns (not created by writer.jdbc()), then the insert fails due mismatch of number of columns or their data types.\n\nThis PR switches to the recommended second INSERT syntax. Column names are taken from datafram field names.\n\nAuthor: CK50 <christian.kurz@oracle.com>\n\nCloses #10380 from CK50/master-SPARK-12010-2.","distinct":true,"url":"https://api.github.com/repos/taishi-oss/spark/commits/502476e45c314a1229b3bce1c61f5cb94a9fc04b"},{"sha":"ea4aab7e87fbcf9ac90f93af79cc892b56508aa0","author":{"email":"270167d20e82b11e0673d1a46b116e2f4cd206bd@realimpactanalytics.com","name":"pierre-borckmans"},"message":"[SPARK-12440][CORE] Avoid setCheckpoint warning when directory is not local\n\nIn SparkContext method `setCheckpointDir`, a warning is issued when spark master is not local and the passed directory for the checkpoint dir appears to be local.\n\nIn practice, when relying on HDFS configuration file and using a relative path for the checkpoint directory (using an incomplete URI without HDFS scheme, ...), this warning should not be issued and might be confusing.\nIn fact, in this case, the checkpoint directory is successfully created, and the checkpointing mechanism works as expected.\n\nThis PR uses the `FileSystem` instance created with the given directory, and checks whether it is local or not.\n(The rationale is that since this same `FileSystem` instance is used to create the checkpoint dir anyway and can therefore be reliably used to determine if it is local or not).\n\nThe warning is only issued if the directory is not local, on top of the existing conditions.\n\nAuthor: pierre-borckmans <pierre.borckmans@realimpactanalytics.com>\n\nCloses #10392 from pierre-borckmans/SPARK-12440_CheckpointDir_Warning_NonLocal.","distinct":true,"url":"https://api.github.com/repos/taishi-oss/spark/commits/ea4aab7e87fbcf9ac90f93af79cc892b56508aa0"}]}