{"push_id":712384888,"size":4,"distinct_size":4,"ref":"refs/heads/branch-1.3","head":"3a71cf946040b647f304bcae1ebcf84d64fab601","before":"88e303f6e991cdbed519bf11820e1280057581e9","commits":[{"sha":"ac3591d097f89efcf6fd8faa25c86ed78ef376bf","author":{"email":"e5dd8a3899598b2e85930c5ff06b11c053ef654f@databricks.com","name":"Josh Rosen"},"message":"[SPARK-8606] Prevent exceptions in RDD.getPreferredLocations() from crashing DAGScheduler\n\nIf `RDD.getPreferredLocations()` throws an exception it may crash the DAGScheduler and SparkContext. This patch addresses this by adding a try-catch block.\n\nAuthor: Josh Rosen <joshrosen@databricks.com>\n\nCloses #7023 from JoshRosen/SPARK-8606 and squashes the following commits:\n\n770b169 [Josh Rosen] Fix getPreferredLocations() DAGScheduler crash with try block.\n44a9b55 [Josh Rosen] Add test of a buggy getPartitions() method\n19aa9f7 [Josh Rosen] Add (failing) regression test for getPreferredLocations() DAGScheduler crash\n\n(cherry picked from commit 0b5abbf5f96a5f6bfd15a65e8788cf3fa96fe54c)\nSigned-off-by: Josh Rosen <joshrosen@databricks.com>","distinct":true,"url":"https://api.github.com/repos/mapr/spark/commits/ac3591d097f89efcf6fd8faa25c86ed78ef376bf"},{"sha":"0ce83db11f5f91121705a5b72f134e9ffe72d2a6","author":{"email":"6f926b8fae3893ce5f7e882614cfe038839d4fc8@ussuning.com","name":"Ai He"},"message":"[SPARK-7810] [PYSPARK] solve python rdd socket connection problem\n\nMethod \"_load_from_socket\" in rdd.py cannot load data from jvm socket when ipv6 is used. The current method only works well with ipv4. New modification should work around both two protocols.\n\nAuthor: Ai He <ai.he@ussuning.com>\nAuthor: AiHe <ai.he@ussuning.com>\n\nCloses #6338 from AiHe/pyspark-networking-issue and squashes the following commits:\n\nd4fc9c4 [Ai He] handle code review 2\ne75c5c8 [Ai He] handle code review\n5644953 [AiHe] solve python rdd socket connection problem to jvm\n\n(cherry picked from commit ecd3aacf2805bb231cfb44bab079319cfe73c3f1)\nSigned-off-by: Davies Liu <davies@databricks.com>","distinct":true,"url":"https://api.github.com/repos/mapr/spark/commits/0ce83db11f5f91121705a5b72f134e9ffe72d2a6"},{"sha":"d720426e1f1961bd9e095cd3c5723a969f07a2dc","author":{"email":"7f17b12a3695bce86f8d21a9e5b0c0b8869fb3be@live.co.kr","name":"lee19"},"message":"[SPARK-8563] [MLLIB] Fixed a bug so that IndexedRowMatrix.computeSVD().U.numCols = k\n\nI'm sorry that I made https://github.com/apache/spark/pull/6949 closed by mistake.\nI pushed codes again.\n\nAnd, I added a test code.\n\n>\nThere is a bug that `U.numCols() = self.nCols` in `IndexedRowMatrix.computeSVD()`\nIt should have been `U.numCols() = k = svd.U.numCols()`\n\n>\n```\nself = U * sigma * V.transpose\n(m x n) = (m x n) * (k x k) * (k x n) //ASIS\n-->\n(m x n) = (m x k) * (k x k) * (k x n) //TOBE\n```\n\nAuthor: lee19 <lee19@live.co.kr>\n\nCloses #6953 from lee19/MLlibBugfix and squashes the following commits:\n\nc1812a0 [lee19] [SPARK-8563] [MLlib] Used nRows instead of numRows() to reduce a burden.\n4b9803b [lee19] [SPARK-8563] [MLlib] Fixed a build error.\nc2ccd89 [lee19] Added a unit test that validates matrix sizes of svd for [SPARK-8563][MLlib]\n8373424 [lee19] [SPARK-8563][MLlib] Fixed a bug so that IndexedRowMatrix.computeSVD().U.numCols = k\n\n(cherry picked from commit e72526227fdcf93b7a33375ef954746ac08753f5)\nSigned-off-by: Xiangrui Meng <meng@databricks.com>","distinct":true,"url":"https://api.github.com/repos/mapr/spark/commits/d720426e1f1961bd9e095cd3c5723a969f07a2dc"},{"sha":"3a71cf946040b647f304bcae1ebcf84d64fab601","author":{"email":"d341bbf2aad80447ede3389687e24bd9faa305d8@gmail.com","name":"x1-"},"message":"[SPARK-8535] [PYSPARK] PySpark : Can't create DataFrame from Pandas dataframe with no explicit column name\n\nBecause implicit name of `pandas.columns` are Int, but `StructField` json expect `String`.\nSo I think `pandas.columns` are should be convert to `String`.\n\n### issue\n\n* [SPARK-8535 PySpark : Can't create DataFrame from Pandas dataframe with no explicit column name](https://issues.apache.org/jira/browse/SPARK-8535)\n\nAuthor: x1- <viva008@gmail.com>\n\nCloses #7124 from x1-/SPARK-8535 and squashes the following commits:\n\nd68fd38 [x1-] modify unit-test using pandas.\nea1897d [x1-] For implicit name of pandas.columns are Int, so should be convert to String.\n\n(cherry picked from commit b6e76edf3005c078b407f63b0a05d3a28c18c742)\nSigned-off-by: Davies Liu <davies@databricks.com>","distinct":true,"url":"https://api.github.com/repos/mapr/spark/commits/3a71cf946040b647f304bcae1ebcf84d64fab601"}]}