{"push_id":685381593,"size":5,"distinct_size":5,"ref":"refs/heads/branch-1.1","head":"36eed2f9ea42bdfe116b9578fc54b50b25f44f3c","before":"c5836816f0384a3142b7c5b51e0222f7abfa85a3","commits":[{"sha":"e445ce61d02778beaa30a2d1867e5b06fe09fb5d","author":{"email":"02e0a999c50b1f88df7a8f5a04e1b76b35ea6a88@databricks.com","name":"Andrew Or"},"message":"[SPARK-6132] ContextCleaner race condition across SparkContexts\n\nThe problem is that `ContextCleaner` may clean variables that belong to a different `SparkContext`. This can happen if the `SparkContext` to which the cleaner belongs stops, and a new one is started immediately afterwards in the same JVM. In this case, if the cleaner is in the middle of cleaning a broadcast, for instance, it will do so through `SparkEnv.get.blockManager`, which could be one that belongs to a different `SparkContext`.\n\nJoshRosen and I suspect that this is the cause of many flaky tests, most notably the `JavaAPISuite`. We were able to reproduce the failure locally (though it is not deterministic and very hard to reproduce).\n\nAuthor: Andrew Or <andrew@databricks.com>\n\nCloses #4869 from andrewor14/cleaner-masquerade and squashes the following commits:\n\n29168c0 [Andrew Or] Synchronize ContextCleaner stop","distinct":true,"url":"https://api.github.com/repos/oliviertoupin/spark/commits/e445ce61d02778beaa30a2d1867e5b06fe09fb5d"},{"sha":"39761f515d65afff377873ee4701b9313c317a60","author":{"email":"02e0a999c50b1f88df7a8f5a04e1b76b35ea6a88@databricks.com","name":"Andrew Or"},"message":"[SPARK-6132][HOTFIX] ContextCleaner InterruptedException should be quiet\n\nIf the cleaner is stopped, we shouldn't print a huge stack trace when the cleaner thread is interrupted because we purposefully did this.\n\nAuthor: Andrew Or <andrew@databricks.com>\n\nCloses #4882 from andrewor14/cleaner-interrupt and squashes the following commits:\n\n8652120 [Andrew Or] Just a hot fix","distinct":true,"url":"https://api.github.com/repos/oliviertoupin/spark/commits/39761f515d65afff377873ee4701b9313c317a60"},{"sha":"ee06e9271017d2730147ac08a228c771630b3688","author":{"email":"284a00ea9901227c42561196ff8576aed3ac5631@gmail.com","name":"Kay Ousterhout"},"message":"[SPARK-6753] Clone SparkConf in ShuffleSuite tests\n\nPrior to this change, the unit test for SPARK-3426 did not clone the\noriginal SparkConf, which meant that that test did not use the options\nset by suites that subclass ShuffleSuite.scala. This commit fixes that\nproblem.\n\nJoshRosen would be great if you could take a look at this, since you wrote this\ntest originally.\n\nAuthor: Kay Ousterhout <kayousterhout@gmail.com>\n\nCloses #5401 from kayousterhout/SPARK-6753 and squashes the following commits:\n\n368c540 [Kay Ousterhout] [SPARK-6753] Clone SparkConf in ShuffleSuite tests\n\n(cherry picked from commit 9d44ddce1d1e19011026605549c37d0db6d6afa1)\nSigned-off-by: Josh Rosen <joshrosen@databricks.com>","distinct":true,"url":"https://api.github.com/repos/oliviertoupin/spark/commits/ee06e9271017d2730147ac08a228c771630b3688"},{"sha":"672f3228c43217caa339061834e256bda049cec4","author":{"email":"fcf9e35ad50aab44387f6ff709c4c4bf73ee4abe@gmail.com","name":"Mike Dusenberry"},"message":"[SPARK-7883] [DOCS] [MLLIB] Fixing broken trainImplicit Scala example in MLlib Collaborative Filtering documentation.\n\nFixing broken trainImplicit Scala example in MLlib Collaborative Filtering documentation to match one of the possible ALS.trainImplicit function signatures.\n\nAuthor: Mike Dusenberry <dusenberrymw@gmail.com>\n\nCloses #6422 from dusenberrymw/Fix_MLlib_Collab_Filtering_trainImplicit_Example and squashes the following commits:\n\n36492f4 [Mike Dusenberry] Fixing broken trainImplicit example in MLlib Collaborative Filtering documentation to match one of the possible ALS.trainImplicit function signatures.\n\n(cherry picked from commit 0463428b6e8f364f0b1f39445a60cd85ae7c07bc)\nSigned-off-by: Xiangrui Meng <meng@databricks.com>","distinct":true,"url":"https://api.github.com/repos/oliviertoupin/spark/commits/672f3228c43217caa339061834e256bda049cec4"},{"sha":"36eed2f9ea42bdfe116b9578fc54b50b25f44f3c","author":{"email":"8757c4a255384de9fc2175f17a84f948e7081d30@gmail.com","name":"MechCoder"},"message":"[SPARK-8032] [PYSPARK] Make version checking for NumPy in MLlib more robust\n\nThe current checking does version `1.x' is less than `1.4' this will fail if x has greater than 1 digit, since x > 4, however `1.x` < `1.4`\n\nIt fails in my system since I have version `1.10` :P\n\nAuthor: MechCoder <manojkumarsivaraj334@gmail.com>\n\nCloses #6579 from MechCoder/np_ver and squashes the following commits:\n\n15430f8 [MechCoder] fix syntax error\n893fb7e [MechCoder] remove equal to\ne35f0d4 [MechCoder] minor\ne89376c [MechCoder] Better checking\n22703dd [MechCoder] [SPARK-8032] Make version checking for NumPy in MLlib more robust\n\n(cherry picked from commit 452eb82dd722e5dfd00ee47bb8b6353933b0016e)\nSigned-off-by: Xiangrui Meng <meng@databricks.com>","distinct":true,"url":"https://api.github.com/repos/oliviertoupin/spark/commits/36eed2f9ea42bdfe116b9578fc54b50b25f44f3c"}]}