{"push_id":628650397,"size":284,"distinct_size":284,"ref":"refs/heads/branch-1.3","head":"ec3e76f1e47bfe1bdd3a010c004124d3bb17c3d1","before":"76e3e652763cf32f8ed7afe81a221bc8284af0ab","commits":[{"sha":"c5a5c6f618b89d712c13a236388fa67c136691ee","author":{"email":"92f00f90ea838fd276007b723d15ea80bfb5c263@nflabs.com","name":"Alexander"},"message":"[DOCS] Fix typo in API for custom InputFormats based on the “new” MapReduce API\n\nThis looks like a simple typo ```SparkContext.newHadoopRDD``` instead of ```SparkContext.newAPIHadoopRDD``` as in actual http://spark.apache.org/docs/1.2.1/api/scala/index.html#org.apache.spark.SparkContext\n\nAuthor: Alexander <abezzubov@nflabs.com>\n\nCloses #4718 from bzz/hadoop-InputFormats-doc-fix and squashes the following commits:\n\n680a4c4 [Alexander] Fix typo in docs on custom Hadoop InputFormats\n\n(cherry picked from commit a7f90390251ff62a0e10edf4c2eb876538597791)\nSigned-off-by: Sean Owen <sowen@cloudera.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/c5a5c6f618b89d712c13a236388fa67c136691ee"},{"sha":"04d3b328fc3747b39dab79a00e7799fa41857635","author":{"email":"50c4b4c4c26f83ee4bbc45a85db1c3c80b5aecdb@intel.com","name":"Cheng Hao"},"message":"[DataFrame] [Typo] Fix the typo\n\nAuthor: Cheng Hao <hao.cheng@intel.com>\n\nCloses #4717 from chenghao-intel/typo1 and squashes the following commits:\n\n858d7b0 [Cheng Hao] update the typo\n\n(cherry picked from commit 275b1bef897d775f1f7743378ca3e09e36160136)\nSigned-off-by: Sean Owen <sowen@cloudera.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/04d3b328fc3747b39dab79a00e7799fa41857635"},{"sha":"eed7389cf80d0930da16f77d6ccb39a82fe976c2","author":{"email":"291c18f3fb7528c712d9098b0e50a515ea0b91d5@cloudera.com","name":"Sean Owen"},"message":"SPARK-5669 [BUILD] Reverse exclusion of JBLAS libs for 1.3\n\nCC mengxr\n\nAuthor: Sean Owen <sowen@cloudera.com>\n\nCloses #4715 from srowen/SPARK-5669.3 and squashes the following commits:\n\nb27ffa9 [Sean Owen] Reverse exclusion of JBLAS libs for 1.3","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/eed7389cf80d0930da16f77d6ccb39a82fe976c2"},{"sha":"4186dd3dd074a41b3a1d6a4279b683fb355da092","author":{"email":"02e0a999c50b1f88df7a8f5a04e1b76b35ea6a88@databricks.com","name":"Andrew Or"},"message":"Revert \"[SPARK-4808] Removing minimum number of elements read before spill check\"\n\nThis reverts commit 0382dcc0a94f8e619fd11ec2cc0b18459a690c2b.","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/4186dd3dd074a41b3a1d6a4279b683fb355da092"},{"sha":"f172387dd6e89d2f24dd507ce8327fb4a496f957","author":{"email":"6d66edb52d2f3270c8a6a71e1adc20ae482f2bc7@gmail.com","name":"Makoto Fukuhara"},"message":"[EXAMPLES] fix typo.\n\nAuthor: Makoto Fukuhara <fukuo33@gmail.com>\n\nCloses #4724 from fukuo33/fix-typo and squashes the following commits:\n\n8c806b9 [Makoto Fukuhara] fix typo.\n\n(cherry picked from commit 934876741683fc254fed18e7ff630614f78944be)\nSigned-off-by: Sean Owen <sowen@cloudera.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/f172387dd6e89d2f24dd507ce8327fb4a496f957"},{"sha":"67b7f792908a3dd6b6453249f3ecf65dd51a6ba5","author":{"email":"79478dbbc8641d1d6545f348f655464aefbda99b@intel.com","name":"Saisai Shao"},"message":"[SPARK-5943][Streaming] Update the test to use new API to reduce the warning\n\nAuthor: Saisai Shao <saisai.shao@intel.com>\n\nCloses #4722 from jerryshao/SPARK-5943 and squashes the following commits:\n\n1b01233 [Saisai Shao] Update the test to use new API to reduce the warning\n\n(cherry picked from commit 757b14b862a1d39c1bad7b321dae1a3ea8338fbb)\nSigned-off-by: Sean Owen <sowen@cloudera.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/67b7f792908a3dd6b6453249f3ecf65dd51a6ba5"},{"sha":"33b908485ae79944ac0d888b444d528178af5dd0","author":{"email":"5d1ed0070fb6b6d5f66c1cf6a3d0bb37cf6f15d1@huawei.com","name":"Jacky Li"},"message":"[SPARK-5939][MLLib] make FPGrowth example app take parameters\n\nAdd parameter parsing in FPGrowth example app in Scala and Java\nAnd a sample data file is added in data/mllib folder\n\nAuthor: Jacky Li <jacky.likun@huawei.com>\n\nCloses #4714 from jackylk/parameter and squashes the following commits:\n\n8c478b3 [Jacky Li] fix according to comments\n3bb74f6 [Jacky Li] make FPGrowth exampl app take parameters\nf0e4d10 [Jacky Li] make FPGrowth exampl app take parameters\n\n(cherry picked from commit 651a1c019eb911005e234a46cc559d63da352377)\nSigned-off-by: Xiangrui Meng <meng@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/33b908485ae79944ac0d888b444d528178af5dd0"},{"sha":"8355773c3ca04950f90345690690407981ad6a82","author":{"email":"7d60694b1dcb7dc3582c310748eb6a84ab6a1ce8@yandex.ru","name":"Alexander Ulanov"},"message":"[MLLIB] SPARK-5912 Programming guide for feature selection\n\nAdded description of ChiSqSelector and few words about feature selection in general. I could add a code example, however it would not look reasonable in the absence of feature discretizer or a dataset in the `data` folder that has redundant features.\n\nAuthor: Alexander Ulanov <nashb@yandex.ru>\n\nCloses #4709 from avulanov/SPARK-5912 and squashes the following commits:\n\n19a8a4e [Alexander Ulanov] Addressing reviewers comments @jkbradley\n58d9e4d [Alexander Ulanov] Addressing reviewers comments @jkbradley\neb6b9fe [Alexander Ulanov] Typo\n2921a1d [Alexander Ulanov] ChiSqSelector example of use\nc845350 [Alexander Ulanov] ChiSqSelector docs\n\n(cherry picked from commit 28ccf5ee769a1df019e38985112065c01724fbd9)\nSigned-off-by: Joseph K. Bradley <joseph@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/8355773c3ca04950f90345690690407981ad6a82"},{"sha":"ae9704010d2c7dff523d8d89ded3af27f414f8e6","author":{"email":"461476587780aa9fa5611ea6dc3912c146a91760@databricks.com","name":"Joseph K. Bradley"},"message":"[SPARK-5912] [docs] [mllib] Small fixes to ChiSqSelector docs\n\nFixes:\n* typo in Scala example\n* Removed comment \"usually applied on sparse data\" since that is debatable\n* small edits to text for clarity\n\nCC: avulanov  I noticed a typo post-hoc and ended up making a few small edits.  Do the changes look OK?\n\nAuthor: Joseph K. Bradley <joseph@databricks.com>\n\nCloses #4732 from jkbradley/chisqselector-docs and squashes the following commits:\n\n9656a3b [Joseph K. Bradley] added Java example for ChiSqSelector to guide\n3f3f9f4 [Joseph K. Bradley] small fixes to ChiSqSelector docs\n\n(cherry picked from commit 59536cc87e10e5011560556729dd901280958f43)\nSigned-off-by: Xiangrui Meng <meng@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/ae9704010d2c7dff523d8d89ded3af27f414f8e6"},{"sha":"33ccad20ef2a4501ea8a8c5983f88f256c3ed478","author":{"email":"8adc4758e0403b3bd961e4e414291eaa9ba64098@databricks.com","name":"Yin Huai"},"message":"[SPARK-5935][SQL] Accept MapType in the schema provided to a JSON dataset.\n\nJIRA: https://issues.apache.org/jira/browse/SPARK-5935\n\nAuthor: Yin Huai <yhuai@databricks.com>\nAuthor: Yin Huai <huai@cse.ohio-state.edu>\n\nCloses #4710 from yhuai/jsonMapType and squashes the following commits:\n\n3e40390 [Yin Huai] Remove unnecessary changes.\nf8e6267 [Yin Huai] Fix test.\nbaa36e3 [Yin Huai] Accept MapType in the schema provided to jsonFile/jsonRDD.\n\n(cherry picked from commit 48376bfe9c97bf31279918def6c6615849c88f4d)\nSigned-off-by: Michael Armbrust <michael@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/33ccad20ef2a4501ea8a8c5983f88f256c3ed478"},{"sha":"2d7786ed1e008b33e8b171a8f2ea30e19426ba1f","author":{"email":"17b9e1c64588c7fa6419b4d29dc1f4426279ba01@databricks.com","name":"Michael Armbrust"},"message":"[SPARK-5873][SQL] Allow viewing of partially analyzed plans in queryExecution\n\nAuthor: Michael Armbrust <michael@databricks.com>\n\nCloses #4684 from marmbrus/explainAnalysis and squashes the following commits:\n\nafbaa19 [Michael Armbrust] fix python\nd93278c [Michael Armbrust] fix hive\ne5fa0a4 [Michael Armbrust] Merge remote-tracking branch 'origin/master' into explainAnalysis\n52119f2 [Michael Armbrust] more tests\n82a5431 [Michael Armbrust] fix tests\n25753d2 [Michael Armbrust] Merge remote-tracking branch 'origin/master' into explainAnalysis\naee1e6a [Michael Armbrust] fix hive\nb23a844 [Michael Armbrust] newline\nde8dc51 [Michael Armbrust] more comments\nacf620a [Michael Armbrust] [SPARK-5873][SQL] Show partially analyzed plans in query execution\n\n(cherry picked from commit 1ed57086d402c38d95cda6c3d9d7aea806609bf9)\nSigned-off-by: Michael Armbrust <michael@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/2d7786ed1e008b33e8b171a8f2ea30e19426ba1f"},{"sha":"dd42558504201f153689b02bdaea1e19b28d3c1f","author":{"email":"9616cf314f60cbadfd3d5d51110130ad7923defb@databricks.com","name":"Xiangrui Meng"},"message":"[SPARK-5958][MLLIB][DOC] update block matrix user guide\n\n* Removed SVD code from examples.\n* Corrected Java API doc link.\n* Updated variable names: `AtransposeA` -> `ata`.\n* Minor changes.\n\nbrkyvz\n\nAuthor: Xiangrui Meng <meng@databricks.com>\n\nCloses #4737 from mengxr/update-block-matrix-user-guide and squashes the following commits:\n\n70f53ac [Xiangrui Meng] update block matrix user guide\n\n(cherry picked from commit cf2e41653de778dc8db8b03385a053aae1152e19)\nSigned-off-by: Xiangrui Meng <meng@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/dd42558504201f153689b02bdaea1e19b28d3c1f"},{"sha":"2b562b04324229e43a48803fe9aff65ee4af21e8","author":{"email":"e6f14efef9fae0ae8f92d04007faea68035873ce@databricks.com","name":"Cheng Lian"},"message":"[SPARK-5968] [SQL] Suppresses ParquetOutputCommitter WARN logs\n\nPlease refer to the [JIRA ticket] [1] for the motivation.\n\n[1]: https://issues.apache.org/jira/browse/SPARK-5968\n\n<!-- Reviewable:start -->\n[<img src=\"https://reviewable.io/review_button.png\" height=40 alt=\"Review on Reviewable\"/>](https://reviewable.io/reviews/apache/spark/4744)\n<!-- Reviewable:end -->\n\nAuthor: Cheng Lian <lian@databricks.com>\n\nCloses #4744 from liancheng/spark-5968 and squashes the following commits:\n\ncaac6a8 [Cheng Lian] Suppresses ParquetOutputCommitter WARN logs\n\n(cherry picked from commit 840333133396d443e747f62fce9967f7681fb276)\nSigned-off-by: Michael Armbrust <michael@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/2b562b04324229e43a48803fe9aff65ee4af21e8"},{"sha":"ba5d60dda770fe1c1f8034149495009ef65749e2","author":{"email":"17b9e1c64588c7fa6419b4d29dc1f4426279ba01@databricks.com","name":"Michael Armbrust"},"message":"[SPARK-5910][SQL] Support for as in selectExpr\n\nAuthor: Michael Armbrust <michael@databricks.com>\n\nCloses #4736 from marmbrus/asExprs and squashes the following commits:\n\n5ba97e4 [Michael Armbrust] [SPARK-5910][SQL] Support for as in selectExpr\n\n(cherry picked from commit 0a59e45e2f2e6f00ccd5f10c79f629fb796fd8d0)\nSigned-off-by: Michael Armbrust <michael@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/ba5d60dda770fe1c1f8034149495009ef65749e2"},{"sha":"e46096b1e9f173c9f65425c3980b6f32edb3bf99","author":{"email":"17b9e1c64588c7fa6419b4d29dc1f4426279ba01@databricks.com","name":"Michael Armbrust"},"message":"[SPARK-5532][SQL] Repartition should not use external rdd representation\n\nAuthor: Michael Armbrust <michael@databricks.com>\n\nCloses #4738 from marmbrus/udtRepart and squashes the following commits:\n\nc06d7b5 [Michael Armbrust] fix compilation\n91c8829 [Michael Armbrust] [SQL][SPARK-5532] Repartition should not use external rdd representation\n\n(cherry picked from commit 201236628a344194f7c20ba8e9afeeaefbe9318c)\nSigned-off-by: Michael Armbrust <michael@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/e46096b1e9f173c9f65425c3980b6f32edb3bf99"},{"sha":"28dd53b1b613ba010dd4402d0744d6ebdd422fb5","author":{"email":"4330a85689689e23b81e88bdf5853b25c33529eb@gmail.com","name":"Tathagata Das"},"message":"[Spark-5967] [UI] Correctly clean JobProgressListener.stageIdToActiveJobIds\n\nPatch should be self-explanatory\npwendell JoshRosen\n\nAuthor: Tathagata Das <tathagata.das1565@gmail.com>\n\nCloses #4741 from tdas/SPARK-5967 and squashes the following commits:\n\n653b5bb [Tathagata Das] Fixed the fix and added test\ne2de972 [Tathagata Das] Clear stages which have no corresponding active jobs.\n\n(cherry picked from commit 64d2c01ff1048de83b9b8efce987b55e457298f9)\nSigned-off-by: Andrew Or <andrew@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/28dd53b1b613ba010dd4402d0744d6ebdd422fb5"},{"sha":"eaf7bf98af71a281e37416f3b469f801df46729e","author":{"email":"02e0a999c50b1f88df7a8f5a04e1b76b35ea6a88@databricks.com","name":"Andrew Or"},"message":"[SPARK-5965] Standalone Worker UI displays {{USER_JAR}}\n\nFor screenshot see: https://issues.apache.org/jira/browse/SPARK-5965\nThis was caused by 20a6013106b56a1a1cc3e8cda092330ffbe77cc3.\n\nAuthor: Andrew Or <andrew@databricks.com>\n\nCloses #4739 from andrewor14/user-jar-blocker and squashes the following commits:\n\n23c4a9e [Andrew Or] Use right argument\n\n(cherry picked from commit 6d2caa576fcdc5c848d1472b09c685b3871e220e)\nSigned-off-by: Andrew Or <andrew@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/eaf7bf98af71a281e37416f3b469f801df46729e"},{"sha":"a4ff445a9f2f34697d99a607b05cbc7322beec18","author":{"email":"9616cf314f60cbadfd3d5d51110130ad7923defb@databricks.com","name":"Xiangrui Meng"},"message":"[MLLIB] Change x_i to y_i in Variance's user guide\n\nVariance is calculated on labels/responses.\n\nAuthor: Xiangrui Meng <meng@databricks.com>\n\nCloses #4740 from mengxr/patch-1 and squashes the following commits:\n\n673317b [Xiangrui Meng] [MLLIB] Change x_i to y_i in Variance's user guide\n\n(cherry picked from commit 105791e35cee694f3b2ac1e06758650fe44e2c71)\nSigned-off-by: Xiangrui Meng <meng@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/a4ff445a9f2f34697d99a607b05cbc7322beec18"},{"sha":"641423dbffd9333ea8d989d0afa7b78426bd3979","author":{"email":"17b9e1c64588c7fa6419b4d29dc1f4426279ba01@databricks.com","name":"Michael Armbrust"},"message":"[SPARK-5952][SQL] Lock when using hive metastore client\n\nAuthor: Michael Armbrust <michael@databricks.com>\n\nCloses #4746 from marmbrus/hiveLock and squashes the following commits:\n\n8b871cf [Michael Armbrust] [SPARK-5952][SQL] Lock when using hive metastore client\n\n(cherry picked from commit a2b9137923e0ba328da8fff2fbbfcf2abf50b033)\nSigned-off-by: Michael Armbrust <michael@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/641423dbffd9333ea8d989d0afa7b78426bd3979"},{"sha":"91bf0f827efff406b56dd6d9443c3d203f03d7fe","author":{"email":"c437f8b7af73b0a10ecac061712ff9de6d41089e@databricks.com","name":"Davies Liu"},"message":"[SPARK-5973] [PySpark] fix zip with two RDDs with AutoBatchedSerializer\n\nAuthor: Davies Liu <davies@databricks.com>\n\nCloses #4745 from davies/fix_zip and squashes the following commits:\n\n2124b2c [Davies Liu] Update tests.py\nb5c828f [Davies Liu] increase the number of records\nc1e40fd [Davies Liu] fix zip with two RDDs with AutoBatchedSerializer\n\n(cherry picked from commit da505e59274d1c838653c1109db65ad374e65304)\nSigned-off-by: Joseph K. Bradley <joseph@databricks.com>","distinct":true,"url":"https://api.github.com/repos/frew/spark/commits/91bf0f827efff406b56dd6d9443c3d203f03d7fe"}]}