{"push_id":651160457,"size":268,"distinct_size":268,"ref":"refs/heads/master","head":"b79aeb95b45ab4ae811039d452cf028d7b844132","before":"8261e31229e962054ace8e11dfd7b4996166fd92","commits":[{"sha":"320bca4508e890b874c2eb7abb76a30ef14c932f","author":{"email":"22a0dda5f6015b8ee84a30ff6553d35a91fe8732@gmail.com","name":"Timothy Chen"},"message":"[SPARK-6081] Support fetching http/https uris in driver runner.\n\nCurrently if passed uris such as http/https, it won't able to fetch them as it only calls HadoopFs get.\nThis fix utilizes the existing util method to fetch remote uris as well.\n\nAuthor: Timothy Chen <tnachen@gmail.com>\n\nCloses #4832 from tnachen/driver_remote and squashes the following commits:\n\naa52cd6 [Timothy Chen] Support fetching remote uris in driver runner.","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/320bca4508e890b874c2eb7abb76a30ef14c932f"},{"sha":"f63b44a5c201d9678738a906462be9a6d7e3e8f8","author":{"email":"7ea8d8bc92d239699affc4b9ea1759f960ddbaa7@huawei.com","name":"WangTaoTheTonic"},"message":"[SPARK-6894]spark.executor.extraLibraryOptions => spark.executor.extraLibraryPath\n\nhttps://issues.apache.org/jira/browse/SPARK-6894\n\ncc vanzin\n\nAuthor: WangTaoTheTonic <wangtao111@huawei.com>\n\nCloses #5506 from WangTaoTheTonic/SPARK-6894 and squashes the following commits:\n\n4b7ced7 [WangTaoTheTonic] spark.executor.extraLibraryOptions => spark.executor.extraLibraryPath","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/f63b44a5c201d9678738a906462be9a6d7e3e8f8"},{"sha":"dcf8a9f331c6193a62bbc9282bdc99663e23ca19","author":{"email":"00251748166a68f887f2228d75111fdd8c3d0fb6@guavus.com","name":"pankaj arora"},"message":"[CORE] SPARK-6880: Fixed null check when all the dependent stages are cancelled due to previous stage failure\n\nFixed null check when all the dependent stages are cancelled due to previous stage failure. This happens when one of the executor node goes down and all the dependent stages are cancelled.\n\nAuthor: pankaj arora <pankaj.arora@guavus.com>\n\nCloses #5494 from pankajarora12/NEWBRANCH and squashes the following commits:\n\n55ba5e3 [pankaj arora] [CORE] SPARK-6880: Fixed null check when all the dependent stages are cancelled due to previous stage failure\n4575720 [pankaj arora] [CORE] SPARK-6880: Fixed null check when all the dependent stages are cancelled due to previous stage failure","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/dcf8a9f331c6193a62bbc9282bdc99663e23ca19"},{"sha":"25998e4d73bcc95ac85d9af71adfdc726ec89568","author":{"email":"48d3a847ef684d87177a99cd6c21cdf466f2e98a@qq.com","name":"GuoQiang Li"},"message":"[SPARK-2033] Automatically cleanup checkpoint\n\nAuthor: GuoQiang Li <witgo@qq.com>\n\nCloses #855 from witgo/cleanup_checkpoint_date and squashes the following commits:\n\n1649850 [GuoQiang Li] review commit\nc0087e0 [GuoQiang Li] Automatically cleanup checkpoint","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/25998e4d73bcc95ac85d9af71adfdc726ec89568"},{"sha":"8f8dc45f6d4c8d7b740eaa3d2ea09d0b531af9dd","author":{"email":"fd726277649d3b2e3ee5d332dca6c89739b68aa5@gmail.com","name":"CodingCat"},"message":"SPARK-1706: Allow multiple executors per worker in Standalone mode\n\nresubmit of https://github.com/apache/spark/pull/636  for a totally different algorithm\n\nhttps://issues.apache.org/jira/browse/SPARK-1706\n\nIn current implementation, the user has to start multiple workers in a server for starting multiple executors in a server, which introduces additional overhead due to the more JVM processes...\n\nIn this patch, I changed the scheduling logic in master to enable the user to start multiple executor processes within the same JVM process.\n\n1. user configure spark.executor.maxCoreNumPerExecutor to suggest the maximum core he/she would like to allocate to each executor\n\n2. Master assigns the executors to the workers with the major consideration on the memoryPerExecutor and the worker.freeMemory, and tries to allocate as many as possible cores to the executor ```min(min(memoryPerExecutor, worker.freeCore), maxLeftCoreToAssign)``` where ```maxLeftCoreToAssign = maxExecutorCanAssign * maxCoreNumPerExecutor```\n\n---------------------------------------\n\nOther small changes include\n\nchange memoryPerSlave in ApplicationDescription to memoryPerExecutor, as \"Slave\" is overrided to represent both worker and executor in the documents... (we have some discussion on this before?)\n\nAuthor: CodingCat <zhunansjtu@gmail.com>\n\nCloses #731 from CodingCat/SPARK-1706-2 and squashes the following commits:\n\n6dee808 [CodingCat] change filter predicate\nfbeb7e5 [CodingCat] address the comments\n940cb42 [CodingCat] avoid unnecessary allocation\nb8ca561 [CodingCat] revert a change\n45967b4 [CodingCat] remove unused method\n2eeff77 [CodingCat] stylistic fixes\n12a1b32 [CodingCat] change the semantic of coresPerExecutor to exact core number\nf035423 [CodingCat] stylistic fix\nd9c1685 [CodingCat] remove unused var\nf595bd6 [CodingCat] recover some unintentional changes\n63b3df9 [CodingCat] change the description of the parameter in the submit script\n4cf61f1 [CodingCat] improve the code and docs\nff011e2 [CodingCat] start multiple executors on the worker by rewriting startExeuctor logic\n2c2bcc5 [CodingCat] fix wrong usage info\n497ec2c [CodingCat] address andrew's comments\n878402c [CodingCat] change the launching executor code\nf64a28d [CodingCat] typo fix\n387f4ec [CodingCat] bug fix\n35c462c [CodingCat] address Andrew's comments\n0b64fea [CodingCat] fix compilation issue\n19d3da7 [CodingCat] address the comments\n5b81466 [CodingCat] remove outdated comments\nec7d421 [CodingCat] test commit\ne5efabb [CodingCat] more java docs and consolidate canUse function\na26096d [CodingCat] stylistic fix\na5d629a [CodingCat] java doc\nb34ec0c [CodingCat] make master support multiple executors per worker","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/8f8dc45f6d4c8d7b740eaa3d2ea09d0b531af9dd"},{"sha":"b075e4b720221a8204cae93468065a6708348830","author":{"email":"8283fd24ce58e0bb0d6bf349e9064fef42c4d84e@cloudera.com","name":"Marcelo Vanzin"},"message":"[SPARK-6700] [yarn] Re-enable flaky test.\n\nTest runs have been successful on jenkins. So let's re-enable the test and look out for any failures, and fix things appropriately.\n\nAuthor: Marcelo Vanzin <vanzin@cloudera.com>\n\nCloses #5459 from vanzin/SPARK-6700 and squashes the following commits:\n\n2ead85b [Marcelo Vanzin] WIP: re-enable flaky test to catch failure in jenkins.","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/b075e4b720221a8204cae93468065a6708348830"},{"sha":"6adb8bcbf0a1a7bfe2990de18c59c66cd7a0aeb8","author":{"email":"e5dd8a3899598b2e85930c5ff06b11c053ef654f@databricks.com","name":"Josh Rosen"},"message":"[SPARK-6905] Upgrade to snappy-java 1.1.1.7\n\nWe should upgrade our snappy-java dependency to 1.1.1.7 in order to include a fix for a bug that results in worse compression in SnappyOutputStream (see https://github.com/xerial/snappy-java/issues/100).\n\nAuthor: Josh Rosen <joshrosen@databricks.com>\n\nCloses #5512 from JoshRosen/snappy-1.1.1.7 and squashes the following commits:\n\nf1ac0f8 [Josh Rosen] Upgrade to snappy-java 1.1.1.7.","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/6adb8bcbf0a1a7bfe2990de18c59c66cd7a0aeb8"},{"sha":"65774370a1275e25cd8a3357e397d116767793a9","author":{"email":"8283fd24ce58e0bb0d6bf349e9064fef42c4d84e@cloudera.com","name":"Marcelo Vanzin"},"message":"[SPARK-5808] [build] Package pyspark files in sbt assembly.\n\nThis turned out to be more complicated than I wanted because the\nlayout of python/ doesn't really follow the usual maven conventions.\nSo some extra code is needed to copy just the right things.\n\nAuthor: Marcelo Vanzin <vanzin@cloudera.com>\n\nCloses #5461 from vanzin/SPARK-5808 and squashes the following commits:\n\n7153dac [Marcelo Vanzin] Only try to create resource dir if it doesn't already exist.\nee90e84 [Marcelo Vanzin] [SPARK-5808] [build] Package pyspark files in sbt assembly.","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/65774370a1275e25cd8a3357e397d116767793a9"},{"sha":"4d4b24927417b2c17810e94d6d46c37491c68869","author":{"email":"7d45abe39fd242ee2f6575da28f13d66568418b3@oss.nttdata.co.jp","name":"Kousuke Saruta"},"message":"[SPARK-6769][YARN][TEST] Usage of the ListenerBus in YarnClusterSuite is wrong\n\nIn YarnClusterSuite, a test case uses `SaveExecutorInfo`  to handle ExecutorAddedEvent as follows.\n\n```\nprivate class SaveExecutorInfo extends SparkListener {\n  val addedExecutorInfos = mutable.Map[String, ExecutorInfo]()\n\n  override def onExecutorAdded(executor: SparkListenerExecutorAdded) {\n    addedExecutorInfos(executor.executorId) = executor.executorInfo\n  }\n}\n\n...\n\n    listener = new SaveExecutorInfo\n    val sc = new SparkContext(new SparkConf()\n      .setAppName(\"yarn \\\"test app\\\" 'with quotes' and \\\\back\\\\slashes and $dollarSigns\"))\n    sc.addSparkListener(listener)\n    val status = new File(args(0))\n    var result = \"failure\"\n    try {\n      val data = sc.parallelize(1 to 4, 4).collect().toSet\n      assert(sc.listenerBus.waitUntilEmpty(WAIT_TIMEOUT_MILLIS))\n      data should be (Set(1, 2, 3, 4))\n      result = \"success\"\n    } finally {\n      sc.stop()\n      Files.write(result, status, UTF_8)\n    }\n```\n\nBut, the usage is wrong because Executors will spawn during initializing SparkContext and SparkContext#addSparkListener should be invoked after the initialization, thus after Executors spawn, so SaveExecutorInfo cannot handle ExecutorAddedEvent.\n\nFollowing code refers the result of the handling ExecutorAddedEvent. Because of the reason above, we cannot reach the assertion.\n\n```\n    // verify log urls are present\n    listener.addedExecutorInfos.values.foreach { info =>\n      assert(info.logUrlMap.nonEmpty)\n    }\n```\n\nAuthor: Kousuke Saruta <sarutak@oss.nttdata.co.jp>\n\nCloses #5417 from sarutak/SPARK-6769 and squashes the following commits:\n\n8adc8ba [Kousuke Saruta] Fixed compile error\ne258530 [Kousuke Saruta] Fixed style\n591cf3e [Kousuke Saruta] Fixed style\n48ec89a [Kousuke Saruta] Merge branch 'master' of git://git.apache.org/spark into SPARK-6769\n860c965 [Kousuke Saruta] Simplified code\n207d325 [Kousuke Saruta] Added findListenersByClass method to ListenerBus\n2408c84 [Kousuke Saruta] Merge branch 'master' of git://git.apache.org/spark into SPARK-6769\n2d7e409 [Kousuke Saruta] Merge branch 'master' of git://git.apache.org/spark into SPARK-6769\n3874adf [Kousuke Saruta] Fixed the usage of listener bus in LogUrlsStandaloneSuite\n153a91b [Kousuke Saruta] Fixed the usage of listener bus in YarnClusterSuite","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/4d4b24927417b2c17810e94d6d46c37491c68869"},{"sha":"a76b921a923ac37d3c73ee18d24df4bb611daba3","author":{"email":"e5dd8a3899598b2e85930c5ff06b11c053ef654f@databricks.com","name":"Josh Rosen"},"message":"Revert \"[SPARK-6352] [SQL] Add DirectParquetOutputCommitter\"\n\nThis reverts commit b29663eeea440b1d1a288d41b5ddf67e77c5bd54.\n\nI'm reverting this because it broke test compilation for the Hadoop 1.x\nprofiles.","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/a76b921a923ac37d3c73ee18d24df4bb611daba3"},{"sha":"6de282e2de3cb69f9b746d03fde581429248824a","author":{"email":"5d14e010a5b345b784fd604efcc6cebb79f97468@gmail.com","name":"zsxwing"},"message":"[SPARK-6796][Streaming][WebUI] Add \"Active Batches\" and \"Completed Batches\" lists to StreamingPage\n\nThis PR adds two lists, `Active Batches` and `Completed Batches`. Here is the screenshot:\n\n![batch_list](https://cloud.githubusercontent.com/assets/1000778/7060458/d8898572-deb3-11e4-938b-6f8602c71a9f.png)\n\nDue to [SPARK-6766](https://issues.apache.org/jira/browse/SPARK-6766), I need to merge #5414 in my local machine to get the above screenshot.\n\nAuthor: zsxwing <zsxwing@gmail.com>\n\nCloses #5434 from zsxwing/SPARK-6796 and squashes the following commits:\n\nbe50fc6 [zsxwing] Fix the code style\n51b792e [zsxwing] Fix the unit test\n6f3078e [zsxwing] Make 'startTime' readable\nf40e0a9 [zsxwing] Merge branch 'master' into SPARK-6796\n2525336 [zsxwing] Rename 'Processed batches' and 'Waiting batches' and also add links\na69c091 [zsxwing] Show the number of total completed batches too\na12ad7b [zsxwing] Change 'records' to 'events' in the UI\n86b5e7f [zsxwing] Make BatchTableBase abstract\nb248787 [zsxwing] Add tests to verify the new tables\nd18ab7d [zsxwing] Fix the code style\n6ceffb3 [zsxwing] Add \"Active Batches\" and \"Completed Batches\" lists to StreamingPage","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/6de282e2de3cb69f9b746d03fde581429248824a"},{"sha":"9717389365772d218cd7c67f9a13c3440f3c6791","author":{"email":"8283fd24ce58e0bb0d6bf349e9064fef42c4d84e@cloudera.com","name":"Marcelo Vanzin"},"message":"[SPARK-6890] [core] Fix launcher lib work with SPARK_PREPEND_CLASSES.\n\nThe fix for SPARK-6406 broke the case where sub-processes are launched\nwhen SPARK_PREPEND_CLASSES is set, because the code now would only add\nthe launcher's build directory to the sub-process's classpath instead\nof the complete assembly.\n\nThis patch fixes the problem by having the launch scripts stash the\nassembly's location in an environment variable. This is not the prettiest\nsolution, but it avoids having to plumb that location all the way through\nthe Worker code that launches executors. The env variable is always\nset by the launch scripts, so users cannot override it.\n\nAuthor: Marcelo Vanzin <vanzin@cloudera.com>\n\nCloses #5504 from vanzin/SPARK-6890 and squashes the following commits:\n\n7aec921 [Marcelo Vanzin] Fix tests.\nff87a60 [Marcelo Vanzin] Merge branch 'master' into SPARK-6890\n31d3ce8 [Marcelo Vanzin] [SPARK-6890] [core] Fix launcher lib work with SPARK_PREPEND_CLASSES.","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/9717389365772d218cd7c67f9a13c3440f3c6791"},{"sha":"30a6e0dcc0bd298731c1387546779cddcc16bc72","author":{"email":"8283fd24ce58e0bb0d6bf349e9064fef42c4d84e@cloudera.com","name":"Marcelo Vanzin"},"message":"[SPARK-5634] [core] Show correct message in HS when no incomplete apps f...\n\n...ound.\n\nAuthor: Marcelo Vanzin <vanzin@cloudera.com>\n\nCloses #5515 from vanzin/SPARK-5634 and squashes the following commits:\n\nf74ecf1 [Marcelo Vanzin] [SPARK-5634] [core] Show correct message in HS when no incomplete apps found.","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/30a6e0dcc0bd298731c1387546779cddcc16bc72"},{"sha":"6be918942c4078692d169d72fa9c358f6e98e85e","author":{"email":"d24118b4297e1ecf0c990d6935f5f9e6e4fd7701@gmail.com","name":"Liang-Chi Hsieh"},"message":"[SPARK-6871][SQL] WITH clause in CTE can not following another WITH clause\n\nJIRA https://issues.apache.org/jira/browse/SPARK-6871\n\nAuthor: Liang-Chi Hsieh <viirya@gmail.com>\n\nCloses #5480 from viirya/no_cte_after_cte and squashes the following commits:\n\n4da3712 [Liang-Chi Hsieh] Create new test.\n40b38ed [Liang-Chi Hsieh] Merge remote-tracking branch 'upstream/master' into no_cte_after_cte\n0edf568 [Liang-Chi Hsieh] for comments.\n6591b79 [Liang-Chi Hsieh] WITH clause in CTE can not following another WITH clause.","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/6be918942c4078692d169d72fa9c358f6e98e85e"},{"sha":"29aabdd6c20197adb16706823a8c7f48a0074352","author":{"email":"c2bf8a29ab4e9ca2b842ca45622f95cb9164f566@intel.com","name":"Daoyuan Wang"},"message":"[HOTFIX] [SPARK-6896] [SQL] fix compile error in hive-thriftserver\n\nSPARK-6440 #5424 import guava but did not promote guava dependency to compile level.\n\n[INFO] compiler plugin: BasicArtifact(org.scalamacros,paradise_2.10.4,2.0.1,null)\n[info] Compiling 8 Scala sources to /root/projects/spark/sql/hive-thriftserver/target/scala-2.10/classes...\n[error] bad symbolic reference. A signature in Utils.class refers to term util\n[error] in package com.google.common which is not available.\n[error] It may be completely missing from the current classpath, or the version on\n[error] the classpath might be incompatible with the version used when compiling Utils.class.\n[error]\n[error] while compiling: /root/projects/spark/sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLEnv.scala\n[error] during phase: erasure\n[error] library version: version 2.10.4\n[error] compiler version: version 2.10.4\n[error] reconstructed args: -deprecation -classpath\n\nAuthor: Daoyuan Wang <daoyuan.wang@intel.com>\n\nCloses #5507 from adrian-wang/guava and squashes the following commits:\n\nc337dad [Daoyuan Wang] fix compile error","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/29aabdd6c20197adb16706823a8c7f48a0074352"},{"sha":"6c5ed8a6d552abd967d27cdb94b68d46ccb57221","author":{"email":"291c18f3fb7528c712d9098b0e50a515ea0b91d5@cloudera.com","name":"Sean Owen"},"message":"SPARK-6861 [BUILD] Scalastyle config prevents building Maven child modules alone\n\nMove scalastyle-config.xml to dev/ (SBT config still doesn't work) to fix running mvn targets from subdirs; make scalastyle a verify stage target again in Maven; output results in target not project root; update to scalastyle 0.7.0\n\nAuthor: Sean Owen <sowen@cloudera.com>\n\nCloses #5471 from srowen/SPARK-6861 and squashes the following commits:\n\nacac637 [Sean Owen] Oops, add back execution but leave it at the default verify phase\n35a4fd2 [Sean Owen] Revert change to scalastyle-config.xml location, but return scalastyle Maven check to verify phase instead of package to get it farther out of the way, since the Maven invocation is optional\nc4fb42c [Sean Owen] Move scalastyle-config.xml to dev/ (SBT config still doesn't work) to fix running mvn targets from subdirs; make scalastyle a verify stage target again in Maven; output results in target not project root; update to scalastyle 0.7.0","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/6c5ed8a6d552abd967d27cdb94b68d46ccb57221"},{"sha":"f11288d5272bc18585b8cad4ee3bd59eade7c296","author":{"email":"c437f8b7af73b0a10ecac061712ff9de6d41089e@databricks.com","name":"Davies Liu"},"message":"[SPARK-6886] [PySpark] fix big closure with shuffle\n\nCurrently, the created broadcast object will have same life cycle as RDD in Python. For multistage jobs, an PythonRDD will be created in JVM and the RDD in Python may be GCed, then the broadcast will be destroyed in JVM before the PythonRDD.\n\nThis PR change to use PythonRDD to track the lifecycle of the broadcast object. It also have a refactor about getNumPartitions() to avoid unnecessary creation of PythonRDD, which could be heavy.\n\ncc JoshRosen\n\nAuthor: Davies Liu <davies@databricks.com>\n\nCloses #5496 from davies/big_closure and squashes the following commits:\n\n9a0ea4c [Davies Liu] fix big closure with shuffle","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/f11288d5272bc18585b8cad4ee3bd59eade7c296"},{"sha":"b75b3070740803480d235b0c9a86673721344f30","author":{"email":"d24118b4297e1ecf0c990d6935f5f9e6e4fd7701@gmail.com","name":"Liang-Chi Hsieh"},"message":"[SPARK-6730][SQL] Allow using keyword as identifier in OPTIONS\n\nJIRA: https://issues.apache.org/jira/browse/SPARK-6730\n\nIt is very possible that keyword will be used as identifier in `OPTIONS`, this pr makes it works.\n\nHowever, another approach is that we can request that `OPTIONS` can't include keywords and has to use alternative identifier (e.g. table -> cassandraTable) if needed.\n\nIf so, please let me know to close this pr. Thanks.\n\nAuthor: Liang-Chi Hsieh <viirya@gmail.com>\n\nCloses #5520 from viirya/relax_options and squashes the following commits:\n\n339fd68 [Liang-Chi Hsieh] Use regex parser.\n92be11c [Liang-Chi Hsieh] Allow using keyword as identifier in OPTIONS.","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/b75b3070740803480d235b0c9a86673721344f30"},{"sha":"e3e4e9a38b25174ed8bb460ba2b375813ebf3b4b","author":{"email":"d24118b4297e1ecf0c990d6935f5f9e6e4fd7701@gmail.com","name":"Liang-Chi Hsieh"},"message":"[SPARK-6800][SQL] Update doc for JDBCRelation's columnPartition\n\nJIRA https://issues.apache.org/jira/browse/SPARK-6800\n\nAuthor: Liang-Chi Hsieh <viirya@gmail.com>\n\nCloses #5488 from viirya/fix_jdbc_where and squashes the following commits:\n\n51386c8 [Liang-Chi Hsieh] Update code comment.\n1dcc929 [Liang-Chi Hsieh] Update document.\n3eb74d6 [Liang-Chi Hsieh] Revert and modify doc.\ndf11783 [Liang-Chi Hsieh] Merge remote-tracking branch 'upstream/master' into fix_jdbc_where\n3e7db15 [Liang-Chi Hsieh] Fix wrong logic to generate WHERE clause for JDBC.","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/e3e4e9a38b25174ed8bb460ba2b375813ebf3b4b"},{"sha":"785f95586b951d7b05481ee925fb95c20c4d6b6f","author":{"email":"8adc4758e0403b3bd961e4e414291eaa9ba64098@databricks.com","name":"Yin Huai"},"message":"[SPARK-6887][SQL] ColumnBuilder misses FloatType\n\nhttps://issues.apache.org/jira/browse/SPARK-6887\n\nAuthor: Yin Huai <yhuai@databricks.com>\n\nCloses #5499 from yhuai/inMemFloat and squashes the following commits:\n\n84cba38 [Yin Huai] Add test.\n4b75ba6 [Yin Huai] Add FloatType back.","distinct":true,"url":"https://api.github.com/repos/yijieshen/spark/commits/785f95586b951d7b05481ee925fb95c20c4d6b6f"}]}