{"push_id":635020216,"size":746,"distinct_size":3,"ref":"refs/heads/sandy-spark-5112","head":"4aba898de9adaa8335257c0913b680cec1351b80","before":"62bac8288c8d5233c6b5281224e33ff454119c85","commits":[{"sha":"08488c175f2e8532cb6aab84da2abd9ad57179cc","author":{"email":"c437f8b7af73b0a10ecac061712ff9de6d41089e@databricks.com","name":"Davies Liu"},"message":"[SPARK-5469] restructure pyspark.sql into multiple files\n\nAll the DataTypes moved into pyspark.sql.types\n\nThe changes can be tracked by `--find-copies-harder -M25`\n```\ndavieslocalhost:~/work/spark/python$ git diff --find-copies-harder -M25 --numstat master..\n2       5       python/docs/pyspark.ml.rst\n0       3       python/docs/pyspark.mllib.rst\n10      2       python/docs/pyspark.sql.rst\n1       1       python/pyspark/mllib/linalg.py\n21      14      python/pyspark/{mllib => sql}/__init__.py\n14      2108    python/pyspark/{sql.py => sql/context.py}\n10      1772    python/pyspark/{sql.py => sql/dataframe.py}\n7       6       python/pyspark/{sql_tests.py => sql/tests.py}\n8       1465    python/pyspark/{sql.py => sql/types.py}\n4       2       python/run-tests\n1       1       sql/core/src/main/scala/org/apache/spark/sql/test/ExamplePointUDT.scala\n```\n\nAlso `git blame -C -C python/pyspark/sql/context.py` to track the history.\n\nAuthor: Davies Liu <davies@databricks.com>\n\nCloses #4479 from davies/sql and squashes the following commits:\n\n1b5f0a5 [Davies Liu] Merge branch 'master' of github.com:apache/spark into sql\n2b2b983 [Davies Liu] restructure pyspark.sql","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/08488c175f2e8532cb6aab84da2abd9ad57179cc"},{"sha":"31d435ecfdc24a788a6e38f4e82767bc275a3283","author":{"email":"1bbfbf3ad5c4de88db64d0be3ca037b409d25231@huawei.com","name":"KaiXinXiaoLei"},"message":"Add a config option to print DAG.\n\nAdd a config option \"spark.rddDebug.enable\" to check whether to print DAG info. When \"spark.rddDebug.enable\" is true, it will print information about DAG in the log.\n\nAuthor: KaiXinXiaoLei <huleilei1@huawei.com>\n\nCloses #4257 from KaiXinXiaoLei/DAGprint and squashes the following commits:\n\nd9fe42e [KaiXinXiaoLei] change  log info\nc27ee76 [KaiXinXiaoLei] change log info\n83c2b32 [KaiXinXiaoLei] change config option\nadcb14f [KaiXinXiaoLei] change the file.\nf4e7b9e [KaiXinXiaoLei] add a option to print DAG","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/31d435ecfdc24a788a6e38f4e82767bc275a3283"},{"sha":"36c4e1d75933dc843acb747b91dc12e75ad1df42","author":{"email":"291c18f3fb7528c712d9098b0e50a515ea0b91d5@cloudera.com","name":"Sean Owen"},"message":"SPARK-4900 [MLLIB] MLlib SingularValueDecomposition ARPACK IllegalStateException\n\nFix ARPACK error code mapping, at least. It's not yet clear whether the error is what we expect from ARPACK. If it isn't, not sure if that's to be treated as an MLlib or Breeze issue.\n\nAuthor: Sean Owen <sowen@cloudera.com>\n\nCloses #4485 from srowen/SPARK-4900 and squashes the following commits:\n\n7355aa1 [Sean Owen] Fix ARPACK error code mapping","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/36c4e1d75933dc843acb747b91dc12e75ad1df42"},{"sha":"20a6013106b56a1a1cc3e8cda092330ffbe77cc3","author":{"email":"8283fd24ce58e0bb0d6bf349e9064fef42c4d84e@cloudera.com","name":"Marcelo Vanzin"},"message":"[SPARK-2996] Implement userClassPathFirst for driver, yarn.\n\nYarn's config option `spark.yarn.user.classpath.first` does not work the same way as\n`spark.files.userClassPathFirst`; Yarn's version is a lot more dangerous, in that it\nmodifies the system classpath, instead of restricting the changes to the user's class\nloader. So this change implements the behavior of the latter for Yarn, and deprecates\nthe more dangerous choice.\n\nTo be able to achieve feature-parity, I also implemented the option for drivers (the existing\noption only applies to executors). So now there are two options, each controlling whether\nto apply userClassPathFirst to the driver or executors. The old option was deprecated, and\naliased to the new one (`spark.executor.userClassPathFirst`).\n\nThe existing \"child-first\" class loader also had to be fixed. It didn't handle resources, and it\nwas also doing some things that ended up causing JVM errors depending on how things\nwere being called.\n\nAuthor: Marcelo Vanzin <vanzin@cloudera.com>\n\nCloses #3233 from vanzin/SPARK-2996 and squashes the following commits:\n\n9cf9cf1 [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\na1499e2 [Marcelo Vanzin] Remove SPARK_HOME propagation.\nfa7df88 [Marcelo Vanzin] Remove 'test.resource' file, create it dynamically.\na8c69f1 [Marcelo Vanzin] Review feedback.\ncabf962 [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\na1b8d7e [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\n3f768e3 [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\n2ce3c7a [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\n0e6d6be [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\n70d4044 [Marcelo Vanzin] Fix pyspark/yarn-cluster test.\n0fe7777 [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\n0e6ef19 [Marcelo Vanzin] Move class loaders around and make names more meaninful.\nfe970a7 [Marcelo Vanzin] Review feedback.\n25d4fed [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\n3cb6498 [Marcelo Vanzin] Call the right loadClass() method on the parent.\nfbb8ab5 [Marcelo Vanzin] Add locking in loadClass() to avoid deadlocks.\n2e6c4b7 [Marcelo Vanzin] Mention new setting in documentation.\nb6497f9 [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\na10f379 [Marcelo Vanzin] Some feedback.\n3730151 [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\nf513871 [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\n44010b6 [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\n7b57cba [Marcelo Vanzin] Remove now outdated message.\n5304d64 [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\n35949c8 [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\n54e1a98 [Marcelo Vanzin] Merge branch 'master' into SPARK-2996\nd1273b2 [Marcelo Vanzin] Add test file to rat exclude.\nfa1aafa [Marcelo Vanzin] Remove write check on user jars.\n89d8072 [Marcelo Vanzin] Cleanups.\na963ea3 [Marcelo Vanzin] Implement spark.driver.userClassPathFirst for standalone cluster mode.\n50afa5f [Marcelo Vanzin] Fix Yarn executor command line.\n7d14397 [Marcelo Vanzin] Register user jars in executor up front.\n7f8603c [Marcelo Vanzin] Fix yarn-cluster mode without userClassPathFirst.\n20373f5 [Marcelo Vanzin] Fix ClientBaseSuite.\n55c88fa [Marcelo Vanzin] Run all Yarn integration tests via spark-submit.\n0b64d92 [Marcelo Vanzin] Add deprecation warning to yarn option.\n4a84d87 [Marcelo Vanzin] Fix the child-first class loader.\nd0394b8 [Marcelo Vanzin] Add \"deprecated configs\" to SparkConf.\n46d8cf2 [Marcelo Vanzin] Update doc with new option, change name to \"userClassPathFirst\".\na314f2d [Marcelo Vanzin] Enable driver class path isolation in SparkSubmit.\n91f7e54 [Marcelo Vanzin] [yarn] Enable executor class path isolation.\na853e74 [Marcelo Vanzin] Re-work CoarseGrainedExecutorBackend command line arguments.\n89522ef [Marcelo Vanzin] Add class path isolation support for Yarn cluster mode.","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/20a6013106b56a1a1cc3e8cda092330ffbe77cc3"},{"sha":"a95ed52157473fb0e42e910ee15270e7f0edf943","author":{"email":"02e0a999c50b1f88df7a8f5a04e1b76b35ea6a88@databricks.com","name":"Andrew Or"},"message":"[SPARK-5703] AllJobsPage throws empty.max exception\n\nIf you have a `SparkListenerJobEnd` event without the corresponding `SparkListenerJobStart` event, then `JobProgressListener` will create an empty `JobUIData` with an empty `stageIds` list. However, later in `AllJobsPage` we call `stageIds.max`. If this is empty, it will throw an exception.\n\nThis crashed my history server.\n\nAuthor: Andrew Or <andrew@databricks.com>\n\nCloses #4490 from andrewor14/jobs-page-max and squashes the following commits:\n\n21797d3 [Andrew Or] Check nonEmpty before calling max","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/a95ed52157473fb0e42e910ee15270e7f0edf943"},{"sha":"a2d33d0b01af87e931d9d883638a52d7a86f6248","author":{"email":"284a00ea9901227c42561196ff8576aed3ac5631@gmail.com","name":"Kay Ousterhout"},"message":"[SPARK-5701] Only set ShuffleReadMetrics when task has shuffle deps\n\nThe updateShuffleReadMetrics method in TaskMetrics (called by the executor heartbeater) will currently always add a ShuffleReadMetrics to TaskMetrics (with values set to 0), even when the task didn't read any shuffle data. ShuffleReadMetrics should only be added if the task reads shuffle data.\n\nAuthor: Kay Ousterhout <kayousterhout@gmail.com>\n\nCloses #4488 from kayousterhout/SPARK-5701 and squashes the following commits:\n\n673ed58 [Kay Ousterhout] SPARK-5701: Only set ShuffleReadMetrics when task has shuffle deps","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/a2d33d0b01af87e931d9d883638a52d7a86f6248"},{"sha":"bd0b5ea708aa5b84adb67c039ec52408289718bb","author":{"email":"50c4b4c4c26f83ee4bbc45a85db1c3c80b5aecdb@intel.com","name":"Cheng Hao"},"message":"[SQL] Remove the duplicated code\n\nAuthor: Cheng Hao <hao.cheng@intel.com>\n\nCloses #4494 from chenghao-intel/tiny_code_change and squashes the following commits:\n\n450dfe7 [Cheng Hao] remove the duplicated code","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/bd0b5ea708aa5b84adb67c039ec52408289718bb"},{"sha":"ef2f55b97f58fa06acb30e9e0172fb66fba383bc","author":{"email":"461476587780aa9fa5611ea6dc3912c146a91760@databricks.com","name":"Joseph K. Bradley"},"message":"[SPARK-5597][MLLIB] save/load for decision trees and emsembles\n\nThis is based on #4444 from jkbradley with the following changes:\n\n1. Node schema updated to\n   ~~~\ntreeId: int\nnodeId: Int\npredict/\n       |- predict: Double\n       |- prob: Double\nimpurity: Double\nisLeaf: Boolean\nsplit/\n     |- feature: Int\n     |- threshold: Double\n     |- featureType: Int\n     |- categories: Array[Double]\nleftNodeId: Integer\nrightNodeId: Integer\ninfoGain: Double\n~~~\n\n2. Some refactor of the implementation.\n\nCloses #4444.\n\nAuthor: Joseph K. Bradley <joseph@databricks.com>\nAuthor: Xiangrui Meng <meng@databricks.com>\n\nCloses #4493 from mengxr/SPARK-5597 and squashes the following commits:\n\n75e3bb6 [Xiangrui Meng] fix style\n2b0033d [Xiangrui Meng] update tree export schema and refactor the implementation\n45873a2 [Joseph K. Bradley] org imports\n1d4c264 [Joseph K. Bradley] Added save/load for tree ensembles\ndcdbf85 [Joseph K. Bradley] added save/load for decision tree but need to generalize it to ensembles","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/ef2f55b97f58fa06acb30e9e0172fb66fba383bc"},{"sha":"c15134632e74e3dee05eda20c6ef79915e15d02e","author":{"email":"4330a85689689e23b81e88bdf5853b25c33529eb@gmail.com","name":"Tathagata Das"},"message":"[SPARK-4964][Streaming][Kafka] More updates to Exactly-once Kafka stream\n\nChanges\n- Added example\n- Added a critical unit test that verifies that offset ranges can be recovered through checkpoints\n\nMight add more changes.\n\nAuthor: Tathagata Das <tathagata.das1565@gmail.com>\n\nCloses #4384 from tdas/new-kafka-fixes and squashes the following commits:\n\n7c931c3 [Tathagata Das] Small update\n3ed9284 [Tathagata Das] updated scala doc\n83d0402 [Tathagata Das] Added JavaDirectKafkaWordCount example.\n26df23c [Tathagata Das] Updates based on PR comments from Cody\ne4abf69 [Tathagata Das] Scala doc improvements and stuff.\nbb65232 [Tathagata Das] Fixed test bug and refactored KafkaStreamSuite\n50f2b56 [Tathagata Das] Added Java API and added more Scala and Java unit tests. Also updated docs.\ne73589c [Tathagata Das] Minor changes.\n4986784 [Tathagata Das] Added unit test to kafka offset recovery\n6a91cab [Tathagata Das] Added example","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/c15134632e74e3dee05eda20c6ef79915e15d02e"},{"sha":"2d1e916730492f5d61b97da6c483d3223ca44315","author":{"email":"291c18f3fb7528c712d9098b0e50a515ea0b91d5@cloudera.com","name":"Sean Owen"},"message":"SPARK-5239 [CORE] JdbcRDD throws \"java.lang.AbstractMethodError: oracle.jdbc.driver.xxxxxx.isClosed()Z\"\n\nThis is a completion of https://github.com/apache/spark/pull/4033 which was withdrawn for some reason.\n\nAuthor: Sean Owen <sowen@cloudera.com>\n\nCloses #4470 from srowen/SPARK-5239.2 and squashes the following commits:\n\n2398bde [Sean Owen] Avoid use of JDBC4-only isClosed()","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/2d1e916730492f5d61b97da6c483d3223ca44315"},{"sha":"ba667935f8670293f10b8bbe1e317b28d00f9875","author":{"email":"e6f14efef9fae0ae8f92d04007faea68035873ce@databricks.com","name":"Cheng Lian"},"message":"[SPARK-5700] [SQL] [Build] Bumps jets3t to 0.9.3 for hadoop-2.3 and hadoop-2.4 profiles\n\nThis is a follow-up PR for #4454 and #4484. JetS3t 0.9.2 contains a log4j.properties file inside the artifact and breaks our tests (see SPARK-5696). This is fixed in 0.9.3.\n\nThis PR also reverts hotfix changes introduced in #4484. The reason is that asking users to configure HiveThriftServer2 logging configurations in hive-log4j.properties can be unintuitive.\n\n<!-- Reviewable:start -->\n[<img src=\"https://reviewable.io/review_button.png\" height=40 alt=\"Review on Reviewable\"/>](https://reviewable.io/reviews/apache/spark/4499)\n<!-- Reviewable:end -->\n\nAuthor: Cheng Lian <lian@databricks.com>\n\nCloses #4499 from liancheng/spark-5700 and squashes the following commits:\n\n4f020c7 [Cheng Lian] Bumps jets3t to 0.9.3 for hadoop-2.3 and hadoop-2.4 profiles","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/ba667935f8670293f10b8bbe1e317b28d00f9875"},{"sha":"50820f15277187e8522520a3ecae412abbdb4397","author":{"email":"fbfd45890515f7eeeeabf87d7a80d3449c3bce83@gmail.com","name":"Nicholas Chammas"},"message":"[SPARK-1805] [EC2] Validate instance types\n\nAddresses [SPARK-1805](https://issues.apache.org/jira/browse/SPARK-1805), though doesn't resolve it completely.\n\nError out quickly if the user asks for the master and slaves to have different AMI virtualization types, since we don't currently support that.\n\nIn addition to that, we print warnings if the inputted instance types are not recognized, though I would prefer if we errored out. Elsewhere in the script it seems [we allow unrecognized instance types](https://github.com/apache/spark/blob/5de14cc2763a8211f77eeb55940dec025822eb78/ec2/spark_ec2.py#L331), though I think we should remove that.\n\nIt's messy, but it should serve us until we enhance spark-ec2 to support clusters with mixed virtualization types.\n\nAuthor: Nicholas Chammas <nicholas.chammas@gmail.com>\n\nCloses #4455 from nchammas/ec2-master-slave-different-virtualization and squashes the following commits:\n\nce28609 [Nicholas Chammas] fix style\nb0adba0 [Nicholas Chammas] validate input instance types","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/50820f15277187e8522520a3ecae412abbdb4397"},{"sha":"6cc96cf0c3ea87ab65d42a59725959d94701577b","author":{"email":"3eee11d4204d9764c5a539ae812edcb2c713bb90@126.com","name":"JqueryFan"},"message":"[Spark-5717] [MLlib] add stop and reorganize import\n\nTrivial. add sc stop and reorganize import\nhttps://issues.apache.org/jira/browse/SPARK-5717\n\nAuthor: JqueryFan <firing@126.com>\nAuthor: Yuhao Yang <hhbyyh@gmail.com>\n\nCloses #4503 from hhbyyh/scstop and squashes the following commits:\n\n7837a2c [JqueryFan] revert import change\n2e85cc1 [Yuhao Yang] add stop and reorganize import","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/6cc96cf0c3ea87ab65d42a59725959d94701577b"},{"sha":"c7ad80ae4256c88e380e7488d48cf6eb14a92d76","author":{"email":"c2bf8a29ab4e9ca2b842ca45622f95cb9164f566@intel.com","name":"Daoyuan Wang"},"message":"[SPARK-5716] [SQL] Support TOK_CHARSETLITERAL in HiveQl\n\nAuthor: Daoyuan Wang <daoyuan.wang@intel.com>\n\nCloses #4502 from adrian-wang/utf8 and squashes the following commits:\n\n4d7b0ee [Daoyuan Wang] remove useless import\n606f981 [Daoyuan Wang] support TOK_CHARSETLITERAL in HiveQl","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/c7ad80ae4256c88e380e7488d48cf6eb14a92d76"},{"sha":"69bc3bb6cffe82aee5ecd0b09410a847ba486b15","author":{"email":"5673041ad99da73cfefa170a7081c0daed5d97b6@cloudera.com","name":"Sandy Ryza"},"message":"SPARK-4136. Under dynamic allocation, cancel outstanding executor requests when no longer needed\n\nThis takes advantage of the changes made in SPARK-4337 to cancel pending requests to YARN when they are no longer needed.\n\nEach time the timer in `ExecutorAllocationManager` strikes, we compute `maxNumNeededExecutors`, the maximum number of executors we could fill with the current load.  This is calculated as the total number of running and pending tasks divided by the number of cores per executor.  If `maxNumNeededExecutors` is below the total number of running and pending executors, we call `requestTotalExecutors(maxNumNeededExecutors)` to let the cluster manager know that it should cancel any pending requests above this amount.  If not, `maxNumNeededExecutors` is just used as a bound in alongside the configured `maxExecutors` to limit the number of new requests.\n\nThe patch modifies the API exposed by `ExecutorAllocationClient` for requesting additional executors by moving from `requestExecutors` to `requestTotalExecutors`.  This makes the communication between the `ExecutorAllocationManager` and the `YarnAllocator` easier to reason about and removes some state that needed to be kept in the `CoarseGrainedSchedulerBackend`.  I think an argument can be made that this makes for a less attractive user-facing API in `SparkContext`, but I'm having trouble envisioning situations where a user would want to use either of these APIs.\n\nThis will likely break some tests, but I wanted to get feedback on the approach before adding tests and polishing.\n\nAuthor: Sandy Ryza <sandy@cloudera.com>\n\nCloses #4168 from sryza/sandy-spark-4136 and squashes the following commits:\n\n37ce77d [Sandy Ryza] Warn on negative number\ncd3b2ff [Sandy Ryza] SPARK-4136","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/69bc3bb6cffe82aee5ecd0b09410a847ba486b15"},{"sha":"b640c841fca92bb0bca77267db2965ff8f79586f","author":{"email":"02e0a999c50b1f88df7a8f5a04e1b76b35ea6a88@databricks.com","name":"Andrew Or"},"message":"[HOTFIX][SPARK-4136] Fix compilation and tests","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/b640c841fca92bb0bca77267db2965ff8f79586f"},{"sha":"59272dad77eb95c5ae8e0652e00d02a2675cda53","author":{"email":"f98b0bead8ca0151df080a83631a6c2556256922@huawei.com","name":"wangfei"},"message":"[SPARK-5592][SQL] java.net.URISyntaxException when insert data to a partitioned table\n\nflowing sql get URISyntaxException:\n```\ncreate table sc as select *\nfrom (select '2011-01-11', '2011-01-11+14:18:26' from src tablesample (1 rows)\nunion all\nselect '2011-01-11', '2011-01-11+15:18:26' from src tablesample (1 rows)\nunion all\nselect '2011-01-11', '2011-01-11+16:18:26' from src tablesample (1 rows) ) s;\ncreate table sc_part (key string) partitioned by (ts string) stored as rcfile;\nset hive.exec.dynamic.partition=true;\nset hive.exec.dynamic.partition.mode=nonstrict;\ninsert overwrite table sc_part partition(ts) select * from sc;\n```\njava.net.URISyntaxException: Relative path in absolute URI: ts=2011-01-11+15:18:26\nat org.apache.hadoop.fs.Path.initialize(Path.java:206)\nat org.apache.hadoop.fs.Path.<init>(Path.java:172)\nat org.apache.hadoop.fs.Path.<init>(Path.java:94)\nat org.apache.spark.sql.hive.SparkHiveDynamicPartitionWriterContainer.org$apache$spark$sql$hive$SparkHiveDynamicPartitionWriterContainer$$newWriter$1(hiveWriterContainers.scala:230)\nat org.apache.spark.sql.hive.SparkHiveDynamicPartitionWriterContainer$$anonfun$getLocalFileWriter$1.apply(hiveWriterContainers.scala:243)\nat org.apache.spark.sql.hive.SparkHiveDynamicPartitionWriterContainer$$anonfun$getLocalFileWriter$1.apply(hiveWriterContainers.scala:243)\nat scala.collection.mutable.MapLike$class.getOrElseUpdate(MapLike.scala:189)\nat scala.collection.mutable.AbstractMap.getOrElseUpdate(Map.scala:91)\nat org.apache.spark.sql.hive.SparkHiveDynamicPartitionWriterContainer.getLocalFileWriter(hiveWriterContainers.scala:243)\nat org.apache.spark.sql.hive.execution.InsertIntoHiveTable$$anonfun$org$apache$spark$sql$hive$execution$InsertIntoHiveTable$$writeToFile$1$1.apply(InsertIntoHiveTable.scala:113)\nat org.apache.spark.sql.hive.execution.InsertIntoHiveTable$$anonfun$org$apache$spark$sql$hive$execution$InsertIntoHiveTable$$writeToFile$1$1.apply(InsertIntoHiveTable.scala:105)\nat scala.collection.Iterator$class.foreach(Iterator.scala:727)\nat scala.collection.AbstractIterator.foreach(Iterator.scala:1157)\nat org.apache.spark.sql.hive.execution.InsertIntoHiveTable.org$apache$spark$sql$hive$execution$InsertIntoHiveTable$$writeToFile$1(InsertIntoHiveTable.scala:105)\nat org.apache.spark.sql.hive.execution.InsertIntoHiveTable$$anonfun$saveAsHiveFile$3.apply(InsertIntoHiveTable.scala:87)\nat org.apache.spark.sql.hive.execution.InsertIntoHiveTable$$anonfun$saveAsHiveFile$3.apply(InsertIntoHiveTable.scala:87)\nat org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)\nat org.apache.spark.scheduler.Task.run(Task.scala:64)\nat org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:194)\nat java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)\nat java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)\nat java.lang.Thread.run(Thread.java:722)\nCaused by: java.net.URISyntaxException: Relative path in absolute URI: ts=2011-01-11+15:18:26\nat java.net.URI.checkPath(URI.java:1804)\nat java.net.URI.<init>(URI.java:752)\nat org.apache.hadoop.fs.Path.initialize(Path.java:203)\n\nAuthor: wangfei <wangfei1@huawei.com>\nAuthor: Fei Wang <wangfei1@huawei.com>\n\nCloses #4368 from scwf/SPARK-5592 and squashes the following commits:\n\naa55ef4 [Fei Wang] comments addressed\nf8f8bb1 [wangfei] added test case\nf24624f [wangfei] Merge branch 'master' of https://github.com/apache/spark into SPARK-5592\n9998177 [wangfei] added test case\nea81daf [wangfei] fix URISyntaxException","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/59272dad77eb95c5ae8e0652e00d02a2675cda53"},{"sha":"c49a4049845c91b225e70fd630cdf6ddc055faf8","author":{"email":"a55716a55d5a8b5f127b6b9db0209b1faacc1984@gmail.com","name":"Miguel Peralvo"},"message":"[SPARK-5668] Display region in spark_ec2.py get_existing_cluster()\n\nShow the region for the different messages displayed by get_existing_cluster(): The search, found and error messages.\n\nAuthor: Miguel Peralvo <miguel.peralvo@gmail.com>\n\nCloses #4457 from MiguelPeralvo/patch-2 and squashes the following commits:\n\na5514c8 [Miguel Peralvo] Update spark_ec2.py\n0a837b0 [Miguel Peralvo] Update spark_ec2.py\n3923f36 [Miguel Peralvo] Update spark_ec2.py\n4ecd9f9 [Miguel Peralvo] [SPARK-5668] Display region in spark_ec2.py get_existing_cluster()","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/c49a4049845c91b225e70fd630cdf6ddc055faf8"},{"sha":"de80b1ba4d3c4b1b3316d482d62e4668b996f6ac","author":{"email":"17b9e1c64588c7fa6419b4d29dc1f4426279ba01@databricks.com","name":"Michael Armbrust"},"message":"[SQL] Add toString to DataFrame/Column\n\nAuthor: Michael Armbrust <michael@databricks.com>\n\nCloses #4436 from marmbrus/dfToString and squashes the following commits:\n\n8a3c35f [Michael Armbrust] Merge remote-tracking branch 'origin/master' into dfToString\nb72a81b [Michael Armbrust] add toString","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/de80b1ba4d3c4b1b3316d482d62e4668b996f6ac"},{"sha":"f98707c043f1be9569ec774796edb783132773a8","author":{"email":"f4fb2fdc15585ce98eef9c03d7a86d94a45d60d0@126.com","name":"OopsOutOfMemory"},"message":"[SPARK-5686][SQL] Add show current roles command in HiveQl\n\nshow current roles\n\nAuthor: OopsOutOfMemory <victorshengli@126.com>\n\nCloses #4471 from OopsOutOfMemory/show_current_role and squashes the following commits:\n\n1c6b210 [OopsOutOfMemory] add show current roles","distinct":false,"url":"https://api.github.com/repos/sryza/spark/commits/f98707c043f1be9569ec774796edb783132773a8"}]}