{"push_id":765245347,"size":215,"distinct_size":215,"ref":"refs/heads/master","head":"907df2fce00d2cbc9fae371344f05f800e0d2726","before":"00b655cced637e1c3b750c19266086b9dcd7c158","commits":[{"sha":"d285212756168200383bf4df2c951bd80a492a7c","author":{"email":"e0984c9e52201d25cb99f6f61136f8d8d13228cd@gmail.com","name":"Mahmoud Lababidi"},"message":"Fixed AtmoicReference<> Example\n\nAuthor: Mahmoud Lababidi <lababidi@gmail.com>\n\nCloses #8076 from lababidi/master and squashes the following commits:\n\naf4553b [Mahmoud Lababidi] Fixed AtmoicReference<> Example","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/d285212756168200383bf4df2c951bd80a492a7c"},{"sha":"0fe66744f16854fc8cd8a72174de93a788e3cf6c","author":{"email":"e5dd8a3899598b2e85930c5ff06b11c053ef654f@databricks.com","name":"Josh Rosen"},"message":"[SPARK-9784] [SQL] Exchange.isUnsafe should check whether codegen and unsafe are enabled\n\nExchange.isUnsafe should check whether codegen and unsafe are enabled.\n\nAuthor: Josh Rosen <joshrosen@databricks.com>\n\nCloses #8073 from JoshRosen/SPARK-9784 and squashes the following commits:\n\n7a1019f [Josh Rosen] [SPARK-9784] Exchange.isUnsafe should check whether codegen and unsafe are enabled","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/0fe66744f16854fc8cd8a72174de93a788e3cf6c"},{"sha":"40ed2af587cedadc6e5249031857a922b3b234ca","author":{"email":"c9d35a384bc579d1c6c8c055f2a2b5c04e11b521@databricks.com","name":"Reynold Xin"},"message":"[SPARK-9763][SQL] Minimize exposure of internal SQL classes.\n\nThere are a few changes in this pull request:\n\n1. Moved all data sources to execution.datasources, except the public JDBC APIs.\n2. In order to maintain backward compatibility from 1, added a backward compatibility translation map in data source resolution.\n3. Moved ui and metric package into execution.\n4. Added more documentation on some internal classes.\n5. Renamed DataSourceRegister.format -> shortName.\n6. Added \"override\" modifier on shortName.\n7. Removed IntSQLMetric.\n\nAuthor: Reynold Xin <rxin@databricks.com>\n\nCloses #8056 from rxin/SPARK-9763 and squashes the following commits:\n\n9df4801 [Reynold Xin] Removed hardcoded name in test cases.\nd9babc6 [Reynold Xin] Shorten.\ne484419 [Reynold Xin] Removed VisibleForTesting.\n171b812 [Reynold Xin] MimaExcludes.\n2041389 [Reynold Xin] Compile ...\n79dda42 [Reynold Xin] Compile.\n0818ba3 [Reynold Xin] Removed IntSQLMetric.\nc46884f [Reynold Xin] Two more fixes.\nf9aa88d [Reynold Xin] [SPARK-9763][SQL] Minimize exposure of internal SQL classes.","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/40ed2af587cedadc6e5249031857a922b3b234ca"},{"sha":"fe2fb7fb7189d183a4273ad27514af4b6b461f26","author":{"email":"c437f8b7af73b0a10ecac061712ff9de6d41089e@databricks.com","name":"Davies Liu"},"message":"[SPARK-9620] [SQL] generated UnsafeProjection should support many columns or large exressions\n\nCurrently, generated UnsafeProjection can reach 64k byte code limit of Java. This patch will split the generated expressions into multiple functions, to avoid the limitation.\n\nAfter this patch, we can work well with table that have up to 64k columns (hit max number of constants limit in Java), it should be enough in practice.\n\ncc rxin\n\nAuthor: Davies Liu <davies@databricks.com>\n\nCloses #8044 from davies/wider_table and squashes the following commits:\n\n9192e6c [Davies Liu] fix generated safe projection\nd1ef81a [Davies Liu] fix failed tests\n737b3d3 [Davies Liu] Merge branch 'master' of github.com:apache/spark into wider_table\nffcd132 [Davies Liu] address comments\n1b95be4 [Davies Liu] put the generated class into sql package\n77ed72d [Davies Liu] address comments\n4518e17 [Davies Liu] Merge branch 'master' of github.com:apache/spark into wider_table\n75ccd01 [Davies Liu] Merge branch 'master' of github.com:apache/spark into wider_table\n495e932 [Davies Liu] support wider table with more than 1k columns for generated projections","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/fe2fb7fb7189d183a4273ad27514af4b6b461f26"},{"sha":"c4fd2a242228ee101904770446e3f37d49e39b76","author":{"email":"c437f8b7af73b0a10ecac061712ff9de6d41089e@databricks.com","name":"Davies Liu"},"message":"[SPARK-9759] [SQL] improve decimal.times() and cast(int, decimalType)\n\nThis patch optimize two things:\n\n1. passing MathContext to JavaBigDecimal.multiply/divide/reminder to do right rounding, because java.math.BigDecimal.apply(MathContext) is expensive\n\n2. Cast integer/short/byte to decimal directly (without double)\n\nThis two optimizations could speed up the end-to-end time of a aggregation (SUM(short * decimal(5, 2)) 75% (from 19s -> 10.8s)\n\nAuthor: Davies Liu <davies@databricks.com>\n\nCloses #8052 from davies/optimize_decimal and squashes the following commits:\n\n225efad [Davies Liu] improve decimal.times() and cast(int, decimalType)","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/c4fd2a242228ee101904770446e3f37d49e39b76"},{"sha":"853809e948e7c5092643587a30738115b6591a59","author":{"email":"4d83797f2913b0167869e81a5d7642fb164905eb@gmail.com","name":"Prabeesh K"},"message":"[SPARK-5155] [PYSPARK] [STREAMING] Mqtt streaming support in Python\n\nThis PR is based on #4229, thanks prabeesh.\n\nCloses #4229\n\nAuthor: Prabeesh K <prabsmails@gmail.com>\nAuthor: zsxwing <zsxwing@gmail.com>\nAuthor: prabs <prabsmails@gmail.com>\nAuthor: Prabeesh K <prabeesh.k@namshi.com>\n\nCloses #7833 from zsxwing/pr4229 and squashes the following commits:\n\n9570bec [zsxwing] Fix the variable name and check null in finally\n4a9c79e [zsxwing] Fix pom.xml indentation\nabf5f18 [zsxwing] Merge branch 'master' into pr4229\n935615c [zsxwing] Fix the flaky MQTT tests\n47278c5 [zsxwing] Include the project class files\n478f844 [zsxwing] Add unpack\n5f8a1d4 [zsxwing] Make the maven build generate the test jar for Python MQTT tests\n734db99 [zsxwing] Merge branch 'master' into pr4229\n126608a [Prabeesh K] address the comments\nb90b709 [Prabeesh K] Merge pull request #1 from zsxwing/pr4229\nd07f454 [zsxwing] Register StreamingListerner before starting StreamingContext; Revert unncessary changes; fix the python unit test\na6747cb [Prabeesh K] wait for starting the receiver before publishing data\n87fc677 [Prabeesh K] address the comments:\n97244ec [zsxwing] Make sbt build the assembly test jar for streaming mqtt\n80474d1 [Prabeesh K] fix\n1f0cfe9 [Prabeesh K] python style fix\ne1ee016 [Prabeesh K] scala style fix\na5a8f9f [Prabeesh K] added Python test\n9767d82 [Prabeesh K] implemented Python-friendly class\na11968b [Prabeesh K] fixed python style\n795ec27 [Prabeesh K] address comments\nee387ae [Prabeesh K] Fix assembly jar location of mqtt-assembly\n3f4df12 [Prabeesh K] updated version\nb34c3c1 [prabs] adress comments\n3aa7fff [prabs] Added Python streaming mqtt word count example\nb7d42ff [prabs] Mqtt streaming support in Python","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/853809e948e7c5092643587a30738115b6591a59"},{"sha":"3c9802d9400bea802984456683b2736a450ee17e","author":{"email":"31941077bc2dc649090f9784590d63cfb9405571@gmail.com","name":"Hao Zhu"},"message":"[SPARK-9801] [STREAMING] Check if file exists before deleting temporary files.\n\nSpark streaming deletes the temp file and backup files without checking if they exist or not\n\nAuthor: Hao Zhu <viadeazhu@gmail.com>\n\nCloses #8082 from viadea/master and squashes the following commits:\n\n242d05f [Hao Zhu] [SPARK-9801][Streaming]No need to check the existence of those files\nfd143f2 [Hao Zhu] [SPARK-9801][Streaming]Check if backupFile exists before deleting backupFile files.\n087daf0 [Hao Zhu] SPARK-9801","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/3c9802d9400bea802984456683b2736a450ee17e"},{"sha":"071bbad5db1096a548c886762b611a8484a52753","author":{"email":"b525b83e0aa3759299c6e560e5a79ce7796a6261@gmail.com","name":"Damian Guy"},"message":"[SPARK-9340] [SQL] Fixes converting unannotated Parquet lists\n\nThis PR is inspired by #8063 authored by dguy. Especially, testing Parquet files added here are all taken from that PR.\n\n**Committer who merges this PR should attribute it to \"Damian Guy <damian.guygmail.com>\".**\n\n----\n\nSPARK-6776 and SPARK-6777 followed `parquet-avro` to implement backwards-compatibility rules defined in `parquet-format` spec. However, both Spark SQL and `parquet-avro` neglected the following statement in `parquet-format`:\n\n> This does not affect repeated fields that are not annotated: A repeated field that is neither contained by a `LIST`- or `MAP`-annotated group nor annotated by `LIST` or `MAP` should be interpreted as a required list of required elements where the element type is the type of the field.\n\nOne of the consequences is that, Parquet files generated by `parquet-protobuf` containing unannotated repeated fields are not correctly converted to Catalyst arrays.\n\nThis PR fixes this issue by\n\n1. Handling unannotated repeated fields in `CatalystSchemaConverter`.\n2. Converting this kind of special repeated fields to Catalyst arrays in `CatalystRowConverter`.\n\n   Two special converters, `RepeatedPrimitiveConverter` and `RepeatedGroupConverter`, are added. They delegate actual conversion work to a child `elementConverter` and accumulates elements in an `ArrayBuffer`.\n\n   Two extra methods, `start()` and `end()`, are added to `ParentContainerUpdater`. So that they can be used to initialize new `ArrayBuffer`s for unannotated repeated fields, and propagate converted array values to upstream.\n\nAuthor: Cheng Lian <lian@databricks.com>\n\nCloses #8070 from liancheng/spark-9340/unannotated-parquet-list and squashes the following commits:\n\nace6df7 [Cheng Lian] Moves ParquetProtobufCompatibilitySuite\nf1c7bfd [Cheng Lian] Updates .rat-excludes\n420ad2b [Cheng Lian] Fixes converting unannotated Parquet lists","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/071bbad5db1096a548c886762b611a8484a52753"},{"sha":"91e9389f39509e63654bd4bcb7bd919eaedda910","author":{"email":"e5dd8a3899598b2e85930c5ff06b11c053ef654f@databricks.com","name":"Josh Rosen"},"message":"[SPARK-9729] [SPARK-9363] [SQL] Use sort merge join for left and right outer join\n\nThis patch adds a new `SortMergeOuterJoin` operator that performs left and right outer joins using sort merge join.  It also refactors `SortMergeJoin` in order to improve performance and code clarity.\n\nAlong the way, I also performed a couple pieces of minor cleanup and optimization:\n\n- Rename the `HashJoin` physical planner rule to `EquiJoinSelection`, since it's also used for non-hash joins.\n- Rewrite the comment at the top of `HashJoin` to better explain the precedence for choosing join operators.\n- Update `JoinSuite` to use `SqlTestUtils.withConf` for changing SQLConf settings.\n\nThis patch incorporates several ideas from adrian-wang's patch, #5717.\n\nCloses #5717.\n\n<!-- Reviewable:start -->\n[<img src=\"https://reviewable.io/review_button.png\" height=40 alt=\"Review on Reviewable\"/>](https://reviewable.io/reviews/apache/spark/7904)\n<!-- Reviewable:end -->\n\nAuthor: Josh Rosen <joshrosen@databricks.com>\nAuthor: Daoyuan Wang <daoyuan.wang@intel.com>\n\nCloses #7904 from JoshRosen/outer-join-smj and squashes 1 commits.","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/91e9389f39509e63654bd4bcb7bd919eaedda910"},{"sha":"0f90d6055e5bea9ceb1d454db84f4aa1d59b284d","author":{"email":"4330a85689689e23b81e88bdf5853b25c33529eb@gmail.com","name":"Tathagata Das"},"message":"[SPARK-9640] [STREAMING] [TEST] Do not run Python Kinesis tests when the Kinesis assembly JAR has not been generated\n\nAuthor: Tathagata Das <tathagata.das1565@gmail.com>\n\nCloses #7961 from tdas/SPARK-9640 and squashes the following commits:\n\n974ce19 [Tathagata Das] Undo changes related to SPARK-9727\n004ae26 [Tathagata Das] style fixes\n9bbb97d [Tathagata Das] Minor style fies\ne6a677e [Tathagata Das] Merge remote-tracking branch 'apache-github/master' into SPARK-9640\nca90719 [Tathagata Das] Removed extra line\nba9cfc7 [Tathagata Das] Improved kinesis test selection logic\n88d59bd [Tathagata Das] updated test modules\n871fcc8 [Tathagata Das] Fixed SparkBuild\n94be631 [Tathagata Das] Fixed style\nb858196 [Tathagata Das] Fixed conditions and few other things based on PR comments.\ne292e64 [Tathagata Das] Added filters for Kinesis python tests","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/0f90d6055e5bea9ceb1d454db84f4aa1d59b284d"},{"sha":"55752d88321925da815823f968128832de6fdbbb","author":{"email":"c9d35a384bc579d1c6c8c055f2a2b5c04e11b521@databricks.com","name":"Reynold Xin"},"message":"[SPARK-9810] [BUILD] Remove individual commit messages from the squash commit message\n\nFor more information, please see the JIRA ticket and the associated dev list discussion.\n\nhttps://issues.apache.org/jira/browse/SPARK-9810\n\nhttp://apache-spark-developers-list.1001551.n3.nabble.com/discuss-Removing-individual-commit-messages-from-the-squash-commit-message-td13295.html\n\nAuthor: Reynold Xin <rxin@databricks.com>\n\nCloses #8091 from rxin/SPARK-9810.","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/55752d88321925da815823f968128832de6fdbbb"},{"sha":"600031ebe27473d8fffe6ea436c2149223b82896","author":{"email":"4330a85689689e23b81e88bdf5853b25c33529eb@gmail.com","name":"Tathagata Das"},"message":"[SPARK-9727] [STREAMING] [BUILD] Updated streaming kinesis SBT project name to be more consistent\n\nAuthor: Tathagata Das <tathagata.das1565@gmail.com>\n\nCloses #8092 from tdas/SPARK-9727 and squashes the following commits:\n\nb1b01fd [Tathagata Das] Updated streaming kinesis project name","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/600031ebe27473d8fffe6ea436c2149223b82896"},{"sha":"d378396f86f625f006738d87fe5dbc2ff8fd913d","author":{"email":"c9d35a384bc579d1c6c8c055f2a2b5c04e11b521@databricks.com","name":"Reynold Xin"},"message":"[SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform.\n\nPlatformDependent.UNSAFE is way too verbose.\n\nAuthor: Reynold Xin <rxin@databricks.com>\n\nCloses #8094 from rxin/SPARK-9815 and squashes the following commits:\n\n229b603 [Reynold Xin] [SPARK-9815] Rename PlatformDependent.UNSAFE -> Platform.","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/d378396f86f625f006738d87fe5dbc2ff8fd913d"},{"sha":"dfe347d2cae3eb05d7539aaf72db3d309e711213","author":{"email":"e5dd8a3899598b2e85930c5ff06b11c053ef654f@databricks.com","name":"Josh Rosen"},"message":"[SPARK-9785] [SQL] HashPartitioning compatibility should consider expression ordering\n\nHashPartitioning compatibility is currently defined w.r.t the _set_ of expressions, but the ordering of those expressions matters when computing hash codes; this could lead to incorrect answers if we mistakenly avoided a shuffle based on the assumption that HashPartitionings with the same expressions in different orders will produce equivalent row hashcodes. The first commit adds a regression test which illustrates this problem.\n\nThe fix for this is simple: make `HashPartitioning.compatibleWith` and `HashPartitioning.guarantees` sensitive to the expression ordering (i.e. do not perform set comparison).\n\nAuthor: Josh Rosen <joshrosen@databricks.com>\n\nCloses #8074 from JoshRosen/hashpartitioning-compatiblewith-fixes and squashes the following commits:\n\nb61412f [Josh Rosen] Demonstrate that I haven't cheated in my fix\n0b4d7d9 [Josh Rosen] Update so that clusteringSet is only used in satisfies().\ndc9c9d7 [Josh Rosen] Add failing regression test for SPARK-9785","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/dfe347d2cae3eb05d7539aaf72db3d309e711213"},{"sha":"bce72797f3499f14455722600b0d0898d4fd87c9","author":{"email":"ced9a24e2e494bb60341a9f26a61a78e7a11abad@apache.org","name":"Jeff Zhang"},"message":"Fix comment error\n\nAPI is updated but its doc comment is not updated.\n\nAuthor: Jeff Zhang <zjffdu@apache.org>\n\nCloses #8097 from zjffdu/dev.","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/bce72797f3499f14455722600b0d0898d4fd87c9"},{"sha":"8cad854ef6a2066de5adffcca6b79a205ccfd5f3","author":{"email":"452ae006f36be6c70342f33f64bb6f6eb552689c@gmail.com","name":"Yanbo Liang"},"message":"[SPARK-8345] [ML] Add an SQL node as a feature transformer\n\nImplements the transforms which are defined by SQL statement.\nCurrently we only support SQL syntax like 'SELECT ... FROM __THIS__'\nwhere '__THIS__' represents the underlying table of the input dataset.\n\nAuthor: Yanbo Liang <ybliang8@gmail.com>\n\nCloses #7465 from yanboliang/spark-8345 and squashes the following commits:\n\nb403fcb [Yanbo Liang] address comments\n0d4bb15 [Yanbo Liang] a better transformSchema() implementation\n51eb9e7 [Yanbo Liang] Add an SQL node as a feature transformer","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/8cad854ef6a2066de5adffcca6b79a205ccfd5f3"},{"sha":"dbd778d84d094ca142bc08c351478595b280bc2a","author":{"email":"6be69bb5cf6cb8dd624e7f174d5aba3c49eb4343@pigscanfly.ca","name":"Holden Karau"},"message":"[SPARK-8764] [ML] string indexer should take option to handle unseen values\n\nAs a precursor to adding a public constructor add an option to handle unseen values by skipping rather than throwing an exception (default remains throwing an exception),\n\nAuthor: Holden Karau <holden@pigscanfly.ca>\n\nCloses #7266 from holdenk/SPARK-8764-string-indexer-should-take-option-to-handle-unseen-values and squashes the following commits:\n\n38a4de9 [Holden Karau] fix long line\n045bf22 [Holden Karau] Add a second b entry so b gets 0 for sure\n81dd312 [Holden Karau] Update the docs for handleInvalid param to be more descriptive\n7f37f6e [Holden Karau] remove extra space (scala style)\n414e249 [Holden Karau] And switch to using handleInvalid instead of skipInvalid\n1e53f9b [Holden Karau] update the param (codegen side)\n7a22215 [Holden Karau] fix typo\n100a39b [Holden Karau] Merge in master\naa5b093 [Holden Karau] Since we filter we should never go down this code path if getSkipInvalid is true\n75ffa69 [Holden Karau] Remove extra newline\nd69ef5e [Holden Karau] Add a test\nb5734be [Holden Karau] Add support for unseen labels\nafecd4e [Holden Karau] Add a param to skip invalid entries.","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/dbd778d84d094ca142bc08c351478595b280bc2a"},{"sha":"5b8bb1b213b8738f563fcd00747604410fbb3087","author":{"email":"4330a85689689e23b81e88bdf5853b25c33529eb@gmail.com","name":"Tathagata Das"},"message":"[SPARK-9572] [STREAMING] [PYSPARK] Added StreamingContext.getActiveOrCreate() in Python\n\nAuthor: Tathagata Das <tathagata.das1565@gmail.com>\n\nCloses #8080 from tdas/SPARK-9572 and squashes the following commits:\n\n64a231d [Tathagata Das] Fix based on comments\n741a0d0 [Tathagata Das] Fixed style\nf4f094c [Tathagata Das] Tweaked test\n9afcdbe [Tathagata Das] Merge remote-tracking branch 'apache-github/master' into SPARK-9572\ne21488d [Tathagata Das] Minor update\n1a371d9 [Tathagata Das] Addressed comments.\n60479da [Tathagata Das] Fixed indent\n9c2da9c [Tathagata Das] Fixed bugs\nb5bd32c [Tathagata Das] Merge remote-tracking branch 'apache-github/master' into SPARK-9572\nb55b348 [Tathagata Das] Removed prints\n5781728 [Tathagata Das] Fix style issues\nb711214 [Tathagata Das] Reverted run-tests.py\n643b59d [Tathagata Das] Revert unnecessary change\n150e58c [Tathagata Das] Added StreamingContext.getActiveOrCreate() in Python","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/5b8bb1b213b8738f563fcd00747604410fbb3087"},{"sha":"5831294a7a8fa2524133c5d718cbc8187d2b0620","author":{"email":"5d14e010a5b345b784fd604efcc6cebb79f97468@gmail.com","name":"zsxwing"},"message":"[SPARK-9646] [SQL] Add metrics for all join and aggregate operators\n\nThis PR added metrics for all join and aggregate operators. However, I found the metrics may be confusing in the following two case:\n1. The iterator is not totally consumed and the metric values will be less.\n2. Recreating the iterators will make metric values look bigger than the size of the input source, such as `CartesianProduct`.\n\nAuthor: zsxwing <zsxwing@gmail.com>\n\nCloses #8060 from zsxwing/sql-metrics and squashes the following commits:\n\n40f3fc1 [zsxwing] Mark LongSQLMetric private[metric] to avoid using incorrectly and leak memory\nb1b9071 [zsxwing] Merge branch 'master' into sql-metrics\n4bef25a [zsxwing] Add metrics for SortMergeOuterJoin\n95ccfc6 [zsxwing] Merge branch 'master' into sql-metrics\n67cb4dd [zsxwing] Add metrics for Project and TungstenProject; remove metrics from PhysicalRDD and LocalTableScan\n0eb47d4 [zsxwing] Merge branch 'master' into sql-metrics\ndd9d932 [zsxwing] Avoid creating new Iterators\n589ea26 [zsxwing] Add metrics for all join and aggregate operators","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/5831294a7a8fa2524133c5d718cbc8187d2b0620"},{"sha":"520ad44b17f72e6465bf990f64b4e289f8a83447","author":{"email":"9835e449f9a666ddd8ba8aeb460af39a5130691b@databricks.com","name":"Feynman Liang"},"message":"[SPARK-9750] [MLLIB] Improve equals on SparseMatrix and DenseMatrix\n\nAdds unit test for `equals` on `mllib.linalg.Matrix` class and `equals` to both `SparseMatrix` and `DenseMatrix`. Supports equality testing between `SparseMatrix` and `DenseMatrix`.\n\nmengxr\n\nAuthor: Feynman Liang <fliang@databricks.com>\n\nCloses #8042 from feynmanliang/SPARK-9750 and squashes the following commits:\n\nbb70d5e [Feynman Liang] Breeze compare for dense matrices as well, in case other is sparse\nab6f3c8 [Feynman Liang] Sparse matrix compare for equals\n22782df [Feynman Liang] Add equality based on matrix semantics, not representation\n78f9426 [Feynman Liang] Add casts\n43d28fa [Feynman Liang] Fix failing test\n6416fa0 [Feynman Liang] Add failing sparse matrix equals tests","distinct":true,"url":"https://api.github.com/repos/rakeshchalasani/spark/commits/520ad44b17f72e6465bf990f64b4e289f8a83447"}]}