{"push_id":704445224,"size":3,"distinct_size":0,"ref":"refs/heads/master","head":"412ab9669810921d04f9feabfbeafa906d4de506","before":"079bcd0339f30343c01c5fd3d5521be4b822d30f","commits":[{"sha":"29283b775291bf03cd9a7e1aaa496faaa5757578","author":{"email":"8baa999284405a44df6958c344ec0d51df537ce1@netflix.com","name":"Nezih Yigitbasi"},"message":"PARQUET-314: Fix broken equals implementations\n\nAuthor: Nezih Yigitbasi <nyigitbasi@netflix.com>\n\nCloses #223 from nezihyigitbasi/parquet-fixes and squashes the following commits:\n\n5279e60 [Nezih Yigitbasi] Override Object.equals properly","distinct":false,"url":"https://api.github.com/repos/nezihyigitbasi-nflx/parquet-mr/commits/29283b775291bf03cd9a7e1aaa496faaa5757578"},{"sha":"89321a2dee438328e75a11954e972175c78f0a2a","author":{"email":"8baa999284405a44df6958c344ec0d51df537ce1@netflix.com","name":"Nezih Yigitbasi"},"message":"PARQUET-311: Fix NPE when debug logging metadata\n\nFixes the issue reported at https://issues.apache.org/jira/browse/PARQUET-311\n\nAuthor: Nezih Yigitbasi <nyigitbasi@netflix.com>\n\nCloses #221 from nezihyigitbasi/debug-log-fix and squashes the following commits:\n\n59129ed [Nezih Yigitbasi] PARQUET-311: Fix NPE when debug logging metadata","distinct":false,"url":"https://api.github.com/repos/nezihyigitbasi-nflx/parquet-mr/commits/89321a2dee438328e75a11954e972175c78f0a2a"},{"sha":"412ab9669810921d04f9feabfbeafa906d4de506","author":{"email":"4c9a82ce72ca2519f38d0af0abbb4cecb9fceca9@apache.org","name":"Ryan Blue"},"message":"PARQUET-306: Add row group alignment\n\nThis adds `AlignmentStrategy` to the `ParquetFileWriter` that can alter the position of row groups and recommend a target size for the next row group. There are two strategies: `NoAlignment` and `PaddingAlignment`. Padding alignment is used for HDFS and no alignment is used for all other file systems. When HDFS-3689 is available, we can add a strategy to use that.\n\nThe amount of padding is controlled by a threshold between 0 and 1 that controls the fraction of the row group size that can be padded. This is interpreted as the maximum amount of padding that is acceptable, in terms of the row group size. For example, setting this to 5% will write padding when the bytes left in a HDFS block are less than 5% of the row group size. This defaults to 0%, which prevents padding from being added and matches the current behavior. The threshold is controlled by a new OutputFormat configuration property, `parquet.writer.padding-thresh`.\n\nAuthor: Ryan Blue <blue@apache.org>\n\nCloses #211 from rdblue/PARQUET-306-row-group-alignment and squashes the following commits:\n\n0137ddf [Ryan Blue] PARQUET-306: Add MR test with padding.\n6ce3f08 [Ryan Blue] PARQUET-306: Add parquet.writer.max-padding setting.\nf1dc659 [Ryan Blue] PARQUET-306: Base next row group size on bytes remaining.\nc6a3e97 [Ryan Blue] PARQUET-306: Add AlignmentStrategy to ParquetFileWriter.","distinct":false,"url":"https://api.github.com/repos/nezihyigitbasi-nflx/parquet-mr/commits/412ab9669810921d04f9feabfbeafa906d4de506"}]}