Writing Spark dataframe in ORC format with Snappy compression
<p>I am successfull in reading a text file stored in S3 and writing it back to S3 in ORC format using Spark dataframes. - <code>inputDf.write().orc(outputPath);</code><br>
What I am not able to do is convert to ORC format with snappy compression. I already tried giving option while writing as setting the codec to snappy but Spark is still writing as normal ORC. How to achieve writing in ORC format with Snappy compression to S3 using Spark Dataframes?</p>