Pyspark: display a spark data frame in a table format
<p>I am using pyspark to read a parquet file like below:</p>

<pre><code>my_df = sqlContext.read.parquet('hdfs://myPath/myDB.db/myTable/**')
</code></pre>

<p>Then when I do <code>my_df.take(5)</code>, it will show <code>[Row(...)]</code>, instead of a table  format like when we use the pandas data frame.</p>

<p>Is it possible to display the data frame in a table format like pandas data frame? Thanks!</p>