Spark SQL: INSERT INTO statement syntax
<p>While reading the <a href="https://docs.datastax.com/en/latest-dse/datastax_enterprise/spark/sparkSqlSupportedSyntax.html" rel="noreferrer">Datastax docs</a> for supported syntax of Spark SQL, I noticed you can use <code>INSERT</code> statements like you would normally do:</p>

<pre><code>INSERT INTO hello (someId,name) VALUES (1,"hello")
</code></pre>

<p>Testing this out in a Spark 2.0 (Python) environment and a connection to a Mysql database, throws the error:</p>

<pre><code>File "/home/yawn/spark-2.0.0-bin-hadoop2.7/python/lib/pyspark.zip/pyspark/sql/utils.py", line 73, in deco
pyspark.sql.utils.ParseException: 
u'\nmismatched input \'someId\' expecting {\'(\', \'SELECT\', \'FROM\', \'VALUES\', \'TABLE\', \'INSERT\', \'MAP\', \'REDUCE\'}(line 1, pos 19)\n\n== SQL ==\nINSERT INTO hello (someId,name) VALUES (1,"hello")\n-------------------^^^\n'
</code></pre>

<p>However if I remove the explicit column definition, it works as expected:</p>

<pre><code>INSERT INTO hello VALUES (1,"hello")
</code></pre>

<p>Am I missing something?</p>