How to get rid of derby.log, metastore_db from Spark Shell
<p>When running <code>spark-shell</code> it creates a file <code>derby.log</code> and a folder <code>metastore_db</code>. How do I configure spark to put these somewhere else?</p>

<p>For derby log I've tried <a href="https://stackoverflow.com/questions/1004327/getting-rid-of-derby-log">Getting rid of derby.log</a> like so <code>spark-shell --driver-memory 10g --conf "-spark.driver.extraJavaOptions=Dderby.stream.info.file=/dev/null"</code> with a couple of different properties but spark ignores them.</p>

<p>Does anyone know how to get rid of these or specify a default directory for them?</p>