Invalidate metadata/refresh imapala from spark code
<p>I'm working on a NRT solution that requires me to frequently update the metadata on an Impala table.</p>

<p>Currently this invalidation is done after my spark code has run.
I would like to speed things up by doing this refresh/invalidate directly from my Spark code.</p>

<p>What would be the most efficient approach?</p>

<ul>
<li>Oozie is just too slow (30 sec overhead? no thanks)</li>
<li>An SSH action to an (edge) node seems like a valid solution but feels "hackish"</li>
<li>I don't see a way to do this from the hive context in Spark either.</li>
</ul>