Spark on Mesos reading from a secured HDFS cluster
<p>We have deployed Spark on Mesos and we are having problems when we are trying to read from HDFS.
Out of the box we tried using Kerberos, which works fine in local mode, but fails when running on Mesos (even though we made sure that each machine had a valid token).</p>

<p>My question is, what alternatives do we have?</p>

<p>According to <a href="http://www.cloudera.com/documentation/enterprise/5-4-x/topics/sg_spark_auth.html" rel="nofollow">this document</a> the only two options are Kerberos and shared secret, from which Kerberos only works on YARN.
I've not found any article how a shared secret could be set up on HDFS.</p>