How to add custom description to Spark Job for displaying in Spark Web UI
<p>When we submit application to Spark, and after performing any operation Spark Web UI displays Job and Stages like <code>count at MyJob.scala:15</code>. But in my application there are multiple <code>count</code> and <code>save</code> operations are there. So it is very difficult to understand UI. Instead of <code>count at MyJob.scala:15</code>, can we add custom description to give more detailed information to job.</p>

<p>While googling found <a href="https://issues.apache.org/jira/browse/SPARK-3468" rel="noreferrer">https://issues.apache.org/jira/browse/SPARK-3468</a> and <a href="https://github.com/apache/spark/pull/2342" rel="noreferrer">https://github.com/apache/spark/pull/2342</a>, author attached <a href="https://cloud.githubusercontent.com/assets/4736016/6936886/e35fd582-d891-11e4-980d-8de13f50e442.png" rel="noreferrer">image</a>, with detailed description like 'Count', 'Cache and Count', 'Job with delays'. So can we achieve same? I am using Spark 2.0.0.</p>