Spark reference table
<p>A Spark RDD contains a collection, each element represents a request.</p>

<p>A Scala function will be passed to the RDD, and, for each RDD element, the function will create a modified request.</p>

<p>For each collection element\request, a lookup table needs to be referenced.
The maximum size of the reference table will be 200 rows.</p>

<p>How performance and scalability, how should the lookup table (which is used within the function) be modeled?</p>

<ol>
<li>Spark Broadcast variable.</li>
<li>Separate Spark RDD.</li>
<li>Scala immutable collection.</li>
</ol>

<p>Perhaps there is a another option I have not considered.</p>

<p>Thanks</p>