adding packages to pyspark using jupyter notebook
<p>I am able to run jupyter with pyspark successfully using <a href="https://cloud.google.com/dataproc/tutorials/jupyter-notebook" rel="nofollow">https://cloud.google.com/dataproc/tutorials/jupyter-notebook</a></p>

<p>My question is - if I had to add packages to pyspark (like spark-csv or graphframes) and use them through the notebook, what is the best practice to follow ? 
I can add the package in a new pyspark job using --packages option, but how do i connect that new pyspark context to the notebook ?</p>