How to schedule the execution of spark-submit to specific time
<p>I have a Spark batch processing code (basically, the model training) that I execute with <code>spark-submit</code> from AWS EMR cluster. Now I want to be able to launch this job each day at specific time.
What is the standard way to do it?
Should I change the code and add the scheduling inside the code? Or is there any way to schedule spark-submit job?
<strong>Or maybe should I make it as a Spark Streaming job executed every 24 hours?</strong> (though I am interested in a specific time slot, i.e. between 11:00pm and 12pm)</p>