Requesting executors because tasks are backlogged
<p>I have a spark streaming application that was running absolutely fine until yesterday and all of a sudden running into these warnings. I have the same environment and using the same code. Here are the warnings:</p>
<blockquote>
<blockquote>
<p>05/09 17:13:03 INFO ExecutorAllocationManager: Requesting 16 new executors because tasks are backlogged (new desired total will be 31)
16/05/09 17:13:03 INFO ExecutorAllocationManager: Requesting 19 new
executors because tasks are backlogged (new desired total will be 50)</p>
</blockquote>
<p>16/05/09 17:13:12 WARN YarnScheduler: Initial job has not accepted any
resources; check your cluster UI to ensure that workers are registered
and have sufficient resources</p>
<p>16/05/09 17:13:27 WARN YarnScheduler: Initial job has not accepted any
resources; check your cluster UI to ensure that workers are registered
and have sufficient resources</p>
</blockquote>
<p>I am using apache spark 1.6 on cloudera 5.5. quickstart VM. There are no applications running on the cluster to consume available resources.</p>
<p>Is there any config to be made?</p>
<p>Thanks!</p>