Limit Kafka batches size when using Spark Streaming
<p>Is it possible to limit the size of the batches returned by the Kafka consumer for Spark Streaming?</p>

<p>I am asking because the first batch I get has hundred of millions of records and it takes ages to process and checkpoint them.</p>