Animate data by scrolling in Matplotlib
<p>I have a large dataset (~30GB) that I want to visualize by looking at it scrolling past. A great example is the top graph in <a href="https://www.youtube.com/watch?v=zUfvRVkHWWY" rel="nofollow">this video.</a>
My data is coming from CSV files.</p>

<p>What I have tried so far is importing the massive CSV files into a numpy array and using <code>np.roll()</code> to shift in a new column from the right side (like in the video) repeatedly until I hit the last column of the array (by calling <code>np.roll()</code> in the <code>mpl.animation.FuncAnimation</code> iterations.
This takes a large amount of CPU, and a much larger amount of memory.</p>

<p>Any suggestion on how to approach this? I couldn't find very many examples online that could help me with this.</p>