What is the most efficient way to serve huge chunks of binary data?
<p>I have an array consisting of 20 GB+ data. I want to serve that data via an API using <code>node.js</code>. My users will request a small slice of data (no more than a few kbs), at arbitrary position on the array. Moreover, that data is growing as time passes. Of course, I can't load 20GB of data into memory, so, what I need is an array class (with <code>read</code> and <code>push</code> operations) that stores data on disk instead of memory. Is there any such a thing? </p>