Error tokenizing data. C error: out of memory pandas python, large file csv
<p>I have a large csv file of 3.5 go and I want to read it using pandas.</p>

<p>This is my code:</p>

<pre><code>import pandas as pd
tp = pd.read_csv('train_2011_2012_2013.csv', sep=';', iterator=True, chunksize=20000000, low_memory = False)
df = pd.concat(tp, ignore_index=True)
</code></pre>

<p>I get this error:</p>

<pre><code>pandas/parser.pyx in pandas.parser.TextReader.read (pandas/parser.c:8771)()

pandas/parser.pyx in pandas.parser.TextReader._read_rows (pandas/parser.c:9731)()

pandas/parser.pyx in pandas.parser.TextReader._tokenize_rows (pandas/parser.c:9602)()

pandas/parser.pyx in pandas.parser.raise_parser_error (pandas/parser.c:23325)()

CParserError: Error tokenizing data. C error: out of 
</code></pre>

<p>The capacity of my ram is 8 Go.</p>