{"action":"created","issue":{"url":"https://api.github.com/repos/pydata/pandas/issues/9735","labels_url":"https://api.github.com/repos/pydata/pandas/issues/9735/labels{/name}","comments_url":"https://api.github.com/repos/pydata/pandas/issues/9735/comments","events_url":"https://api.github.com/repos/pydata/pandas/issues/9735/events","html_url":"https://github.com/pydata/pandas/issues/9735","id":64547932,"number":9735,"title":"BUG: read_csv, engine='c' error","user":{"login":"sbtlaarzc","id":6989689,"avatar_url":"https://avatars.githubusercontent.com/u/6989689?v=3","gravatar_id":"","url":"https://api.github.com/users/sbtlaarzc","html_url":"https://github.com/sbtlaarzc","followers_url":"https://api.github.com/users/sbtlaarzc/followers","following_url":"https://api.github.com/users/sbtlaarzc/following{/other_user}","gists_url":"https://api.github.com/users/sbtlaarzc/gists{/gist_id}","starred_url":"https://api.github.com/users/sbtlaarzc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sbtlaarzc/subscriptions","organizations_url":"https://api.github.com/users/sbtlaarzc/orgs","repos_url":"https://api.github.com/users/sbtlaarzc/repos","events_url":"https://api.github.com/users/sbtlaarzc/events{/privacy}","received_events_url":"https://api.github.com/users/sbtlaarzc/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/pydata/pandas/labels/CSV","name":"CSV","color":"5319e7"}],"state":"closed","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/pydata/pandas/milestones/34","html_url":"https://github.com/pydata/pandas/milestones/0.17.0","labels_url":"https://api.github.com/repos/pydata/pandas/milestones/34/labels","id":1033710,"number":34,"title":"0.17.0","description":"","creator":{"login":"jreback","id":953992,"avatar_url":"https://avatars.githubusercontent.com/u/953992?v=3","gravatar_id":"","url":"https://api.github.com/users/jreback","html_url":"https://github.com/jreback","followers_url":"https://api.github.com/users/jreback/followers","following_url":"https://api.github.com/users/jreback/following{/other_user}","gists_url":"https://api.github.com/users/jreback/gists{/gist_id}","starred_url":"https://api.github.com/users/jreback/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jreback/subscriptions","organizations_url":"https://api.github.com/users/jreback/orgs","repos_url":"https://api.github.com/users/jreback/repos","events_url":"https://api.github.com/users/jreback/events{/privacy}","received_events_url":"https://api.github.com/users/jreback/received_events","type":"User","site_admin":false},"open_issues":13,"closed_issues":522,"state":"open","created_at":"2015-03-23T10:47:38Z","updated_at":"2015-09-17T23:48:15Z","due_on":"2015-09-28T07:00:00Z","closed_at":null},"comments":8,"created_at":"2015-03-26T14:59:21Z","updated_at":"2015-09-17T23:48:15Z","closed_at":"2015-09-17T23:48:15Z","body":"I am trying to read a file 57MB with ```pandas.csv_read```. The file contains a header (5 rows), afterwads integer values and at the end float values:\r\n\r\n    info         \r\n           2681087         53329       1287215       1287215         53328\r\n    RSA                    53328         53328       1287215             0\r\n    (I14)           (I14)           (d25.15)            (d25.15)            \r\n    F                          1         5332   \r\n               1\r\n              33\r\n              61\r\n              92\r\n             128\r\n             ...\r\n             165\r\n             205\r\n             239\r\n             272\r\n        0.112474585277959E+09\r\n        0.126110931411177E+09\r\n        0.515995872032845E+09\r\n        0.126110931411175E+09\r\n       -0.194634413074014E+09\r\n        0.112474585277950E+09\r\n        ...\r\n\r\nWhen I read the txt file:\r\n    import pandas as pd\r\n    pd.read_csv(file, skiprows=5+n_int_values, header=None, engine='c', \r\n                dtype=np.float, low_memory=False)\r\n\r\nThe result is an error:\r\n\r\n    ---------------------------------------------------------------------------\r\n    CParserError                              Traceback (most recent call last)\r\n    <ipython-input-118-699921ac7a12> in <module>()\r\n    ----> 1 a=pd.read_csv(loc, skiprows=5+n_coloums+n_rows, header=None, engine='c', \r\n    low_memory=False, error_bad_lines=False)\r\n    \r\n    C:\\Anaconda\\lib\\site-packages\\pandas\\io\\parsers.pyc in parser_f(filepath_or_buffer, sep, dialect,     \r\n    compression, doublequote, escapechar, quotechar, quoting, skipinitialspace, lineterminator, \r\n    header, index_col, names, prefix, skiprows, skipfooter, skip_footer, na_values, na_fvalues, \r\n    true_values, false_values, delimiter, converters, dtype, usecols, engine, delim_whitespace, \r\n    as_recarray, na_filter, compact_ints, use_unsigned, low_memory, buffer_lines, warn_bad_lines, \r\n    error_bad_lines, keep_default_na, thousands, comment, decimal, parse_dates, keep_date_col, \r\n    dayfirst, date_parser, memory_map, float_precision, nrows, iterator, chunksize, verbose, \r\n    encoding, squeeze, mangle_dupe_cols, tupleize_cols, infer_datetime_format, skip_blank_lines)\r\n        468                     skip_blank_lines=skip_blank_lines)\r\n        469 \r\n    --> 470         return _read(filepath_or_buffer, kwds)\r\n        471 \r\n        472     parser_f.__name__ = name\r\n    \r\n    C:\\Anaconda\\lib\\site-packages\\pandas\\io\\parsers.pyc in _read(filepath_or_buffer, kwds)\r\n        254         return parser\r\n        255 \r\n    --> 256     return parser.read()\r\n        257 \r\n        258 _parser_defaults = {\r\n    \r\n    C:\\Anaconda\\lib\\site-packages\\pandas\\io\\parsers.pyc in read(self, nrows)\r\n        713                 raise ValueError('skip_footer not supported for iteration')\r\n        714 \r\n    --> 715         ret = self._engine.read(nrows)\r\n        716 \r\n        717         if self.options.get('as_recarray'):\r\n    \r\n    C:\\Anaconda\\lib\\site-packages\\pandas\\io\\parsers.pyc in read(self, nrows)\r\n       1162 \r\n       1163         try:\r\n    -> 1164             data = self._reader.read(nrows)\r\n       1165         except StopIteration:\r\n       1166             if nrows is None:\r\n    \r\n    pandas\\parser.pyx in pandas.parser.TextReader.read (pandas\\parser.c:7426)()\r\n    \r\n    pandas\\parser.pyx in pandas.parser.TextReader._read_rows (pandas\\parser.c:8377)()\r\n    \r\n    pandas\\parser.pyx in pandas.parser.raise_parser_error (pandas\\parser.c:20728)()\r\n    \r\n    CParserError: Error tokenizing data. C error: Buffer overflow caught - possible malformed input     \r\n    file.\r\n\r\nThis happens on pandas 0.16.0, on anaconda python 2.7.8. On an older version - 0.14.1. it works correctly.\r\n\r\nNote: When I use ```engine='python'```, the txt file is loaded normaly."},"comment":{"url":"https://api.github.com/repos/pydata/pandas/issues/comments/141287437","html_url":"https://github.com/pydata/pandas/issues/9735#issuecomment-141287437","issue_url":"https://api.github.com/repos/pydata/pandas/issues/9735","id":141287437,"user":{"login":"jreback","id":953992,"avatar_url":"https://avatars.githubusercontent.com/u/953992?v=3","gravatar_id":"","url":"https://api.github.com/users/jreback","html_url":"https://github.com/jreback","followers_url":"https://api.github.com/users/jreback/followers","following_url":"https://api.github.com/users/jreback/following{/other_user}","gists_url":"https://api.github.com/users/jreback/gists{/gist_id}","starred_url":"https://api.github.com/users/jreback/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jreback/subscriptions","organizations_url":"https://api.github.com/users/jreback/orgs","repos_url":"https://api.github.com/users/jreback/repos","events_url":"https://api.github.com/users/jreback/events{/privacy}","received_events_url":"https://api.github.com/users/jreback/received_events","type":"User","site_admin":false},"created_at":"2015-09-17T23:48:15Z","updated_at":"2015-09-17T23:48:15Z","body":"closed by #11138 "}}