{"action":"created","issue":{"url":"https://api.github.com/repos/pydata/pandas/issues/11716","labels_url":"https://api.github.com/repos/pydata/pandas/issues/11716/labels{/name}","comments_url":"https://api.github.com/repos/pydata/pandas/issues/11716/comments","events_url":"https://api.github.com/repos/pydata/pandas/issues/11716/events","html_url":"https://github.com/pydata/pandas/issues/11716","id":119293202,"number":11716,"title":"read_csv dumps core with python 2.7.10 and pandas 0.17.1 ","user":{"login":"jdfekete","id":1331338,"avatar_url":"https://avatars.githubusercontent.com/u/1331338?v=3","gravatar_id":"","url":"https://api.github.com/users/jdfekete","html_url":"https://github.com/jdfekete","followers_url":"https://api.github.com/users/jdfekete/followers","following_url":"https://api.github.com/users/jdfekete/following{/other_user}","gists_url":"https://api.github.com/users/jdfekete/gists{/gist_id}","starred_url":"https://api.github.com/users/jdfekete/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jdfekete/subscriptions","organizations_url":"https://api.github.com/users/jdfekete/orgs","repos_url":"https://api.github.com/users/jdfekete/repos","events_url":"https://api.github.com/users/jdfekete/events{/privacy}","received_events_url":"https://api.github.com/users/jdfekete/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/pydata/pandas/labels/Can't%20Repro","name":"Can't Repro","color":"ae2045"},{"url":"https://api.github.com/repos/pydata/pandas/labels/CSV","name":"CSV","color":"5319e7"}],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-11-28T13:08:39Z","updated_at":"2015-12-07T16:47:38Z","closed_at":"2015-11-29T17:28:21Z","body":"I am reading a very large csv file (the NYC taxi dataset at https://storage.googleapis.com/tlc-trip-data/2015/), only two columns:\r\nindex_col=False,skipinitialspace=True,usecols=['pickup_longitude', 'pickup_latitude'], chunksize=...\r\nI load it progressively by varying-size chunks, and use 2 threads to do the progressive loading.\r\nAfter reading about 10M lines (the number varies from one run to the other), it dumps a core. \r\nHere is what GDB finds-out:\r\n\r\nFatal Python error: GC object already tracked\r\nFatal Python error: GC object already tracked\r\n\r\nProgram received signal SIGABRT, Aborted.\r\n[Switching to Thread 0x7fffddd98700 (LWP 10284)]\r\n0x00007ffff782dcc9 in __GI_raise (sig=sig@entry=6)\r\n    at ../nptl/sysdeps/unix/sysv/linux/raise.c:56\r\n56\t../nptl/sysdeps/unix/sysv/linux/raise.c: No such file or directory.\r\n(gdb) where\r\n#0  0x00007ffff782dcc9 in __GI_raise (sig=sig@entry=6)\r\n    at ../nptl/sysdeps/unix/sysv/linux/raise.c:56\r\n#1  0x00007ffff78310d8 in __GI_abort () at abort.c:89\r\n#2  0x000000000045a4f2 in Py_FatalError ()\r\n#3  0x000000000052b5ec in PyTuple_New ()\r\n#4  0x000000000050c73d in ?? ()\r\n#5  0x000000000050d3f6 in Py_BuildValue ()\r\n#6  0x00007fffec3d01d8 in buffer_rd_bytes (source=0x7fffd8006650, \r\n    nbytes=<optimized out>, bytes_read=0x7fffddd96d08, status=0x7fffddd96d04)\r\n    at pandas/src/parser/io.c:123\r\n#7  0x00007fffec3cf065 in parser_buffer_bytes (nbytes=<optimized out>, \r\n    self=0x7fffd8003480) at pandas/src/parser/tokenizer.c:610\r\n#8  _tokenize_helper (self=0x7fffd8003480, nrows=nrows@entry=3186, \r\n    all=all@entry=0) at pandas/src/parser/tokenizer.c:1872\r\n#9  0x00007fffec3cf3e7 in tokenize_nrows (self=<optimized out>, \r\n    nrows=nrows@entry=3186) at pandas/src/parser/tokenizer.c:1905\r\n#10 0x00007fffec39a3c4 in __pyx_f_6pandas_6parser_10TextReader__tokenize_rows (\r\n    __pyx_v_self=0x7fffdddd5050, __pyx_v_nrows=3186) at pandas/parser.c:8745\r\n#11 0x00007fffec3a21a2 in __pyx_f_6pandas_6parser_10TextReader__read_rows (\r\n    __pyx_v_self=0x7fffdddd5050, __pyx_v_rows=0x7fffd8249a88, __pyx_v_trim=0)\r\n    at pandas/parser.c:8970\r\n#12 0x00007fffec393f0c in __pyx_f_6pandas_6parser_10TextReader__read_low_memory\r\n    (__pyx_v_self=0x7fffdddd5050, __pyx_v_rows=0x7fffcb815948)\r\n"},"comment":{"url":"https://api.github.com/repos/pydata/pandas/issues/comments/162588601","html_url":"https://github.com/pydata/pandas/issues/11716#issuecomment-162588601","issue_url":"https://api.github.com/repos/pydata/pandas/issues/11716","id":162588601,"user":{"login":"jreback","id":953992,"avatar_url":"https://avatars.githubusercontent.com/u/953992?v=3","gravatar_id":"","url":"https://api.github.com/users/jreback","html_url":"https://github.com/jreback","followers_url":"https://api.github.com/users/jreback/followers","following_url":"https://api.github.com/users/jreback/following{/other_user}","gists_url":"https://api.github.com/users/jreback/gists{/gist_id}","starred_url":"https://api.github.com/users/jreback/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jreback/subscriptions","organizations_url":"https://api.github.com/users/jreback/orgs","repos_url":"https://api.github.com/users/jreback/repos","events_url":"https://api.github.com/users/jreback/events{/privacy}","received_events_url":"https://api.github.com/users/jreback/received_events","type":"User","site_admin":false},"created_at":"2015-12-07T16:47:38Z","updated_at":"2015-12-07T16:47:38Z","body":"xref #11786 "}}