{"action":"created","issue":{"url":"https://api.github.com/repos/binux/pyspider/issues/174","labels_url":"https://api.github.com/repos/binux/pyspider/issues/174/labels{/name}","comments_url":"https://api.github.com/repos/binux/pyspider/issues/174/comments","events_url":"https://api.github.com/repos/binux/pyspider/issues/174/events","html_url":"https://github.com/binux/pyspider/issues/174","id":66432190,"number":174,"title":"*** glibc detected *** /usr/local/bin/python2.7: free(): invalid next size (fast): 0x00000000028d40d0 ***","user":{"login":"Horrower","id":11806114,"avatar_url":"https://avatars.githubusercontent.com/u/11806114?v=3","gravatar_id":"","url":"https://api.github.com/users/Horrower","html_url":"https://github.com/Horrower","followers_url":"https://api.github.com/users/Horrower/followers","following_url":"https://api.github.com/users/Horrower/following{/other_user}","gists_url":"https://api.github.com/users/Horrower/gists{/gist_id}","starred_url":"https://api.github.com/users/Horrower/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Horrower/subscriptions","organizations_url":"https://api.github.com/users/Horrower/orgs","repos_url":"https://api.github.com/users/Horrower/repos","events_url":"https://api.github.com/users/Horrower/events{/privacy}","received_events_url":"https://api.github.com/users/Horrower/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":23,"created_at":"2015-04-05T12:21:36Z","updated_at":"2015-04-05T22:02:46Z","closed_at":null,"body":"Sometimes when many spiders working I have that error and scheduler quits, but all other processess continue to work until end of queue.\r\n \r\nI'm using elasticsearch library for storing data (creating connection in spider) and mongodb as common database.\r\nrabbitmq as queue manager.\r\nI'v spent many and many time for trying to cache this issue.\r\nTried to change rate/burst, didnt help.\r\n\r\nhere is full log:\r\n[I 150405 08:07:12 scheduler:635] select projectname:7cbd373a8deb5c71f015d56b834d140b http://..url...\r\n*** glibc detected *** /usr/local/bin/python2.7: free(): invalid next size (fast): 0x00000000024cf440 ***\r\n======= Backtrace: =========\r\n/lib64/libc.so.6(+0x75e66)[0x7f5049f82e66]\r\n/lib64/libc.so.6(+0x789b3)[0x7f5049f859b3]\r\n/usr/local/lib/libpython2.7.so.1.0(+0x7d419)[0x7f504abc6419]\r\n/usr/local/lib/libpython2.7.so.1.0(+0x8d06b)[0x7f504abd606b]\r\n/usr/local/lib/libpython2.7.so.1.0(+0x8d06b)[0x7f504abd606b]\r\n/usr/local/lib/libpython2.7.so.1.0(+0xac871)[0x7f504abf5871]\r\n/usr/local/lib/libpython2.7.so.1.0(+0x8d06b)[0x7f504abd606b]\r\n/usr/local/lib/libpython2.7.so.1.0(+0xac871)[0x7f504abf5871]\r\n/usr/local/lib/libpython2.7.so.1.0(+0x8d06b)[0x7f504abd606b]\r\n/usr/local/lib/libpython2.7.so.1.0(+0xaccb6)[0x7f504abf5cb6]\r\n/usr/local/lib/libpython2.7.so.1.0(+0x1304be)[0x7f504ac794be]\r\n/usr/local/lib/libpython2.7.so.1.0(_PyObject_GC_Malloc+0xfe)[0x7f504ac79d2e]\r\n/usr/local/lib/libpython2.7.so.1.0(PyType_GenericAlloc+0x49)[0x7f504abf5919]\r\n/usr/local/lib/libpython2.7.so.1.0(+0xab133)[0x7f504abf4133]\r\n/usr/local/lib/libpython2.7.so.1.0(PyObject_Call+0x53)[0x7f504ab91283]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x4145)[0x7f504ac3f7d5]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(+0x778b8)[0x7f504abc08b8]\r\n/usr/local/lib/libpython2.7.so.1.0(PyObject_Call+0x53)[0x7f504ab91283]\r\n/usr/local/lib/libpython2.7.so.1.0(+0x5a8bf)[0x7f504aba38bf]\r\n/usr/local/lib/libpython2.7.so.1.0(PyObject_Call+0x53)[0x7f504ab91283]\r\n/usr/local/lib/libpython2.7.so.1.0(+0xb45e0)[0x7f504abfd5e0]\r\n/usr/local/lib/libpython2.7.so.1.0(+0xab178)[0x7f504abf4178]\r\n/usr/local/lib/libpython2.7.so.1.0(PyObject_Call+0x53)[0x7f504ab91283]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x4145)[0x7f504ac3f7d5]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(+0x777b1)[0x7f504abc07b1]\r\n/usr/local/lib/libpython2.7.so.1.0(PyObject_Call+0x53)[0x7f504ab91283]\r\n/usr/local/lib/libpython2.7.so.1.0(+0x5a8bf)[0x7f504aba38bf]\r\n/usr/local/lib/libpython2.7.so.1.0(PyObject_Call+0x53)[0x7f504ab91283]\r\n/usr/local/lib/libpython2.7.so.1.0(+0xb45e0)[0x7f504abfd5e0]\r\n/usr/local/lib/libpython2.7.so.1.0(+0xab178)[0x7f504abf4178]\r\n/usr/local/lib/libpython2.7.so.1.0(PyObject_Call+0x53)[0x7f504ab91283]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x4c42)[0x7f504ac402d2]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(+0x778b8)[0x7f504abc08b8]\r\n/usr/local/lib/libpython2.7.so.1.0(PyObject_Call+0x53)[0x7f504ab91283]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x4145)[0x7f504ac3f7d5]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalFrameEx+0x5b8a)[0x7f504ac4121a]\r\n/usr/local/lib/libpython2.7.so.1.0(PyEval_EvalCodeEx+0x88e)[0x7f504ac42bde]\r\n======= Memory map: ========\r\n00400000-00401000 r-xp 00000000 08:03 2370547                            /usr/local/bin/python2.7\r\n00600000-00601000 rw-p 00000000 08:03 2370547                            /usr/local/bin/python2.7\r\n01938000-01daf000 rw-p 00000000 00:00 0\r\n01daf000-027f7000 rw-p 00000000 00:00 0\r\n7f5039d82000-7f5039d98000 r-xp 00000000 08:03 2228584                    /lib64/libgcc_s-4.4.7-20120601.so.1\r\n7f5039d98000-7f5039f97000 ---p 00016000 08:03 2228584                    /lib64/libgcc_s-4.4.7-20120601.so.1\r\n7f5039f97000-7f5039f98000 rw-p 00015000 08:03 2228584                    /lib64/libgcc_s-4.4.7-20120601.so.1\r\n7f5039f98000-7f5039fd8000 rw-p 00000000 00:00 0\r\n7f5039fd8000-7f5039ffe000 r-xp 00000000 08:03 2360514                    /usr/lib64/libnssdbm3.so\r\n7f5039ffe000-7f503a1fe000 ---p 00026000 08:03 2360514                    /usr/lib64/libnssdbm3.so\r\n7f503a1fe000-7f503a1ff000 r--p 00026000 08:03 2360514                    /usr/lib64/libnssdbm3.so\r\n7f503a1ff000-7f503a200000 rw-p 00027000 08:03 2360514                    /usr/lib64/libnssdbm3.so\r\n7f503a200000-7f503a224000 r-xp 00000000 08:03 2363318                    /usr/lib64/libnsspem.so\r\n7f503a224000-7f503a423000 ---p 00024000 08:03 2363318                    /usr/lib64/libnsspem.so\r\n7f503a423000-7f503a424000 r--p 00023000 08:03 2363318                    /usr/lib64/libnsspem.so\r\n7f503a424000-7f503a425000 rw-p 00024000 08:03 2363318                    /usr/lib64/libnsspem.so\r\n7f503a425000-7f503a427000 r-xp 00000000 08:03 2361126                    /usr/lib64/libnsssysinit.so\r\n7f503a427000-7f503a626000 ---p 00002000 08:03 2361126                    /usr/lib64/libnsssysinit.so\r\n7f503a626000-7f503a627000 r--p 00001000 08:03 2361126                    /usr/lib64/libnsssysinit.so\r\n7f503a627000-7f503a628000 rw-p 00002000 08:03 2361126                    /usr/lib64/libnsssysinit.so\r\n7f503a628000-7f503a69a000 r-xp 00000000 08:03 2228643                    /lib64/libfreeblpriv3.so\r\n7f503a69a000-7f503a89a000 ---p 00072000 08:03 2228643                    /lib64/libfreeblpriv3.so\r\n7f503a89a000-7f503a89c000 r--p 00072000 08:03 2228643                    /lib64/libfreeblpriv3.so\r\n7f503a89c000-7f503a89d000 rw-p 00074000 08:03 2228643                    /lib64/libfreeblpriv3.so\r\n7f503a89d000-7f503a8a1000 rw-p 00000000 00:00 0\r\n7f503a8a1000-7f503a92d000 r-xp 00000000 08:03 2360387                    /usr/lib64/libsqlite3.so.0.8.6\r\n7f503a92d000-7f503ab2c000 ---p 0008c000 08:03 2360387                    /usr/lib64/libsqlite3.so.0.8.6\r\n7f503ab2c000-7f503ab2f000 rw-p 0008b000 08:03 2360387                    /usr/lib64/libsqlite3.so.0.8.6\r\n7f503ab2f000-7f503ab30000 rw-p 00000000 00:00 0\r\n7f503ab30000-7f503ab6e000 r-xp 00000000 08:03 2360516                    /usr/lib64/libsoftokn3.so\r\n7f503ab6e000-7f503ad6d000 ---p 0003e000 08:03 2360516                    /usr/lib64/libsoftokn3.so\r\n7f503ad6d000-7f503ad6f000 r--p 0003d000 08:03 2360516                    /usr/lib64/libsoftokn3.so\r\n7f503ad6f000-7f503ad70000 rw-p 0003f000 08:03 2360516                    /usr/lib64/libsoftokn3.so\r\n7f503ad70000-7f503adf0000 rw-p 00000000 00:00 0\r\n7f503adf0000-7f503adfc000 r-xp 00000000 08:03 2228253                    /lib64/libnss_files-2.12.so\r\n7f503adfc000-7f503affc000 ---p 0000c000 08:03 2228253                    /lib64/libnss_files-2.12.so\r\n7f503affc000-7f503affd000 r--p 0000c000 08:03 2228253                    /lib64/libnss_files-2.12.so\r\n7f503affd000-7f503affe000 rw-p 0000d000 08:03 2228253                    /lib64/libnss_files-2.12.so\r\n7f503affe000-7f503b094000 r-xp 00000000 08:03 2493438                    /usr/local/lib/python2.7/lib-dynload/unicodedata.so\r\n7f503b094000-7f503b293000 ---p 00096000 08:03 2493438                    /usr/local/lib/python2.7/lib-dynload/unicodedata.so\r\n7f503b293000-7f503b2a7000 rw-p 00095000 08:03 2493438                    /usr/local/lib/python2.7/lib-dynload/unicodedata.so\r\n7f503b2a7000-7f503b2e7000 rw-p 00000000 00:00 0\r\n7f503b2e7000-7f503b2e9000 r-xp 00000000 08:03 2228229                    /lib64/libfreebl3.so\r\n7f503b2e9000-7f503b4e8000 ---p 00002000 08:03 2228229                    /lib64/libfreebl3.so\r\n7f503b4e8000-7f503b4e9000 r--p 00001000 08:03 2228229                    /lib64/libfreebl3.so\r\n7f503b4e9000-7f503b4ea000 rw-p 00002000 08:03 2228229                    /lib64/libfreebl3.so\r\n7f503b4ea000-7f503b4f1000 r-xp 00000000 08:03 2228241                    /lib64/libcrypt-2.12.so\r\n7f503b4f1000-7f503b6f1000 ---p 00007000 08:03 2228241                    /lib64/libcrypt-2.12.so\r\n7f503b6f1000-7f503b6f2000 r--p 00007000 08:03 2228241                    /lib64/libcrypt-2.12.so\r\n7f503b6f2000-7f503b6f3000 rw-p 00008000 08:03 2228241                    /lib64/libcrypt-2.12.so\r\n7f503b6f3000-7f503b721000 rw-p 00000000 00:00 0\r\n7f503b721000-7f503b73a000 r-xp 00000000 08:03 2360411                    /usr/lib64/libsasl2.so.2.0.23\r\n7f503b73a000-7f503b939000 ---p 00019000 08:03 2360411                    /usr/lib64/libsasl2.so.2.0.23\r\n7f503b939000-7f503b93a000 r--p 00018000 08:03 2360411                    /usr/lib64/libsasl2.so.2.0.23\r\n7f503b93a000-7f503b93b000 rw-p 00019000 08:03 2360411                    /usr/lib64/libsasl2.so.2.0.23\r\n7f503b93b000-7f503b949000 r-xp 00000000 08:03 2228400                    /lib64/liblber-2.4.so.2.10.2\r\n7f503b949000-7f503bb48000 ---p 0000e000 08:03 2228400                    /lib64/liblber-2.4.so.2.10.2\r\n7f503bb48000-7f503bb49000 r--p 0000d000 08:03 2228400                    /lib64/liblber-2.4.so.2.10.2\r\n7f503bb49000-7f503bb4a000 rw-p 0000e000 08:03 2228400                    /lib64/liblber-2.4.so.2.10.2\r\n7f503bb4a000-7f503bb71000 r-xp 00000000 08:03 2361221                    /usr/lib64/libssh2.so.1.0.1\r\n7f503bb71000-7f503bd70000 ---p 00027000 08:03 2361221                    /usr/lib64/libssh2.so.1.0.1\r\n7f503bd70000-7f503bd72000 rw-p 00026000 08:03 2361221                    /usr/lib64/libssh2.so.1.0.1\r\n7f503bd72000-7f503bdab000 r-xp 00000000 08:03 2228618                    /lib64/libnspr4.so\r\n7f503bdab000-7f503bfab000 ---p 00039000 08:03 2228618                    /lib64/libnspr4.so\r\n7f503bfab000-7f503bfac000 r--p 00039000 08:03 2228618                    /lib64/libnspr4.so\r\n7f503bfac000-7f503bfae000 rw-p 0003a000 08:03 2228618                    /lib64/libnspr4.so\r\n7f503bfae000-7f503bfb0000 rw-p 00000000 00:00 0\r\n7f503bfb0000-7f503bfb4000 r-xp 00000000 08:03 2228619                    /lib64/libplc4.so\r\n7f503bfb4000-7f503c1b3000 ---p 00004000 08:03 2228619                    /lib64/libplc4.so"},"comment":{"url":"https://api.github.com/repos/binux/pyspider/issues/comments/89862130","html_url":"https://github.com/binux/pyspider/issues/174#issuecomment-89862130","issue_url":"https://api.github.com/repos/binux/pyspider/issues/174","id":89862130,"user":{"login":"Horrower","id":11806114,"avatar_url":"https://avatars.githubusercontent.com/u/11806114?v=3","gravatar_id":"","url":"https://api.github.com/users/Horrower","html_url":"https://github.com/Horrower","followers_url":"https://api.github.com/users/Horrower/followers","following_url":"https://api.github.com/users/Horrower/following{/other_user}","gists_url":"https://api.github.com/users/Horrower/gists{/gist_id}","starred_url":"https://api.github.com/users/Horrower/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Horrower/subscriptions","organizations_url":"https://api.github.com/users/Horrower/orgs","repos_url":"https://api.github.com/users/Horrower/repos","events_url":"https://api.github.com/users/Horrower/events{/privacy}","received_events_url":"https://api.github.com/users/Horrower/received_events","type":"User","site_admin":false},"created_at":"2015-04-05T22:02:45Z","updated_at":"2015-04-05T22:02:45Z","body":"How can i debug pyspider with GDB on Centos? "}}