{"action":"created","issue":{"url":"https://api.github.com/repos/edsu/twarc/issues/72","labels_url":"https://api.github.com/repos/edsu/twarc/issues/72/labels{/name}","comments_url":"https://api.github.com/repos/edsu/twarc/issues/72/comments","events_url":"https://api.github.com/repos/edsu/twarc/issues/72/events","html_url":"https://github.com/edsu/twarc/issues/72","id":92861935,"number":72,"title":"Archive & Hydrate failures getting OpenSSL.SSL.SysCallError: (104, 'ECONNRESET') by Twitter","user":{"login":"remagio","id":610819,"avatar_url":"https://avatars.githubusercontent.com/u/610819?v=3","gravatar_id":"","url":"https://api.github.com/users/remagio","html_url":"https://github.com/remagio","followers_url":"https://api.github.com/users/remagio/followers","following_url":"https://api.github.com/users/remagio/following{/other_user}","gists_url":"https://api.github.com/users/remagio/gists{/gist_id}","starred_url":"https://api.github.com/users/remagio/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/remagio/subscriptions","organizations_url":"https://api.github.com/users/remagio/orgs","repos_url":"https://api.github.com/users/remagio/repos","events_url":"https://api.github.com/users/remagio/events{/privacy}","received_events_url":"https://api.github.com/users/remagio/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-07-03T12:08:14Z","updated_at":"2015-07-04T09:32:43Z","closed_at":null,"body":"It's a few weeks that very often Archive.py and Twarc --Hydrate failes unnoticed when launching with &. It doesn't write any traceback neither forwarding output to files. But launching both interactively I get this:\r\n\r\n```\r\nTraceback (most recent call last):\r\n  File \"/usr/local/bin/twarc.py\", line 4, in <module>\r\n    __import__('pkg_resources').run_script('twarc==0.3.0', 'twarc.py')\r\n  File \"/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py\", line 729, in run_script\r\n    self.require(requires)[0].run_script(script_name, ns)\r\n  File \"/usr/local/lib/python2.7/dist-packages/pkg_resources/__init__.py\", line 1649, in run_script\r\n    exec(script_code, namespace, namespace)\r\n  File \"/usr/local/lib/python2.7/dist-packages/twarc-0.3.0-py2.7.egg/EGG-INFO/scripts/twarc.py\", line 335, in <module>\r\n    \r\n  File \"/usr/local/lib/python2.7/dist-packages/twarc-0.3.0-py2.7.egg/EGG-INFO/scripts/twarc.py\", line 109, in main\r\n    \r\n  File \"/usr/local/lib/python2.7/dist-packages/twarc-0.3.0-py2.7.egg/EGG-INFO/scripts/twarc.py\", line 298, in hydrate\r\n    \r\n  File \"/usr/local/lib/python2.7/dist-packages/twarc-0.3.0-py2.7.egg/EGG-INFO/scripts/twarc.py\", line 172, in new_f\r\n    \r\n  File \"/usr/local/lib/python2.7/dist-packages/twarc-0.3.0-py2.7.egg/EGG-INFO/scripts/twarc.py\", line 323, in post\r\n    \r\n  File \"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\", line 507, in post\r\n    return self.request('POST', url, data=data, json=json, **kwargs)\r\n  File \"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\", line 464, in request\r\n    resp = self.send(prep, **send_kwargs)\r\n  File \"/usr/local/lib/python2.7/dist-packages/requests/sessions.py\", line 576, in send\r\n    r = adapter.send(request, **kwargs)\r\n  File \"/usr/local/lib/python2.7/dist-packages/requests/adapters.py\", line 370, in send\r\n    timeout=timeout\r\n  File \"/usr/local/lib/python2.7/dist-packages/requests/packages/urllib3/connectionpool.py\", line 544, in urlopen\r\n    body=body, headers=headers)\r\n  File \"/usr/local/lib/python2.7/dist-packages/requests/packages/urllib3/connectionpool.py\", line 372, in _make_request\r\n    httplib_response = conn.getresponse(buffering=True)\r\n  File \"/usr/lib/python2.7/httplib.py\", line 1034, in getresponse\r\n    response.begin()\r\n  File \"/usr/lib/python2.7/httplib.py\", line 407, in begin\r\n    version, status, reason = self._read_status()\r\n  File \"/usr/lib/python2.7/httplib.py\", line 365, in _read_status\r\n    line = self.fp.readline()\r\n  File \"/usr/lib/python2.7/socket.py\", line 447, in readline\r\n    data = self._sock.recv(self._rbufsize)\r\n  File \"/usr/local/lib/python2.7/dist-packages/requests/packages/urllib3/contrib/pyopenssl.py\", line 188, in recv\r\n    data = self.connection.recv(*args, **kwargs)\r\n  File \"/usr/local/lib/python2.7/dist-packages/pyOpenSSL-0.14-py2.7.egg/OpenSSL/SSL.py\", line 995, in recv\r\n    self._raise_ssl_error(self._ssl, result)\r\n  File \"/usr/local/lib/python2.7/dist-packages/pyOpenSSL-0.14-py2.7.egg/OpenSSL/SSL.py\", line 862, in _raise_ssl_error\r\n    raise SysCallError(errno, errorcode[errno])\r\nOpenSSL.SSL.SysCallError: (104, 'ECONNRESET')\r\n```\r\nThe systems used have no I/O issues or network issues, all debians & OS X full updated and Twarc is current v0.3.0. How can I help in finding any solution?"},"comment":{"url":"https://api.github.com/repos/edsu/twarc/issues/comments/118492225","html_url":"https://github.com/edsu/twarc/issues/72#issuecomment-118492225","issue_url":"https://api.github.com/repos/edsu/twarc/issues/72","id":118492225,"user":{"login":"remagio","id":610819,"avatar_url":"https://avatars.githubusercontent.com/u/610819?v=3","gravatar_id":"","url":"https://api.github.com/users/remagio","html_url":"https://github.com/remagio","followers_url":"https://api.github.com/users/remagio/followers","following_url":"https://api.github.com/users/remagio/following{/other_user}","gists_url":"https://api.github.com/users/remagio/gists{/gist_id}","starred_url":"https://api.github.com/users/remagio/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/remagio/subscriptions","organizations_url":"https://api.github.com/users/remagio/orgs","repos_url":"https://api.github.com/users/remagio/repos","events_url":"https://api.github.com/users/remagio/events{/privacy}","received_events_url":"https://api.github.com/users/remagio/received_events","type":"User","site_admin":false},"created_at":"2015-07-04T09:32:43Z","updated_at":"2015-07-04T09:32:43Z","body":"Same error still come up, if it helps it raise up always when starting again the hydrate after a \"rate limit exceeded\" wait."}}