{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/curator/issues/457","labels_url":"https://api.github.com/repos/elastic/curator/issues/457/labels{/name}","comments_url":"https://api.github.com/repos/elastic/curator/issues/457/comments","events_url":"https://api.github.com/repos/elastic/curator/issues/457/events","html_url":"https://github.com/elastic/curator/issues/457","id":101460012,"number":457,"title":"Curator throws TransportError before it reaches timeout and finishes taking snapshot within the timeout","user":{"login":"rhealitycheck","id":5863615,"avatar_url":"https://avatars.githubusercontent.com/u/5863615?v=3","gravatar_id":"","url":"https://api.github.com/users/rhealitycheck","html_url":"https://github.com/rhealitycheck","followers_url":"https://api.github.com/users/rhealitycheck/followers","following_url":"https://api.github.com/users/rhealitycheck/following{/other_user}","gists_url":"https://api.github.com/users/rhealitycheck/gists{/gist_id}","starred_url":"https://api.github.com/users/rhealitycheck/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rhealitycheck/subscriptions","organizations_url":"https://api.github.com/users/rhealitycheck/orgs","repos_url":"https://api.github.com/users/rhealitycheck/repos","events_url":"https://api.github.com/users/rhealitycheck/events{/privacy}","received_events_url":"https://api.github.com/users/rhealitycheck/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-08-17T16:31:38Z","updated_at":"2015-08-17T17:11:43Z","closed_at":null,"body":"Hi so I'm on curator 3.2.3 which I believe is the most current. And I'm facing an issue where it raises a TransportError but it eventually finishes taking the snapshot within the requested timeout period. So why is this being raised before the timeout and how can I actually look at the more granular errors being thrown?\r\n\r\n`curator --host <myservername> snapshot --repository my_s3_repository --name indices-2015.08.04 --request_timeout 7200 indices --older-than 13 --time-unit days --timestring %Y.%m.%d --exclude foo`\r\n2015-08-17 11:12:04,114 INFO      Job starting: snapshot indices\r\n2015-08-17 11:12:04,115 WARNING   Overriding default connection timeout.  New timeout: 21600\r\n2015-08-17 11:12:06,338 INFO      Snapshot name: indices-2015.08.04\r\n**2015-08-17 11:16:08,389 ERROR     Client raised a TransportError.**\r\n2015-08-17 11:16:08,390 WARNING   Job did not complete successfully.\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/elastic/curator/issues/comments/131892728","html_url":"https://github.com/elastic/curator/issues/457#issuecomment-131892728","issue_url":"https://api.github.com/repos/elastic/curator/issues/457","id":131892728,"user":{"login":"rhealitycheck","id":5863615,"avatar_url":"https://avatars.githubusercontent.com/u/5863615?v=3","gravatar_id":"","url":"https://api.github.com/users/rhealitycheck","html_url":"https://github.com/rhealitycheck","followers_url":"https://api.github.com/users/rhealitycheck/followers","following_url":"https://api.github.com/users/rhealitycheck/following{/other_user}","gists_url":"https://api.github.com/users/rhealitycheck/gists{/gist_id}","starred_url":"https://api.github.com/users/rhealitycheck/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rhealitycheck/subscriptions","organizations_url":"https://api.github.com/users/rhealitycheck/orgs","repos_url":"https://api.github.com/users/rhealitycheck/repos","events_url":"https://api.github.com/users/rhealitycheck/events{/privacy}","received_events_url":"https://api.github.com/users/rhealitycheck/received_events","type":"User","site_admin":false},"created_at":"2015-08-17T17:11:43Z","updated_at":"2015-08-17T17:11:43Z","body":"Ok, so I just ran one with the `--request_timeout` taken out and `--debug` on. and this is the error message that i get:\r\n\r\n`2015-08-17 12:06:25,441 DEBUG         urllib3.util.retry               from_int:155  Converted retries value: False -> Retry(total=False, connect=None, read=None, redirect=0)\r\n2015-08-17 12:07:25,443 WARNING            elasticsearch       log_request_fail:82   PUT http://haproxystaging:9200/_snapshot/my_s3_repository/mdp-2015.08.04?wait_for_completion=true [status:N/A request:60.002s]\r\nTraceback (most recent call last):\r\n  File \"/Users/rhea/dev/venv/lib/python2.7/site-packages/elasticsearch/connection/http_urllib3.py\", line 74, in perform_request\r\n    response = self.pool.urlopen(method, url, body, retries=False, headers=self.headers, **kw)\r\n  File \"/Users/rhea/dev/venv/lib/python2.7/site-packages/urllib3/connectionpool.py\", line 607, in urlopen\r\n    _stacktrace=sys.exc_info()[2])\r\n  File \"/Users/rhea/dev/venv/lib/python2.7/site-packages/urllib3/util/retry.py\", line 222, in increment\r\n    raise six.reraise(type(error), error, _stacktrace)\r\n  File \"/Users/rhea/dev/venv/lib/python2.7/site-packages/urllib3/connectionpool.py\", line 557, in urlopen\r\n    body=body, headers=headers)\r\n  File \"/Users/rhea/dev/venv/lib/python2.7/site-packages/urllib3/connectionpool.py\", line 374, in _make_request\r\n    httplib_response = conn.getresponse(buffering=True)\r\n  File \"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py\", line 1045, in getresponse\r\n    response.begin()\r\n  File \"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py\", line 409, in begin\r\n    version, status, reason = self._read_status()\r\n  File \"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/httplib.py\", line 373, in _read_status\r\n    raise BadStatusLine(line)\r\n**ProtocolError: ('Connection aborted.', BadStatusLine(\"''\",))**\r\n2015-08-17 12:07:25,450 DEBUG              elasticsearch       log_request_fail:90   > {\"indices\": \"mdp-2015.08.04\", \"partial\": false, \"ignore_unavailable\": false, \"include_global_state\": true}\r\n2015-08-17 12:07:25,450 DEBUG         urllib3.util.retry               from_int:155  Converted retries value: False -> Retry(total=False, connect=None, read=None, redirect=0)\r\n2015-08-17 12:07:25,451 INFO      urllib3.connectionpool              _new_conn:205  Starting new HTTP connection (2): haproxystaging\r\n2015-08-17 12:07:25,528 DEBUG     urllib3.connectionpool          _make_request:385  \"PUT /_snapshot/my_s3_repository/mdp-2015.08.04?wait_for_completion=true HTTP/1.1\" 503 233\r\n2015-08-17 12:07:25,528 WARNING            elasticsearch       log_request_fail:82   PUT /_snapshot/my_s3_repository/mdp-2015.08.04?wait_for_completion=true [status:503 request:0.077s]\r\n2015-08-17 12:07:25,528 DEBUG              elasticsearch       log_request_fail:90   > {\"indices\": \"mdp-2015.08.04\", \"partial\": false, \"ignore_unavailable\": false, \"include_global_state\": true}\r\n2015-08-17 12:07:25,528 DEBUG         urllib3.util.retry               from_int:155  Converted retries value: False -> Retry(total=False, connect=None, read=None, redirect=0)\r\n2015-08-17 12:07:25,536 DEBUG     urllib3.connectionpool          _make_request:385  \"PUT /_snapshot/my_s3_repository/mdp-2015.08.04?wait_for_completion=true HTTP/1.1\" 503 233\r\n2015-08-17 12:07:25,537 WARNING            elasticsearch       log_request_fail:82   PUT /_snapshot/my_s3_repository/mdp-2015.08.04?wait_for_completion=true [status:503 request:0.008s]\r\n2015-08-17 12:07:25,537 DEBUG              elasticsearch       log_request_fail:90   > {\"indices\": \"mdp-2015.08.04\", \"partial\": false, \"ignore_unavailable\": false, \"include_global_state\": true}\r\n2015-08-17 12:07:25,537 DEBUG         urllib3.util.retry               from_int:155  Converted retries value: False -> Retry(total=False, connect=None, read=None, redirect=0)\r\n2015-08-17 12:07:25,544 DEBUG     urllib3.connectionpool          _make_request:385  \"PUT /_snapshot/my_s3_repository/mdp-2015.08.04?wait_for_completion=true HTTP/1.1\" 503 233\r\n2015-08-17 12:07:25,544 WARNING            elasticsearch       log_request_fail:82   PUT /_snapshot/my_s3_repository/mdp-2015.08.04?wait_for_completion=true [status:503 request:0.007s]\r\n2015-08-17 12:07:25,544 DEBUG              elasticsearch       log_request_fail:90   > {\"indices\": \"mdp-2015.08.04\", \"partial\": false, \"ignore_unavailable\": false, \"include_global_state\": true}\r\n2015-08-17 12:07:25,544 ERROR       curator.api.snapshot        create_snapshot:91   Client raised a TransportError.\r\n2015-08-17 12:07:25,544 WARNING        curator.cli.utils               exit_msg:69   Job did not complete successfully.`\r\n\r\nand I'm confused where the bad status line is coming from given that before that it returned a giant list of all the snapshots I currently have in my repo."}}