{"action":"created","issue":{"url":"https://api.github.com/repos/elasticsearch/curator/issues/259","labels_url":"https://api.github.com/repos/elasticsearch/curator/issues/259/labels{/name}","comments_url":"https://api.github.com/repos/elasticsearch/curator/issues/259/comments","events_url":"https://api.github.com/repos/elasticsearch/curator/issues/259/events","html_url":"https://github.com/elasticsearch/curator/issues/259","id":55465167,"number":259,"title":"Curator crashes on KeyErrors","user":{"login":"rtoma","id":2914051,"avatar_url":"https://avatars.githubusercontent.com/u/2914051?v=3","gravatar_id":"","url":"https://api.github.com/users/rtoma","html_url":"https://github.com/rtoma","followers_url":"https://api.github.com/users/rtoma/followers","following_url":"https://api.github.com/users/rtoma/following{/other_user}","gists_url":"https://api.github.com/users/rtoma/gists{/gist_id}","starred_url":"https://api.github.com/users/rtoma/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rtoma/subscriptions","organizations_url":"https://api.github.com/users/rtoma/orgs","repos_url":"https://api.github.com/users/rtoma/repos","events_url":"https://api.github.com/users/rtoma/events{/privacy}","received_events_url":"https://api.github.com/users/rtoma/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-01-26T10:10:07Z","updated_at":"2015-01-27T08:46:03Z","closed_at":null,"body":"We run curator 2.1.1 for some time and got 2 crashes like:\r\n```\r\nTraceback (most recent call last):\r\n  File \"/usr/bin/curator\", line 9, in <module>\r\n    load_entry_point('elasticsearch-curator==2.1.1', 'console_scripts', 'curator')()\r\n  File \"/usr/lib/python2.6/site-packages/curator/curator_script.py\", line 364, in main\r\n    arguments.func(client, **argdict)\r\n  File \"/usr/lib/python2.6/site-packages/curator/curator.py\", line 905, in bloom\r\n    _op_loop(client, matching_indices, op=disable_bloom_filter, dry_run=dry_run, **kwargs)\r\n  File \"/usr/lib/python2.6/site-packages/curator/curator.py\", line 746, in _op_loop\r\n    skipped = op(client, item, **kwargs)\r\n  File \"/usr/lib/python2.6/site-packages/curator/curator.py\", line 536, in disable_bloom_filter\r\n    if index_closed(client, index_name): # Don't try to disable bloom filter on a closed index.  It will re-open them\r\n  File \"/usr/lib/python2.6/site-packages/curator/curator.py\", line 149, in index_closed\r\n    return index_metadata['metadata']['indices'][index_name]['state'] == 'close'\r\nKeyError: u'logstash-xpr-log4json-2015.01.12'\r\n```\r\n\r\n\r\nAny ideas why?"},"comment":{"url":"https://api.github.com/repos/elasticsearch/curator/issues/comments/71610293","html_url":"https://github.com/elasticsearch/curator/issues/259#issuecomment-71610293","issue_url":"https://api.github.com/repos/elasticsearch/curator/issues/259","id":71610293,"user":{"login":"rtoma","id":2914051,"avatar_url":"https://avatars.githubusercontent.com/u/2914051?v=3","gravatar_id":"","url":"https://api.github.com/users/rtoma","html_url":"https://github.com/rtoma","followers_url":"https://api.github.com/users/rtoma/followers","following_url":"https://api.github.com/users/rtoma/following{/other_user}","gists_url":"https://api.github.com/users/rtoma/gists{/gist_id}","starred_url":"https://api.github.com/users/rtoma/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rtoma/subscriptions","organizations_url":"https://api.github.com/users/rtoma/orgs","repos_url":"https://api.github.com/users/rtoma/repos","events_url":"https://api.github.com/users/rtoma/events{/privacy}","received_events_url":"https://api.github.com/users/rtoma/received_events","type":"User","site_admin":false},"created_at":"2015-01-27T08:46:03Z","updated_at":"2015-01-27T08:46:03Z","body":"```\r\n$ fgrep xpr-log4json /usr/local/bin/curator.sh\r\n/usr/bin/curator --loglevel WARNING --timeout 3600 --host 10.98.252.244 optimize --prefix logstash-xpr-log4json- --older-than 2\r\n/usr/bin/curator --loglevel WARNING --timeout 3600 --host 10.98.252.244 delete --prefix logstash-xpr-log4json- --older-than 14\r\n/usr/bin/curator --loglevel WARNING --timeout 3600 --host 10.98.252.244 bloom --prefix logstash-xpr-log4json- --older-than 1\r\n```\r\n\r\nMaybe its a race condition between the delete and bloom command? Maybe the delete is async and still underway when the bloom starts?\r\n\r\nLast night, same cron, all went fine as did before last weekend. Supporting the race condition hypothesis."}}