{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/curator/issues/420","labels_url":"https://api.github.com/repos/elastic/curator/issues/420/labels{/name}","comments_url":"https://api.github.com/repos/elastic/curator/issues/420/comments","events_url":"https://api.github.com/repos/elastic/curator/issues/420/events","html_url":"https://github.com/elastic/curator/issues/420","id":91110147,"number":420,"title":"curator v3.2.0 reporting successful indices deletion, but does not actually deleted them","user":{"login":"TinLe","id":465041,"avatar_url":"https://avatars.githubusercontent.com/u/465041?v=3","gravatar_id":"","url":"https://api.github.com/users/TinLe","html_url":"https://github.com/TinLe","followers_url":"https://api.github.com/users/TinLe/followers","following_url":"https://api.github.com/users/TinLe/following{/other_user}","gists_url":"https://api.github.com/users/TinLe/gists{/gist_id}","starred_url":"https://api.github.com/users/TinLe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/TinLe/subscriptions","organizations_url":"https://api.github.com/users/TinLe/orgs","repos_url":"https://api.github.com/users/TinLe/repos","events_url":"https://api.github.com/users/TinLe/events{/privacy}","received_events_url":"https://api.github.com/users/TinLe/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-06-26T00:19:17Z","updated_at":"2015-06-26T03:06:12Z","closed_at":null,"body":"I have a cluster with bunch of old indices that I want to prune, keeping only latest 7 days.  I run the command.\r\n\r\n$ curator --port 9217 --timeout 900 delete indices --timestring \"%Y.%m.%d\" --older-than 7 --time-unit days\r\n2015-06-25 16:54:49,038 INFO      Job starting: delete indices\r\n2015-06-25 16:54:49,628 INFO      Pruning Kibana-related indices to prevent accidental deletion.\r\n2015-06-25 16:54:49,628 WARNING   Very large list of indices.  Breaking it up into smaller chunks.\r\n2015-06-25 16:54:49,629 INFO      Deleting indices as a batch operation:\r\n.....bunch of outputs\r\n2015-06-25 16:55:33,241 INFO      Job completed successfully.\r\n\r\nBut that is not true.   I checked and there are still many indices that were supposed to be deleted and were not.   So if I run the same command multiple times, eventually all the indices get deleted.\r\n\r\nThe output of multiple runs is fairly long, I'll put them in a gist here:\r\nhttps://gist.github.com/TinLe/c64dbe495e0c2d228a6b\r\n\r\nThe last few runs correctly gave Error or Warnings, so that part is correct.   The error/warning were because the cluster just started creating new daily indices, so were busy with initializing shards (yellow status).   Once the cluster got done with the new indices, the deletion completed fine.   When I started the deletion, the cluster was relatively quiet and in green status.\r\n\r\nThe bug is that curator is reporting \"Job completed successfully\" when obviously that is not the case.\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/elastic/curator/issues/comments/115482744","html_url":"https://github.com/elastic/curator/issues/420#issuecomment-115482744","issue_url":"https://api.github.com/repos/elastic/curator/issues/420","id":115482744,"user":{"login":"untergeek","id":1020383,"avatar_url":"https://avatars.githubusercontent.com/u/1020383?v=3","gravatar_id":"","url":"https://api.github.com/users/untergeek","html_url":"https://github.com/untergeek","followers_url":"https://api.github.com/users/untergeek/followers","following_url":"https://api.github.com/users/untergeek/following{/other_user}","gists_url":"https://api.github.com/users/untergeek/gists{/gist_id}","starred_url":"https://api.github.com/users/untergeek/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/untergeek/subscriptions","organizations_url":"https://api.github.com/users/untergeek/orgs","repos_url":"https://api.github.com/users/untergeek/repos","events_url":"https://api.github.com/users/untergeek/events{/privacy}","received_events_url":"https://api.github.com/users/untergeek/received_events","type":"User","site_admin":false},"created_at":"2015-06-26T03:06:12Z","updated_at":"2015-06-26T03:06:12Z","body":"I count 94 indices you're trying to delete at once.  This translates into 940 shards, at the default 5+1.  The first pass is 66 indices, which would be 660 shards at the default 5+1.\r\n\r\nIs 5+1 your index template?  Or are you creating these with more or fewer shards/replicas?"}}