{"action":"created","issue":{"url":"https://api.github.com/repos/IKANOW/Aleph2/issues/24","labels_url":"https://api.github.com/repos/IKANOW/Aleph2/issues/24/labels{/name}","comments_url":"https://api.github.com/repos/IKANOW/Aleph2/issues/24/comments","events_url":"https://api.github.com/repos/IKANOW/Aleph2/issues/24/events","html_url":"https://github.com/IKANOW/Aleph2/issues/24","id":99425910,"number":24,"title":"Add user configurable concurrency to CRUD service batch processor (+other settings)","user":{"login":"Alex-Ikanow","id":851950,"avatar_url":"https://avatars.githubusercontent.com/u/851950?v=3","gravatar_id":"","url":"https://api.github.com/users/Alex-Ikanow","html_url":"https://github.com/Alex-Ikanow","followers_url":"https://api.github.com/users/Alex-Ikanow/followers","following_url":"https://api.github.com/users/Alex-Ikanow/following{/other_user}","gists_url":"https://api.github.com/users/Alex-Ikanow/gists{/gist_id}","starred_url":"https://api.github.com/users/Alex-Ikanow/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Alex-Ikanow/subscriptions","organizations_url":"https://api.github.com/users/Alex-Ikanow/orgs","repos_url":"https://api.github.com/users/Alex-Ikanow/repos","events_url":"https://api.github.com/users/Alex-Ikanow/events{/privacy}","received_events_url":"https://api.github.com/users/Alex-Ikanow/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/IKANOW/Aleph2/labels/enhancement","name":"enhancement","color":"84b6eb"},{"url":"https://api.github.com/repos/IKANOW/Aleph2/labels/in_progress","name":"in_progress","color":"fbca04"}],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/IKANOW/Aleph2/milestones/3","html_url":"https://github.com/IKANOW/Aleph2/milestones/September%202015%20delivery","labels_url":"https://api.github.com/repos/IKANOW/Aleph2/milestones/3/labels","id":1218091,"number":3,"title":"September 2015 delivery","description":"","creator":{"login":"Alex-Ikanow","id":851950,"avatar_url":"https://avatars.githubusercontent.com/u/851950?v=3","gravatar_id":"","url":"https://api.github.com/users/Alex-Ikanow","html_url":"https://github.com/Alex-Ikanow","followers_url":"https://api.github.com/users/Alex-Ikanow/followers","following_url":"https://api.github.com/users/Alex-Ikanow/following{/other_user}","gists_url":"https://api.github.com/users/Alex-Ikanow/gists{/gist_id}","starred_url":"https://api.github.com/users/Alex-Ikanow/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Alex-Ikanow/subscriptions","organizations_url":"https://api.github.com/users/Alex-Ikanow/orgs","repos_url":"https://api.github.com/users/Alex-Ikanow/repos","events_url":"https://api.github.com/users/Alex-Ikanow/events{/privacy}","received_events_url":"https://api.github.com/users/Alex-Ikanow/received_events","type":"User","site_admin":false},"open_issues":12,"closed_issues":1,"state":"open","created_at":"2015-07-21T13:22:31Z","updated_at":"2015-08-21T22:13:26Z","due_on":"2015-08-31T04:00:00Z","closed_at":null},"comments":2,"created_at":"2015-08-06T12:40:35Z","updated_at":"2015-08-21T22:30:43Z","closed_at":null,"body":"(and plumb into elasticsearch crud module)"},"comment":{"url":"https://api.github.com/repos/IKANOW/Aleph2/issues/comments/133580055","html_url":"https://github.com/IKANOW/Aleph2/issues/24#issuecomment-133580055","issue_url":"https://api.github.com/repos/IKANOW/Aleph2/issues/24","id":133580055,"user":{"login":"Alex-Ikanow","id":851950,"avatar_url":"https://avatars.githubusercontent.com/u/851950?v=3","gravatar_id":"","url":"https://api.github.com/users/Alex-Ikanow","html_url":"https://github.com/Alex-Ikanow","followers_url":"https://api.github.com/users/Alex-Ikanow/followers","following_url":"https://api.github.com/users/Alex-Ikanow/following{/other_user}","gists_url":"https://api.github.com/users/Alex-Ikanow/gists{/gist_id}","starred_url":"https://api.github.com/users/Alex-Ikanow/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Alex-Ikanow/subscriptions","organizations_url":"https://api.github.com/users/Alex-Ikanow/orgs","repos_url":"https://api.github.com/users/Alex-Ikanow/repos","events_url":"https://api.github.com/users/Alex-Ikanow/events{/privacy}","received_events_url":"https://api.github.com/users/Alex-Ikanow/received_events","type":"User","site_admin":false},"created_at":"2015-08-21T22:30:43Z","updated_at":"2015-08-21T22:30:43Z","body":"Ongoing issues\r\n\r\n1) Need to add an alias r__<index-name> covering all the cases ... unfortunately there's no easy way of doing that in the temporal case.\r\n\r\nMaybe in the non-temporal case you can add aliases, and the temporal case you have to handle it a bit differently anyway because of the data, so accept you have to \"blah\"* there?\r\n\r\nIs there some way of putting a hook in ES so when it creates a new index it will run some JS code, or something like that? (Preferably without installng a plugin). The alternative is to have some reasonably frequent loop to check for such cases and accept that there'll be a time between a new day occurring and the data being accessible via the r__ alias\r\n\r\n2) One annoyance is that if you swap between temporal and non-temporal, the wildcard is really annoying because\r\nbase_index_1\r\nbase_index_2015\r\ncan't really be differentiated... \r\n\r\n3) ... of course if the plan is to do base_index* anyway then it doesn't really matter I suppose.\r\n\r\nThe only issue is that if you are in temporal mode base_index_2015 and then you switch to non-temporal mode (base_index), then a standard search on base_index* will bring back everything\r\n\r\nI guess that's arguably what you want anyway, ie to treat base_index* as \"all the data\"\r\n\r\nOK I'm sold on that.\r\n\r\n\r\n\r\n"}}