{"action":"created","issue":{"url":"https://api.github.com/repos/lucidsoftware/cumulus/issues/105","labels_url":"https://api.github.com/repos/lucidsoftware/cumulus/issues/105/labels{/name}","comments_url":"https://api.github.com/repos/lucidsoftware/cumulus/issues/105/comments","events_url":"https://api.github.com/repos/lucidsoftware/cumulus/issues/105/events","html_url":"https://github.com/lucidsoftware/cumulus/pull/105","id":121758711,"number":105,"title":"Run resource executions in parallel","user":{"login":"pauldraper","id":1403271,"avatar_url":"https://avatars.githubusercontent.com/u/1403271?v=3","gravatar_id":"","url":"https://api.github.com/users/pauldraper","html_url":"https://github.com/pauldraper","followers_url":"https://api.github.com/users/pauldraper/followers","following_url":"https://api.github.com/users/pauldraper/following{/other_user}","gists_url":"https://api.github.com/users/pauldraper/gists{/gist_id}","starred_url":"https://api.github.com/users/pauldraper/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pauldraper/subscriptions","organizations_url":"https://api.github.com/users/pauldraper/orgs","repos_url":"https://api.github.com/users/pauldraper/repos","events_url":"https://api.github.com/users/pauldraper/events{/privacy}","received_events_url":"https://api.github.com/users/pauldraper/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":9,"created_at":"2015-12-11T17:48:11Z","updated_at":"2015-12-16T06:18:06Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/lucidsoftware/cumulus/pulls/105","html_url":"https://github.com/lucidsoftware/cumulus/pull/105","diff_url":"https://github.com/lucidsoftware/cumulus/pull/105.diff","patch_url":"https://github.com/lucidsoftware/cumulus/pull/105.patch"},"body":"Solves #80 \r\n\r\nFor me, it reduces an S3 diff from 140 to 20 seconds over wifi."},"comment":{"url":"https://api.github.com/repos/lucidsoftware/cumulus/issues/comments/165012443","html_url":"https://github.com/lucidsoftware/cumulus/pull/105#issuecomment-165012443","issue_url":"https://api.github.com/repos/lucidsoftware/cumulus/issues/105","id":165012443,"user":{"login":"pauldraper","id":1403271,"avatar_url":"https://avatars.githubusercontent.com/u/1403271?v=3","gravatar_id":"","url":"https://api.github.com/users/pauldraper","html_url":"https://github.com/pauldraper","followers_url":"https://api.github.com/users/pauldraper/followers","following_url":"https://api.github.com/users/pauldraper/following{/other_user}","gists_url":"https://api.github.com/users/pauldraper/gists{/gist_id}","starred_url":"https://api.github.com/users/pauldraper/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pauldraper/subscriptions","organizations_url":"https://api.github.com/users/pauldraper/orgs","repos_url":"https://api.github.com/users/pauldraper/repos","events_url":"https://api.github.com/users/pauldraper/events{/privacy}","received_events_url":"https://api.github.com/users/pauldraper/received_events","type":"User","site_admin":false},"created_at":"2015-12-16T06:18:06Z","updated_at":"2015-12-16T06:18:06Z","body":"> The problem I'm seeing with the retries still is that we are still hitting the throttling limit, but just trying more times.\r\n\r\nRetries are actually the [AWS-recommended](http://docs.aws.amazon.com/AWSEC2/latest/APIReference/query-api-troubleshooting.html#api-request-rate) solution to hitting their undocumented limits.\r\n\r\n> If an API request exceeds the API request rate for its category, the request returns the RequestLimitExceeded error code. To prevent this error, ensure that your application doesn't retry API requests at a high rate. You can do this by using care when polling and by using exponential back-off retries.\r\n\r\nBut we don't save much on ELBs anyway -- they take seconds not minutes to diff -- so I'm fine with setting the parallelism per API."}}