{"action":"created","issue":{"url":"https://api.github.com/repos/archiecobbs/s3backer/issues/46","labels_url":"https://api.github.com/repos/archiecobbs/s3backer/issues/46/labels{/name}","comments_url":"https://api.github.com/repos/archiecobbs/s3backer/issues/46/comments","events_url":"https://api.github.com/repos/archiecobbs/s3backer/issues/46/events","html_url":"https://github.com/archiecobbs/s3backer/issues/46","id":88254107,"number":46,"title":"Multiple Object Delete Support","user":{"login":"xmas79","id":11197659,"avatar_url":"https://avatars.githubusercontent.com/u/11197659?v=3","gravatar_id":"","url":"https://api.github.com/users/xmas79","html_url":"https://github.com/xmas79","followers_url":"https://api.github.com/users/xmas79/followers","following_url":"https://api.github.com/users/xmas79/following{/other_user}","gists_url":"https://api.github.com/users/xmas79/gists{/gist_id}","starred_url":"https://api.github.com/users/xmas79/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/xmas79/subscriptions","organizations_url":"https://api.github.com/users/xmas79/orgs","repos_url":"https://api.github.com/users/xmas79/repos","events_url":"https://api.github.com/users/xmas79/events{/privacy}","received_events_url":"https://api.github.com/users/xmas79/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-06-14T21:49:57Z","updated_at":"2015-07-02T05:15:12Z","closed_at":null,"body":"When deleting multiple blocks the network usage is suboptimal since each block is deleted with a single delete request. It would be more effient to make a single delete request with multiple objects (reference http://docs.aws.amazon.com/AmazonS3/latest/API/multiobjectdeleteapi.html).\r\n\r\nThe --erase flag is the most impacted scenario, but normal usage (where filesystem is mounted with discard) could also get a boost (eg rm -rf /this/folder, or when deleting big files).\r\n\r\nAnother quirk seems to be the \"max-keys\" parameter of the GET /?marker.... http request (that is actually fixed at 256). It would be better to make it an option in the command line, and set its default to the system maximum (1000). This gives network efficiency during the initial block listing.\r\n"},"comment":{"url":"https://api.github.com/repos/archiecobbs/s3backer/issues/comments/117909004","html_url":"https://github.com/archiecobbs/s3backer/issues/46#issuecomment-117909004","issue_url":"https://api.github.com/repos/archiecobbs/s3backer/issues/46","id":117909004,"user":{"login":"xmas79","id":11197659,"avatar_url":"https://avatars.githubusercontent.com/u/11197659?v=3","gravatar_id":"","url":"https://api.github.com/users/xmas79","html_url":"https://github.com/xmas79","followers_url":"https://api.github.com/users/xmas79/followers","following_url":"https://api.github.com/users/xmas79/following{/other_user}","gists_url":"https://api.github.com/users/xmas79/gists{/gist_id}","starred_url":"https://api.github.com/users/xmas79/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/xmas79/subscriptions","organizations_url":"https://api.github.com/users/xmas79/orgs","repos_url":"https://api.github.com/users/xmas79/repos","events_url":"https://api.github.com/users/xmas79/events{/privacy}","received_events_url":"https://api.github.com/users/xmas79/received_events","type":"User","site_admin":false},"created_at":"2015-07-02T05:15:12Z","updated_at":"2015-07-02T05:15:12Z","body":"Hi Archie,\r\nsorry for closing this issue. I thought you could simply see the patches in the fork and merge them when reviewed the code and tested the functionalities I already implemented.\r\n\r\nAnd sorry for being so confusing in senting patches, but when I tried to implement the bulk delete I had to speed up the development process: testing a bulk delete means create (and put data!) and then delete a bunch of (big) filesystems, so I implemented other patches as well even before the bulk delete was functional.\r\n\r\nTake you time to review all the changes, and thanks.\r\n\r\n"}}