{"action":"created","issue":{"url":"https://api.github.com/repos/dogestry/dogestry/issues/36","labels_url":"https://api.github.com/repos/dogestry/dogestry/issues/36/labels{/name}","comments_url":"https://api.github.com/repos/dogestry/dogestry/issues/36/comments","events_url":"https://api.github.com/repos/dogestry/dogestry/issues/36/events","html_url":"https://github.com/dogestry/dogestry/issues/36","id":57506274,"number":36,"title":"Optimizations to exporting an image","user":{"login":"amjith","id":49260,"avatar_url":"https://avatars.githubusercontent.com/u/49260?v=3","gravatar_id":"","url":"https://api.github.com/users/amjith","html_url":"https://github.com/amjith","followers_url":"https://api.github.com/users/amjith/followers","following_url":"https://api.github.com/users/amjith/following{/other_user}","gists_url":"https://api.github.com/users/amjith/gists{/gist_id}","starred_url":"https://api.github.com/users/amjith/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/amjith/subscriptions","organizations_url":"https://api.github.com/users/amjith/orgs","repos_url":"https://api.github.com/users/amjith/repos","events_url":"https://api.github.com/users/amjith/events{/privacy}","received_events_url":"https://api.github.com/users/amjith/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-02-12T19:19:58Z","updated_at":"2015-02-20T00:55:55Z","closed_at":null,"body":"Capturing @relistan's ideas for reducing the IO writes. \r\n\r\n1. Get the list of missing layers in S3 that needs to be uploaded. Start streaming the tar file from docker export for an image. For each file that is encountered in the streaming tar, only uncompress the files that are in the missing layers list, skip over the files that are not in the missing list. This way we only uncompress/write the missing layers to disk.\r\n\r\n2. If item 1 is not possible, then export the docker image as a tar file into the temp folder. Instead of untaring the whole archive and picking the files we need to upload, only pull the necessary files from the tar archive directly, thus saving a disk write for untaring all the files. \r\n\r\n/cc @toffer "},"comment":{"url":"https://api.github.com/repos/dogestry/dogestry/issues/comments/75171183","html_url":"https://github.com/dogestry/dogestry/issues/36#issuecomment-75171183","issue_url":"https://api.github.com/repos/dogestry/dogestry/issues/36","id":75171183,"user":{"login":"toffer","id":67997,"avatar_url":"https://avatars.githubusercontent.com/u/67997?v=3","gravatar_id":"","url":"https://api.github.com/users/toffer","html_url":"https://github.com/toffer","followers_url":"https://api.github.com/users/toffer/followers","following_url":"https://api.github.com/users/toffer/following{/other_user}","gists_url":"https://api.github.com/users/toffer/gists{/gist_id}","starred_url":"https://api.github.com/users/toffer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/toffer/subscriptions","organizations_url":"https://api.github.com/users/toffer/orgs","repos_url":"https://api.github.com/users/toffer/repos","events_url":"https://api.github.com/users/toffer/events{/privacy}","received_events_url":"https://api.github.com/users/toffer/received_events","type":"User","site_admin":false},"created_at":"2015-02-20T00:55:54Z","updated_at":"2015-02-20T00:55:54Z","body":"Option 1 is a good idea, and should be totally doable...which means we can skip worrying about option 2!\r\n"}}