{"action":"created","issue":{"url":"https://api.github.com/repos/facelessuser/Rummage/issues/65","labels_url":"https://api.github.com/repos/facelessuser/Rummage/issues/65/labels{/name}","comments_url":"https://api.github.com/repos/facelessuser/Rummage/issues/65/comments","events_url":"https://api.github.com/repos/facelessuser/Rummage/issues/65/events","html_url":"https://github.com/facelessuser/Rummage/issues/65","id":89988992,"number":65,"title":"Maybe use memory mapped files","user":{"login":"facelessuser","id":1055125,"avatar_url":"https://avatars.githubusercontent.com/u/1055125?v=3","gravatar_id":"","url":"https://api.github.com/users/facelessuser","html_url":"https://github.com/facelessuser","followers_url":"https://api.github.com/users/facelessuser/followers","following_url":"https://api.github.com/users/facelessuser/following{/other_user}","gists_url":"https://api.github.com/users/facelessuser/gists{/gist_id}","starred_url":"https://api.github.com/users/facelessuser/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/facelessuser/subscriptions","organizations_url":"https://api.github.com/users/facelessuser/orgs","repos_url":"https://api.github.com/users/facelessuser/repos","events_url":"https://api.github.com/users/facelessuser/events{/privacy}","received_events_url":"https://api.github.com/users/facelessuser/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/facelessuser/Rummage/labels/Enhancement","name":"Enhancement","color":"207de5"},{"url":"https://api.github.com/repos/facelessuser/Rummage/labels/Maybe","name":"Maybe","color":"bfd4f2"},{"url":"https://api.github.com/repos/facelessuser/Rummage/labels/Priority%20-%20Medium","name":"Priority - Medium","color":"fef2c0"}],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/facelessuser/Rummage/milestones/1","html_url":"https://github.com/facelessuser/Rummage/milestones/1.0.0","labels_url":"https://api.github.com/repos/facelessuser/Rummage/milestones/1/labels","id":1172784,"number":1,"title":"1.0.0","description":"","creator":{"login":"facelessuser","id":1055125,"avatar_url":"https://avatars.githubusercontent.com/u/1055125?v=3","gravatar_id":"","url":"https://api.github.com/users/facelessuser","html_url":"https://github.com/facelessuser","followers_url":"https://api.github.com/users/facelessuser/followers","following_url":"https://api.github.com/users/facelessuser/following{/other_user}","gists_url":"https://api.github.com/users/facelessuser/gists{/gist_id}","starred_url":"https://api.github.com/users/facelessuser/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/facelessuser/subscriptions","organizations_url":"https://api.github.com/users/facelessuser/orgs","repos_url":"https://api.github.com/users/facelessuser/repos","events_url":"https://api.github.com/users/facelessuser/events{/privacy}","received_events_url":"https://api.github.com/users/facelessuser/received_events","type":"User","site_admin":false},"open_issues":10,"closed_issues":0,"state":"open","created_at":"2015-06-19T17:30:17Z","updated_at":"2015-06-22T14:30:41Z","due_on":null,"closed_at":null},"comments":2,"created_at":"2015-06-22T01:54:15Z","updated_at":"2015-06-28T15:50:23Z","closed_at":null,"body":"I am looking for a way to increase performance of really large files.  Assuming my understanding is correct, this could help.  I feel like it may have a slightly negative impact on small files, but I am hoping it has overall positive effect increasing performance on big files.\r\n\r\nThis is not guaranteed to make it in, but this is to track evaluation of it before 1.0.0."},"comment":{"url":"https://api.github.com/repos/facelessuser/Rummage/issues/comments/116293533","html_url":"https://github.com/facelessuser/Rummage/issues/65#issuecomment-116293533","issue_url":"https://api.github.com/repos/facelessuser/Rummage/issues/65","id":116293533,"user":{"login":"facelessuser","id":1055125,"avatar_url":"https://avatars.githubusercontent.com/u/1055125?v=3","gravatar_id":"","url":"https://api.github.com/users/facelessuser","html_url":"https://github.com/facelessuser","followers_url":"https://api.github.com/users/facelessuser/followers","following_url":"https://api.github.com/users/facelessuser/following{/other_user}","gists_url":"https://api.github.com/users/facelessuser/gists{/gist_id}","starred_url":"https://api.github.com/users/facelessuser/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/facelessuser/subscriptions","organizations_url":"https://api.github.com/users/facelessuser/orgs","repos_url":"https://api.github.com/users/facelessuser/repos","events_url":"https://api.github.com/users/facelessuser/events{/privacy}","received_events_url":"https://api.github.com/users/facelessuser/received_events","type":"User","site_admin":false},"created_at":"2015-06-28T15:50:23Z","updated_at":"2015-06-28T15:50:23Z","body":"After further reading, it sounds like using this won't read the whole file in memory, though you reserve the virtual memory for the file (this will pose a problem if you try and read the whole thing in, but if reading only parts, the size could exceed actual size as it is only reserving the size.  On 32 bit systems, 4GB would be the limit; I'm okay with this.\r\n\r\nIn general, replacing would be the biggest issue as here we read the whole thing in.  I'm not worried about this, this tool shouldn't be used for such large files.  It just isn't fast enough.  We should just swallow the error, quit processing, and move on."}}