{"action":"created","issue":{"url":"https://api.github.com/repos/isetbio/RemoteDataToolbox/issues/34","labels_url":"https://api.github.com/repos/isetbio/RemoteDataToolbox/issues/34/labels{/name}","comments_url":"https://api.github.com/repos/isetbio/RemoteDataToolbox/issues/34/comments","events_url":"https://api.github.com/repos/isetbio/RemoteDataToolbox/issues/34/events","html_url":"https://github.com/isetbio/RemoteDataToolbox/issues/34","id":123320979,"number":34,"title":"Cache performance tests","user":{"login":"npcottaris","id":3444212,"avatar_url":"https://avatars.githubusercontent.com/u/3444212?v=3","gravatar_id":"","url":"https://api.github.com/users/npcottaris","html_url":"https://github.com/npcottaris","followers_url":"https://api.github.com/users/npcottaris/followers","following_url":"https://api.github.com/users/npcottaris/following{/other_user}","gists_url":"https://api.github.com/users/npcottaris/gists{/gist_id}","starred_url":"https://api.github.com/users/npcottaris/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/npcottaris/subscriptions","organizations_url":"https://api.github.com/users/npcottaris/orgs","repos_url":"https://api.github.com/users/npcottaris/repos","events_url":"https://api.github.com/users/npcottaris/events{/privacy}","received_events_url":"https://api.github.com/users/npcottaris/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":11,"created_at":"2015-12-21T17:21:58Z","updated_at":"2015-12-23T17:32:23Z","closed_at":null,"body":"Hello,\r\n\r\nI did a little  testing by comparing the loading times for a dataset of hyperspectral images totaling 6.02 GB. Here are my findings:\r\n~~~\r\n* Loading from remote source: 1st time     |   144 seconds\r\n* Loading from remote source: 2nd time     |   134 seconds\r\n* Loading from remote source: 3rd time     |   135 seconds\r\n* Loading from local disk: 1st time        |    55 seconds\r\n* Loading from local disk: 2nd time        |    54 seconds\r\n* Loading from local disk: 3rd time        |    55 seconds\r\n~~~\r\n\r\nThe remote loading was done via\r\n~~~\r\nclient = RdtClient('isetbio');\r\nclient.crp(remotePath);\r\nclient.readArtifac(filename, 'type', filetype)\r\n~~~\r\n\r\n* The performance improvement during remote loading following the initial access is not that dramatic and does not approach the local loading performance.\r\n\r\n* Do we have to configure any settings to enable caching in the RDT, or is this done automatically?\r\n* If there is a cache directory, where is it located?\r\n\r\nNicolas\r\n"},"comment":{"url":"https://api.github.com/repos/isetbio/RemoteDataToolbox/issues/comments/166950963","html_url":"https://github.com/isetbio/RemoteDataToolbox/issues/34#issuecomment-166950963","issue_url":"https://api.github.com/repos/isetbio/RemoteDataToolbox/issues/34","id":166950963,"user":{"login":"DavidBrainard","id":1158757,"avatar_url":"https://avatars.githubusercontent.com/u/1158757?v=3","gravatar_id":"","url":"https://api.github.com/users/DavidBrainard","html_url":"https://github.com/DavidBrainard","followers_url":"https://api.github.com/users/DavidBrainard/followers","following_url":"https://api.github.com/users/DavidBrainard/following{/other_user}","gists_url":"https://api.github.com/users/DavidBrainard/gists{/gist_id}","starred_url":"https://api.github.com/users/DavidBrainard/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/DavidBrainard/subscriptions","organizations_url":"https://api.github.com/users/DavidBrainard/orgs","repos_url":"https://api.github.com/users/DavidBrainard/repos","events_url":"https://api.github.com/users/DavidBrainard/events{/privacy}","received_events_url":"https://api.github.com/users/DavidBrainard/received_events","type":"User","site_admin":false},"created_at":"2015-12-23T17:32:23Z","updated_at":"2015-12-23T17:32:23Z","body":"It might be worth someone at Stanford running the timing test script.  That will give us some sense of how much we might want location services.\r\n\r\nIt also seems like it might be useful to find out what is slow.  Is it the checking that the cache is up to date or the reading from the cache.  I have no idea how easy it would be to get the separate timing info.\r\n\r\nBen, you had an archiva instance in your room at one point.  I wonder how the timing compares to archiva on a local (not AWI) machine, for the same set of files."}}