{"action":"created","issue":{"url":"https://api.github.com/repos/JuliaStats/DataFrames.jl/issues/754","labels_url":"https://api.github.com/repos/JuliaStats/DataFrames.jl/issues/754/labels{/name}","comments_url":"https://api.github.com/repos/JuliaStats/DataFrames.jl/issues/754/comments","events_url":"https://api.github.com/repos/JuliaStats/DataFrames.jl/issues/754/events","html_url":"https://github.com/JuliaStats/DataFrames.jl/pull/754","id":53230707,"number":754,"title":"Optimize RDA","user":{"login":"alyst","id":348591,"avatar_url":"https://avatars.githubusercontent.com/u/348591?v=3","gravatar_id":"","url":"https://api.github.com/users/alyst","html_url":"https://github.com/alyst","followers_url":"https://api.github.com/users/alyst/followers","following_url":"https://api.github.com/users/alyst/following{/other_user}","gists_url":"https://api.github.com/users/alyst/gists{/gist_id}","starred_url":"https://api.github.com/users/alyst/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alyst/subscriptions","organizations_url":"https://api.github.com/users/alyst/orgs","repos_url":"https://api.github.com/users/alyst/repos","events_url":"https://api.github.com/users/alyst/events{/privacy}","received_events_url":"https://api.github.com/users/alyst/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-01-01T22:43:51Z","updated_at":"2015-01-02T20:12:46Z","closed_at":"2015-01-01T23:35:42Z","pull_request":{"url":"https://api.github.com/repos/JuliaStats/DataFrames.jl/pulls/754","html_url":"https://github.com/JuliaStats/DataFrames.jl/pull/754","diff_url":"https://github.com/JuliaStats/DataFrames.jl/pull/754.diff","patch_url":"https://github.com/JuliaStats/DataFrames.jl/pull/754.patch"},"body":"* Decouple XDR and ASCII formats by subclassing RDAIO type. \r\n* Optimize the speed and memory footprint of RDA import by buffering and \"vectorizing\" column data reads.\r\n Reading of sample 84M binary RData file on my system before the patch:\r\n```\r\n[~]$ julia -e \"using DataFrames; @time read_rda(\\\"test.RData\\\")\"\r\n elapsed time: 52.973835777 seconds (5705277252 bytes allocated, 50.75% gc time)\r\n```\r\n  after:\r\n```\r\n[~]$ julia -e \"using DataFrames; @time read_rda(\\\"\\test.RData\\\")\"\r\nelapsed time: 15.160802834 seconds (2433811160 bytes allocated, 5.08% gc time)\r\n```\r\n* Support NAs in character vectors."},"comment":{"url":"https://api.github.com/repos/JuliaStats/DataFrames.jl/issues/comments/68558092","html_url":"https://github.com/JuliaStats/DataFrames.jl/pull/754#issuecomment-68558092","issue_url":"https://api.github.com/repos/JuliaStats/DataFrames.jl/issues/754","id":68558092,"user":{"login":"dmbates","id":371258,"avatar_url":"https://avatars.githubusercontent.com/u/371258?v=3","gravatar_id":"","url":"https://api.github.com/users/dmbates","html_url":"https://github.com/dmbates","followers_url":"https://api.github.com/users/dmbates/followers","following_url":"https://api.github.com/users/dmbates/following{/other_user}","gists_url":"https://api.github.com/users/dmbates/gists{/gist_id}","starred_url":"https://api.github.com/users/dmbates/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dmbates/subscriptions","organizations_url":"https://api.github.com/users/dmbates/orgs","repos_url":"https://api.github.com/users/dmbates/repos","events_url":"https://api.github.com/users/dmbates/events{/privacy}","received_events_url":"https://api.github.com/users/dmbates/received_events","type":"User","site_admin":false},"created_at":"2015-01-02T20:12:46Z","updated_at":"2015-01-02T20:12:46Z","body":"I just posted a message on the julia-users list regarding using an embedded R in Julia, which I think will be the way to go rather than refining RDA.jl or adding data sets to the RDatasets package.  Because R is Open Source it is reasonable to expect a user who wants to read saved R data to have R installed.  Then the hard work of reading saved R data can be relegated to R and just the results pulled into Julia.\r\n\r\nI plan to create a package under the JuliaStats group and would welcome others contributing to it."}}