{"action":"created","issue":{"url":"https://api.github.com/repos/hadley/dplyr/issues/145","labels_url":"https://api.github.com/repos/hadley/dplyr/issues/145/labels{/name}","comments_url":"https://api.github.com/repos/hadley/dplyr/issues/145/comments","events_url":"https://api.github.com/repos/hadley/dplyr/issues/145/events","html_url":"https://github.com/hadley/dplyr/issues/145","id":23698036,"number":145,"title":"parallel execution","user":{"login":"romainfrancois","id":2625526,"avatar_url":"https://avatars.githubusercontent.com/u/2625526?v=3","gravatar_id":"","url":"https://api.github.com/users/romainfrancois","html_url":"https://github.com/romainfrancois","followers_url":"https://api.github.com/users/romainfrancois/followers","following_url":"https://api.github.com/users/romainfrancois/following{/other_user}","gists_url":"https://api.github.com/users/romainfrancois/gists{/gist_id}","starred_url":"https://api.github.com/users/romainfrancois/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/romainfrancois/subscriptions","organizations_url":"https://api.github.com/users/romainfrancois/orgs","repos_url":"https://api.github.com/users/romainfrancois/repos","events_url":"https://api.github.com/users/romainfrancois/events{/privacy}","received_events_url":"https://api.github.com/users/romainfrancois/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/hadley/dplyr/milestones/1","html_url":"https://github.com/hadley/dplyr/milestones/bluesky","labels_url":"https://api.github.com/repos/hadley/dplyr/milestones/1/labels","id":491295,"number":1,"title":"bluesky","description":"Things that would be awesome to do one day, but are not an immediate priority","creator":{"login":"hadley","id":4196,"avatar_url":"https://avatars.githubusercontent.com/u/4196?v=3","gravatar_id":"","url":"https://api.github.com/users/hadley","html_url":"https://github.com/hadley","followers_url":"https://api.github.com/users/hadley/followers","following_url":"https://api.github.com/users/hadley/following{/other_user}","gists_url":"https://api.github.com/users/hadley/gists{/gist_id}","starred_url":"https://api.github.com/users/hadley/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hadley/subscriptions","organizations_url":"https://api.github.com/users/hadley/orgs","repos_url":"https://api.github.com/users/hadley/repos","events_url":"https://api.github.com/users/hadley/events{/privacy}","received_events_url":"https://api.github.com/users/hadley/received_events","type":"User","site_admin":false},"open_issues":8,"closed_issues":6,"state":"open","created_at":"2013-11-20T17:26:48Z","updated_at":"2015-08-24T22:10:46Z","due_on":null,"closed_at":null},"comments":13,"created_at":"2013-12-04T07:00:44Z","updated_at":"2015-10-07T13:34:21Z","closed_at":"2014-07-28T16:04:26Z","body":"There are cases where we might be able to parallelise the execution. Of course that is hard because of how R is implemented, but when we have an expression that is completely hybrid (not sure the term is right). \r\n\r\n```\r\nsummarise( df, v = mean(x) )\r\n```\r\n\r\nThere is no reason we can't calculate the means in parallel. \r\n\r\nThe difficulty is identifying whether some expression can be run in parallel. Perhaps we'd have to include this information in a `virtual` method of `Result`. \r\n"},"comment":{"url":"https://api.github.com/repos/hadley/dplyr/issues/comments/146197765","html_url":"https://github.com/hadley/dplyr/issues/145#issuecomment-146197765","issue_url":"https://api.github.com/repos/hadley/dplyr/issues/145","id":146197765,"user":{"login":"koaning","id":1019791,"avatar_url":"https://avatars.githubusercontent.com/u/1019791?v=3","gravatar_id":"","url":"https://api.github.com/users/koaning","html_url":"https://github.com/koaning","followers_url":"https://api.github.com/users/koaning/followers","following_url":"https://api.github.com/users/koaning/following{/other_user}","gists_url":"https://api.github.com/users/koaning/gists{/gist_id}","starred_url":"https://api.github.com/users/koaning/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/koaning/subscriptions","organizations_url":"https://api.github.com/users/koaning/orgs","repos_url":"https://api.github.com/users/koaning/repos","events_url":"https://api.github.com/users/koaning/events{/privacy}","received_events_url":"https://api.github.com/users/koaning/received_events","type":"User","site_admin":false},"created_at":"2015-10-07T13:34:21Z","updated_at":"2015-10-07T13:34:21Z","body":"+1 \r\n\r\nI'm currently using Spark locally to get a performance boost to help with some of the tasks. It helps but I don't see SparkR giving me the level of flexibility that dplyr does anytime soon. I especially miss `do`, which might never make the cut."}}