{"action":"created","issue":{"url":"https://api.github.com/repos/berndbischl/mlr/issues/289","labels_url":"https://api.github.com/repos/berndbischl/mlr/issues/289/labels{/name}","comments_url":"https://api.github.com/repos/berndbischl/mlr/issues/289/comments","events_url":"https://api.github.com/repos/berndbischl/mlr/issues/289/events","html_url":"https://github.com/berndbischl/mlr/issues/289","id":71970015,"number":289,"title":"gsoc-visualization","user":{"login":"zmjones","id":1114501,"avatar_url":"https://avatars.githubusercontent.com/u/1114501?v=3","gravatar_id":"","url":"https://api.github.com/users/zmjones","html_url":"https://github.com/zmjones","followers_url":"https://api.github.com/users/zmjones/followers","following_url":"https://api.github.com/users/zmjones/following{/other_user}","gists_url":"https://api.github.com/users/zmjones/gists{/gist_id}","starred_url":"https://api.github.com/users/zmjones/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zmjones/subscriptions","organizations_url":"https://api.github.com/users/zmjones/orgs","repos_url":"https://api.github.com/users/zmjones/repos","events_url":"https://api.github.com/users/zmjones/events{/privacy}","received_events_url":"https://api.github.com/users/zmjones/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":21,"created_at":"2015-04-29T19:44:51Z","updated_at":"2015-05-06T22:22:54Z","closed_at":null,"body":"In the near future (before May 5) I plan on refactoring `plotROCRCurves` to use [plotROC](http://cran.r-project.org/web/packages/plotROC/index.html) which uses `ggplot2` instead of base graphics. This package offers some extra functionality (compared to what is available now) which I'll document. I also hope to get at least one other smallish feature done by then. \r\n\r\nOne option would be extending `plotLearnerPrediction` to cases with 3 features. I think the two obvious things to do here are to use one of the 3D plotting packages (I think [plot3Drgl](http://cran.r-project.org/web/packages/plot3Drgl/vignettes/plot3Drgl.pdf) is nice). Another thing I'd definitely like to do is to use facetting for the third feature. With a discrete feature this is easy but it might be nice to add the ability to discretize one of the features as well. We could also plot 4 features by using the background color as well. In general it would be possible to layer on additional features in this way but it seems to have diminishing returns in terms of interpretability after 2 or 3 features.\r\n\r\nAnother thing I could possibly do is to add an option to `performance` that lets you apply a measure to a subset of the feature space. I find this very useful for exploring the fit of learners, especially with data that is structured in some way. I haven't looked at the code for `performance` yet so i don't have an idea how much work that would entail. One problem i can see is that if some of the cells of the grouping are small the variance might be quite large. I am not sure whether that is out of the scope of the project. Is this is something others would like to have?\r\n\r\nWhen I get back (around May 16-17) I would like to finish up any residual work from the above first. I'd like to talk to Julia/Lars/Bernd about what I do next. I've had my nose in the EDA related functionality lately and so my inclination is to start working on that first. Alternatively I could start work on producing interactive versions of the existing plotting functionality.\r\n\r\nI have found some papers recently that I think are worth prioritizing above the minor things in my proposal (dependent data resampling methods and standard error estimates for random forests and other ensemble methods). In particular [Hooker 2012](http://www.tandfonline.com/doi/pdf/10.1198/106186007X237892) and [Drummond and Holte 2006](http://download-v2.springer.com/static/pdf/951/art%253A10.1007%252Fs10994-006-8199-5.pdf?token2=exp=1430337677~acl=%2Fstatic%2Fpdf%2F951%2Fart%25253A10.1007%25252Fs10994-006-8199-5.pdf*~hmac=b7d69b614d34a14935a52d058831fa50cbf8400d6a4f175bd2860e14cf3a61fd)."},"comment":{"url":"https://api.github.com/repos/berndbischl/mlr/issues/comments/99628835","html_url":"https://github.com/berndbischl/mlr/issues/289#issuecomment-99628835","issue_url":"https://api.github.com/repos/berndbischl/mlr/issues/289","id":99628835,"user":{"login":"larskotthoff","id":579233,"avatar_url":"https://avatars.githubusercontent.com/u/579233?v=3","gravatar_id":"","url":"https://api.github.com/users/larskotthoff","html_url":"https://github.com/larskotthoff","followers_url":"https://api.github.com/users/larskotthoff/followers","following_url":"https://api.github.com/users/larskotthoff/following{/other_user}","gists_url":"https://api.github.com/users/larskotthoff/gists{/gist_id}","starred_url":"https://api.github.com/users/larskotthoff/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/larskotthoff/subscriptions","organizations_url":"https://api.github.com/users/larskotthoff/orgs","repos_url":"https://api.github.com/users/larskotthoff/repos","events_url":"https://api.github.com/users/larskotthoff/events{/privacy}","received_events_url":"https://api.github.com/users/larskotthoff/received_events","type":"User","site_admin":false},"created_at":"2015-05-06T22:22:54Z","updated_at":"2015-05-06T22:22:54Z","body":"Yes, I'm in Vancouver so if you do happen to make it over here, give me a shout."}}