{"action":"created","issue":{"url":"https://api.github.com/repos/berndbischl/mlr/issues/233","labels_url":"https://api.github.com/repos/berndbischl/mlr/issues/233/labels{/name}","comments_url":"https://api.github.com/repos/berndbischl/mlr/issues/233/comments","events_url":"https://api.github.com/repos/berndbischl/mlr/issues/233/events","html_url":"https://github.com/berndbischl/mlr/issues/233","id":56715271,"number":233,"title":"Tutorial: Nested resampling should probably be its own section in \"advanced\"","user":{"login":"berndbischl","id":1225974,"avatar_url":"https://avatars.githubusercontent.com/u/1225974?v=3","gravatar_id":"","url":"https://api.github.com/users/berndbischl","html_url":"https://github.com/berndbischl","followers_url":"https://api.github.com/users/berndbischl/followers","following_url":"https://api.github.com/users/berndbischl/following{/other_user}","gists_url":"https://api.github.com/users/berndbischl/gists{/gist_id}","starred_url":"https://api.github.com/users/berndbischl/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/berndbischl/subscriptions","organizations_url":"https://api.github.com/users/berndbischl/orgs","repos_url":"https://api.github.com/users/berndbischl/repos","events_url":"https://api.github.com/users/berndbischl/events{/privacy}","received_events_url":"https://api.github.com/users/berndbischl/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/berndbischl/mlr/labels/tutorial","name":"tutorial","color":"f7c6c7"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-02-05T19:16:36Z","updated_at":"2015-05-28T16:30:40Z","closed_at":null,"body":""},"comment":{"url":"https://api.github.com/repos/berndbischl/mlr/issues/comments/106467745","html_url":"https://github.com/berndbischl/mlr/issues/233#issuecomment-106467745","issue_url":"https://api.github.com/repos/berndbischl/mlr/issues/233","id":106467745,"user":{"login":"rpinsler","id":4355273,"avatar_url":"https://avatars.githubusercontent.com/u/4355273?v=3","gravatar_id":"","url":"https://api.github.com/users/rpinsler","html_url":"https://github.com/rpinsler","followers_url":"https://api.github.com/users/rpinsler/followers","following_url":"https://api.github.com/users/rpinsler/following{/other_user}","gists_url":"https://api.github.com/users/rpinsler/gists{/gist_id}","starred_url":"https://api.github.com/users/rpinsler/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rpinsler/subscriptions","organizations_url":"https://api.github.com/users/rpinsler/orgs","repos_url":"https://api.github.com/users/rpinsler/repos","events_url":"https://api.github.com/users/rpinsler/events{/privacy}","received_events_url":"https://api.github.com/users/rpinsler/received_events","type":"User","site_admin":false},"created_at":"2015-05-28T16:30:40Z","updated_at":"2015-05-28T16:30:40Z","body":"The nested resampling tutorial itself seems alright. For benchmarking, I think if the process differs from the single task/single learner setup (see above), then this should be pointed out. Furthermore, it would be interesting to see an example of what you can do with the benchmark results, e.g. visualize performances and pick the best one (similar to: http://topepo.github.io/caret/training.html#resamp). However, it seems that currently there is also some visualization functionality missing or in progress which might fit here."}}