{"action":"created","issue":{"url":"https://api.github.com/repos/alexandrebarachant/Grasp-and-lift-EEG-challenge/issues/1","labels_url":"https://api.github.com/repos/alexandrebarachant/Grasp-and-lift-EEG-challenge/issues/1/labels{/name}","comments_url":"https://api.github.com/repos/alexandrebarachant/Grasp-and-lift-EEG-challenge/issues/1/comments","events_url":"https://api.github.com/repos/alexandrebarachant/Grasp-and-lift-EEG-challenge/issues/1/events","html_url":"https://github.com/alexandrebarachant/Grasp-and-lift-EEG-challenge/issues/1","id":114679240,"number":1,"title":"Running trained models on different data","user":{"login":"Qwlouse","id":1160920,"avatar_url":"https://avatars.githubusercontent.com/u/1160920?v=3","gravatar_id":"","url":"https://api.github.com/users/Qwlouse","html_url":"https://github.com/Qwlouse","followers_url":"https://api.github.com/users/Qwlouse/followers","following_url":"https://api.github.com/users/Qwlouse/following{/other_user}","gists_url":"https://api.github.com/users/Qwlouse/gists{/gist_id}","starred_url":"https://api.github.com/users/Qwlouse/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Qwlouse/subscriptions","organizations_url":"https://api.github.com/users/Qwlouse/orgs","repos_url":"https://api.github.com/users/Qwlouse/repos","events_url":"https://api.github.com/users/Qwlouse/events{/privacy}","received_events_url":"https://api.github.com/users/Qwlouse/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-11-02T20:39:45Z","updated_at":"2015-11-03T19:48:09Z","closed_at":null,"body":"I've reproduced the results and verified that they are fine. However I'd like to run the trained models on some new data, and I can't seem to make that work. Maybe you could point me in the right direction? Is it at all possible without retraining everything, because to me it seems you didn't store any trained models, only their predictions. "},"comment":{"url":"https://api.github.com/repos/alexandrebarachant/Grasp-and-lift-EEG-challenge/issues/comments/153467333","html_url":"https://github.com/alexandrebarachant/Grasp-and-lift-EEG-challenge/issues/1#issuecomment-153467333","issue_url":"https://api.github.com/repos/alexandrebarachant/Grasp-and-lift-EEG-challenge/issues/1","id":153467333,"user":{"login":"alexandrebarachant","id":2145718,"avatar_url":"https://avatars.githubusercontent.com/u/2145718?v=3","gravatar_id":"","url":"https://api.github.com/users/alexandrebarachant","html_url":"https://github.com/alexandrebarachant","followers_url":"https://api.github.com/users/alexandrebarachant/followers","following_url":"https://api.github.com/users/alexandrebarachant/following{/other_user}","gists_url":"https://api.github.com/users/alexandrebarachant/gists{/gist_id}","starred_url":"https://api.github.com/users/alexandrebarachant/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alexandrebarachant/subscriptions","organizations_url":"https://api.github.com/users/alexandrebarachant/orgs","repos_url":"https://api.github.com/users/alexandrebarachant/repos","events_url":"https://api.github.com/users/alexandrebarachant/events{/privacy}","received_events_url":"https://api.github.com/users/alexandrebarachant/received_events","type":"User","site_admin":false},"created_at":"2015-11-03T19:48:09Z","updated_at":"2015-11-03T19:48:09Z","body":"Hi Klaus,\r\n\r\nThe bad new is that since we did not save the models so you will have to re-run things.\r\nThe good new is that you can keep validation predictions and therefore have to re-run only the test predictions. \r\n\r\nBefore getting to into the how to generate and save models, i strongly suggest to choose the \"safe1\" solution. It only involves a subset of 8 level2 models, and the performance does not change that much. It will be much faster to run.\r\n\r\nMost of the change are concerning level1 models. I assume your new data are in the same format as the other ones, so here we go :\r\n* Update meta-info, in genInfos.py, you will have to point out to your new files (L33). \r\n* Re-run genInfos.py\r\n* In preprocessing/aux.py , change the path L44 to point the new files.\r\n* do the same thing for genPreds_CNN_Tim.py and genPreds_RNN.py\r\n* re-run lvl1 models in **test mode only** (modify lvl1/genAll.sh)\r\n* re-run lvl2 models in **test mode only** (modify lvl2/genSafe1.sh)\r\n\r\nIf you want to save models, you could use the guideline provided by sklearn : http://scikit-learn.org/stable/modules/model_persistence.html\r\n\r\nFor lvl1, you will have to save pre-processing model, post-preprocessing, and final classifyer. for lvl2, you just need to save the classifyer"}}