{"action":"created","issue":{"url":"https://api.github.com/repos/ClimbsRocks/machineJS/issues/109","labels_url":"https://api.github.com/repos/ClimbsRocks/machineJS/issues/109/labels{/name}","comments_url":"https://api.github.com/repos/ClimbsRocks/machineJS/issues/109/comments","events_url":"https://api.github.com/repos/ClimbsRocks/machineJS/issues/109/events","html_url":"https://github.com/ClimbsRocks/machineJS/issues/109","id":117622154,"number":109,"title":"only do long training on an algo if it is within a couple percent of our best","user":{"login":"ClimbsRocks","id":7017045,"avatar_url":"https://avatars.githubusercontent.com/u/7017045?v=3","gravatar_id":"","url":"https://api.github.com/users/ClimbsRocks","html_url":"https://github.com/ClimbsRocks","followers_url":"https://api.github.com/users/ClimbsRocks/followers","following_url":"https://api.github.com/users/ClimbsRocks/following{/other_user}","gists_url":"https://api.github.com/users/ClimbsRocks/gists{/gist_id}","starred_url":"https://api.github.com/users/ClimbsRocks/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ClimbsRocks/subscriptions","organizations_url":"https://api.github.com/users/ClimbsRocks/orgs","repos_url":"https://api.github.com/users/ClimbsRocks/repos","events_url":"https://api.github.com/users/ClimbsRocks/events{/privacy}","received_events_url":"https://api.github.com/users/ClimbsRocks/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-11-18T16:17:45Z","updated_at":"2015-11-19T07:55:27Z","closed_at":"2015-11-19T07:55:27Z","body":"send over our scores to the python script. \r\n\r\nbefore doing longTrain, make suer it's worth the investment. check that our score for this algo is within a few percent of our best score. \r\n\r\nwe will probably have to do this based on our training scores on the smaller dataset. those are cross-validated already, so should be reasonably representative. \r\n\r\nthe downside is that we will have fewer classifiers to feed into ensembler. \r\n\r\nthe upside is that we will avoid the incredibly expensive long training time (right now for random forests, it takes ~an order of magnitude longer to do the long training than it does to do the hyperparameter searching) for algorithms that are unlikely to be of much use for ensembler. \r\n\r\n\r\nnote that the first few algos will *always* be the \"best\" algos up to that point, so we should still have a decent spread of good and \"not so good\" algos to work with in ensembler."},"comment":{"url":"https://api.github.com/repos/ClimbsRocks/machineJS/issues/comments/157981442","html_url":"https://github.com/ClimbsRocks/machineJS/issues/109#issuecomment-157981442","issue_url":"https://api.github.com/repos/ClimbsRocks/machineJS/issues/109","id":157981442,"user":{"login":"ClimbsRocks","id":7017045,"avatar_url":"https://avatars.githubusercontent.com/u/7017045?v=3","gravatar_id":"","url":"https://api.github.com/users/ClimbsRocks","html_url":"https://github.com/ClimbsRocks","followers_url":"https://api.github.com/users/ClimbsRocks/followers","following_url":"https://api.github.com/users/ClimbsRocks/following{/other_user}","gists_url":"https://api.github.com/users/ClimbsRocks/gists{/gist_id}","starred_url":"https://api.github.com/users/ClimbsRocks/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ClimbsRocks/subscriptions","organizations_url":"https://api.github.com/users/ClimbsRocks/orgs","repos_url":"https://api.github.com/users/ClimbsRocks/repos","events_url":"https://api.github.com/users/ClimbsRocks/events{/privacy}","received_events_url":"https://api.github.com/users/ClimbsRocks/received_events","type":"User","site_admin":false},"created_at":"2015-11-19T07:55:27Z","updated_at":"2015-11-19T07:55:27Z","body":"finished! this should prove highly effective at having us spend our time on the best algos"}}