{"action":"created","issue":{"url":"https://api.github.com/repos/stockit/stockit/issues/4","labels_url":"https://api.github.com/repos/stockit/stockit/issues/4/labels{/name}","comments_url":"https://api.github.com/repos/stockit/stockit/issues/4/comments","events_url":"https://api.github.com/repos/stockit/stockit/issues/4/events","html_url":"https://github.com/stockit/stockit/issues/4","id":71363991,"number":4,"title":"Matrix Running","user":{"login":"johnmcconnell","id":1870400,"avatar_url":"https://avatars.githubusercontent.com/u/1870400?v=3","gravatar_id":"","url":"https://api.github.com/users/johnmcconnell","html_url":"https://github.com/johnmcconnell","followers_url":"https://api.github.com/users/johnmcconnell/followers","following_url":"https://api.github.com/users/johnmcconnell/following{/other_user}","gists_url":"https://api.github.com/users/johnmcconnell/gists{/gist_id}","starred_url":"https://api.github.com/users/johnmcconnell/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/johnmcconnell/subscriptions","organizations_url":"https://api.github.com/users/johnmcconnell/orgs","repos_url":"https://api.github.com/users/johnmcconnell/repos","events_url":"https://api.github.com/users/johnmcconnell/events{/privacy}","received_events_url":"https://api.github.com/users/johnmcconnell/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-04-27T18:25:41Z","updated_at":"2015-04-27T18:27:27Z","closed_at":null,"body":"Right now we currently grab all document in the order they are published like so:\r\n|---early documents---------------------------------------later documents---------|\r\n\r\nWe split them in to training and test\r\n|-------training (all the early documents)-----|\r\nand \r\n|------- test (all the later documents) ---------|\r\n\r\nWe _*shuffle*_ test documents and produce five folds\r\n|---fold---|---fold2---|---fold3---|---fold4---|---fold5---|\r\n\r\nWe then test the accuracy of each fold.\r\n\r\nI would like to create n test and training folds and then create 5 test folds for a given test fold like so:\r\n|---early documents---------------------------------------later documents-----|\r\n|-----training 1-----|-------test 1--------|\r\n..............................|-----training 2-----|-------test 2--------|\r\n............................................................|-----training 3-----|-------test 3--------|\r\n\r\nThen repeat the test process from above.\r\nThanks @dmcquillan314 "},"comment":{"url":"https://api.github.com/repos/stockit/stockit/issues/comments/96770859","html_url":"https://github.com/stockit/stockit/issues/4#issuecomment-96770859","issue_url":"https://api.github.com/repos/stockit/stockit/issues/4","id":96770859,"user":{"login":"johnmcconnell","id":1870400,"avatar_url":"https://avatars.githubusercontent.com/u/1870400?v=3","gravatar_id":"","url":"https://api.github.com/users/johnmcconnell","html_url":"https://github.com/johnmcconnell","followers_url":"https://api.github.com/users/johnmcconnell/followers","following_url":"https://api.github.com/users/johnmcconnell/following{/other_user}","gists_url":"https://api.github.com/users/johnmcconnell/gists{/gist_id}","starred_url":"https://api.github.com/users/johnmcconnell/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/johnmcconnell/subscriptions","organizations_url":"https://api.github.com/users/johnmcconnell/orgs","repos_url":"https://api.github.com/users/johnmcconnell/repos","events_url":"https://api.github.com/users/johnmcconnell/events{/privacy}","received_events_url":"https://api.github.com/users/johnmcconnell/received_events","type":"User","site_admin":false},"created_at":"2015-04-27T18:27:27Z","updated_at":"2015-04-27T18:27:27Z","body":"In end we should have 25 separate runs"}}