{"action":"created","issue":{"url":"https://api.github.com/repos/peteflorence/Machine-Learning-6.867-homework/issues/32","labels_url":"https://api.github.com/repos/peteflorence/Machine-Learning-6.867-homework/issues/32/labels{/name}","comments_url":"https://api.github.com/repos/peteflorence/Machine-Learning-6.867-homework/issues/32/comments","events_url":"https://api.github.com/repos/peteflorence/Machine-Learning-6.867-homework/issues/32/events","html_url":"https://github.com/peteflorence/Machine-Learning-6.867-homework/issues/32","id":117928468,"number":32,"title":"SARSA","user":{"login":"manuelli","id":5898488,"avatar_url":"https://avatars.githubusercontent.com/u/5898488?v=3","gravatar_id":"","url":"https://api.github.com/users/manuelli","html_url":"https://github.com/manuelli","followers_url":"https://api.github.com/users/manuelli/followers","following_url":"https://api.github.com/users/manuelli/following{/other_user}","gists_url":"https://api.github.com/users/manuelli/gists{/gist_id}","starred_url":"https://api.github.com/users/manuelli/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/manuelli/subscriptions","organizations_url":"https://api.github.com/users/manuelli/orgs","repos_url":"https://api.github.com/users/manuelli/repos","events_url":"https://api.github.com/users/manuelli/events{/privacy}","received_events_url":"https://api.github.com/users/manuelli/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"manuelli","id":5898488,"avatar_url":"https://avatars.githubusercontent.com/u/5898488?v=3","gravatar_id":"","url":"https://api.github.com/users/manuelli","html_url":"https://github.com/manuelli","followers_url":"https://api.github.com/users/manuelli/followers","following_url":"https://api.github.com/users/manuelli/following{/other_user}","gists_url":"https://api.github.com/users/manuelli/gists{/gist_id}","starred_url":"https://api.github.com/users/manuelli/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/manuelli/subscriptions","organizations_url":"https://api.github.com/users/manuelli/orgs","repos_url":"https://api.github.com/users/manuelli/repos","events_url":"https://api.github.com/users/manuelli/events{/privacy}","received_events_url":"https://api.github.com/users/manuelli/received_events","type":"User","site_admin":false},"milestone":null,"comments":1,"created_at":"2015-11-19T22:59:58Z","updated_at":"2015-12-01T18:53:24Z","closed_at":null,"body":"- [x] Implement SARSA update\r\n- [x] Test it for convergence with a known policy, i.e. our simple controller\r\n- [x] Implement full SARSA policy updates"},"comment":{"url":"https://api.github.com/repos/peteflorence/Machine-Learning-6.867-homework/issues/comments/161061358","html_url":"https://github.com/peteflorence/Machine-Learning-6.867-homework/issues/32#issuecomment-161061358","issue_url":"https://api.github.com/repos/peteflorence/Machine-Learning-6.867-homework/issues/32","id":161061358,"user":{"login":"manuelli","id":5898488,"avatar_url":"https://avatars.githubusercontent.com/u/5898488?v=3","gravatar_id":"","url":"https://api.github.com/users/manuelli","html_url":"https://github.com/manuelli","followers_url":"https://api.github.com/users/manuelli/followers","following_url":"https://api.github.com/users/manuelli/following{/other_user}","gists_url":"https://api.github.com/users/manuelli/gists{/gist_id}","starred_url":"https://api.github.com/users/manuelli/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/manuelli/subscriptions","organizations_url":"https://api.github.com/users/manuelli/orgs","repos_url":"https://api.github.com/users/manuelli/repos","events_url":"https://api.github.com/users/manuelli/events{/privacy}","received_events_url":"https://api.github.com/users/manuelli/received_events","type":"User","site_admin":false},"created_at":"2015-12-01T18:53:24Z","updated_at":"2015-12-01T18:53:24Z","body":"Currently the discrete version of this is working. 4 inner and 4 outer bins seems to work reasonably well. Have implemented the continuous version with function approximation. Now need to test it our for convergence."}}