{"action":"created","issue":{"url":"https://api.github.com/repos/fchollet/keras/issues/428","labels_url":"https://api.github.com/repos/fchollet/keras/issues/428/labels{/name}","comments_url":"https://api.github.com/repos/fchollet/keras/issues/428/comments","events_url":"https://api.github.com/repos/fchollet/keras/issues/428/events","html_url":"https://github.com/fchollet/keras/issues/428","id":96697283,"number":428,"title":"Saving internal states of optimizers for successive calls to model.fit","user":{"login":"the-moliver","id":144949,"avatar_url":"https://avatars.githubusercontent.com/u/144949?v=3","gravatar_id":"","url":"https://api.github.com/users/the-moliver","html_url":"https://github.com/the-moliver","followers_url":"https://api.github.com/users/the-moliver/followers","following_url":"https://api.github.com/users/the-moliver/following{/other_user}","gists_url":"https://api.github.com/users/the-moliver/gists{/gist_id}","starred_url":"https://api.github.com/users/the-moliver/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/the-moliver/subscriptions","organizations_url":"https://api.github.com/users/the-moliver/orgs","repos_url":"https://api.github.com/users/the-moliver/repos","events_url":"https://api.github.com/users/the-moliver/events{/privacy}","received_events_url":"https://api.github.com/users/the-moliver/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-07-23T00:25:29Z","updated_at":"2015-07-23T00:50:35Z","closed_at":null,"body":"I might be wrong, but I think that every call to `model.fit` resets the accumulated states (such as momentum, etc.) in the optimizers. I think it would be great if the optimizers could essentially pick up where they left off training, or at least have the option of doing so. I don't think this would be difficult to do, but I'd like to have some feedback before trying to make this work."},"comment":{"url":"https://api.github.com/repos/fchollet/keras/issues/comments/123918813","html_url":"https://github.com/fchollet/keras/issues/428#issuecomment-123918813","issue_url":"https://api.github.com/repos/fchollet/keras/issues/428","id":123918813,"user":{"login":"kenterao","id":6008132,"avatar_url":"https://avatars.githubusercontent.com/u/6008132?v=3","gravatar_id":"","url":"https://api.github.com/users/kenterao","html_url":"https://github.com/kenterao","followers_url":"https://api.github.com/users/kenterao/followers","following_url":"https://api.github.com/users/kenterao/following{/other_user}","gists_url":"https://api.github.com/users/kenterao/gists{/gist_id}","starred_url":"https://api.github.com/users/kenterao/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kenterao/subscriptions","organizations_url":"https://api.github.com/users/kenterao/orgs","repos_url":"https://api.github.com/users/kenterao/repos","events_url":"https://api.github.com/users/kenterao/events{/privacy}","received_events_url":"https://api.github.com/users/kenterao/received_events","type":"User","site_admin":false},"created_at":"2015-07-23T00:50:35Z","updated_at":"2015-07-23T00:50:35Z","body":"I have an implementation with `get_state` and `set_state` methods on the optimizers.  It's good for continuing the fitting process but it's also needed for parallelized fitting.  When running fitting processes on multiple nodes, both the weights and the optimizers states need to be gathered and broadcast."}}