{"action":"created","issue":{"url":"https://api.github.com/repos/dmlc/MXNet.jl/issues/10","labels_url":"https://api.github.com/repos/dmlc/MXNet.jl/issues/10/labels{/name}","comments_url":"https://api.github.com/repos/dmlc/MXNet.jl/issues/10/comments","events_url":"https://api.github.com/repos/dmlc/MXNet.jl/issues/10/events","html_url":"https://github.com/dmlc/MXNet.jl/pull/10","id":113820891,"number":10,"title":"added ADAM SGD","user":{"login":"cbecker","id":26833,"avatar_url":"https://avatars.githubusercontent.com/u/26833?v=3","gravatar_id":"","url":"https://api.github.com/users/cbecker","html_url":"https://github.com/cbecker","followers_url":"https://api.github.com/users/cbecker/followers","following_url":"https://api.github.com/users/cbecker/following{/other_user}","gists_url":"https://api.github.com/users/cbecker/gists{/gist_id}","starred_url":"https://api.github.com/users/cbecker/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cbecker/subscriptions","organizations_url":"https://api.github.com/users/cbecker/orgs","repos_url":"https://api.github.com/users/cbecker/repos","events_url":"https://api.github.com/users/cbecker/events{/privacy}","received_events_url":"https://api.github.com/users/cbecker/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-10-28T13:27:58Z","updated_at":"2015-10-28T13:55:16Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/dmlc/MXNet.jl/pulls/10","html_url":"https://github.com/dmlc/MXNet.jl/pull/10","diff_url":"https://github.com/dmlc/MXNet.jl/pull/10.diff","patch_url":"https://github.com/dmlc/MXNet.jl/pull/10.patch"},"body":"This adds the ADAM SGD algorithm.\r\n\r\nI am decaying the rate manually in the ADAM functions, as I was not sure how to integrate it properly with the other MXNet learning rate functions."},"comment":{"url":"https://api.github.com/repos/dmlc/MXNet.jl/issues/comments/151852507","html_url":"https://github.com/dmlc/MXNet.jl/pull/10#issuecomment-151852507","issue_url":"https://api.github.com/repos/dmlc/MXNet.jl/issues/10","id":151852507,"user":{"login":"cbecker","id":26833,"avatar_url":"https://avatars.githubusercontent.com/u/26833?v=3","gravatar_id":"","url":"https://api.github.com/users/cbecker","html_url":"https://github.com/cbecker","followers_url":"https://api.github.com/users/cbecker/followers","following_url":"https://api.github.com/users/cbecker/following{/other_user}","gists_url":"https://api.github.com/users/cbecker/gists{/gist_id}","starred_url":"https://api.github.com/users/cbecker/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cbecker/subscriptions","organizations_url":"https://api.github.com/users/cbecker/orgs","repos_url":"https://api.github.com/users/cbecker/repos","events_url":"https://api.github.com/users/cbecker/events{/privacy}","received_events_url":"https://api.github.com/users/cbecker/received_events","type":"User","site_admin":false},"created_at":"2015-10-28T13:55:16Z","updated_at":"2015-10-28T13:55:16Z","body":"Ok I see, no problem, then it should be fine now. You can merge.\r\nAs side note, in my experiments ADAM converges much faster than SGD, even with the default params."}}