{"action":"reopened","issue":{"url":"https://api.github.com/repos/Lasagne/Lasagne/issues/468","labels_url":"https://api.github.com/repos/Lasagne/Lasagne/issues/468/labels{/name}","comments_url":"https://api.github.com/repos/Lasagne/Lasagne/issues/468/comments","events_url":"https://api.github.com/repos/Lasagne/Lasagne/issues/468/events","html_url":"https://github.com/Lasagne/Lasagne/issues/468","id":111880832,"number":468,"title":"Glorot gains for Leaky_rectify and very_leaky_rectify","user":{"login":"skaae","id":2623134,"avatar_url":"https://avatars.githubusercontent.com/u/2623134?v=3","gravatar_id":"","url":"https://api.github.com/users/skaae","html_url":"https://github.com/skaae","followers_url":"https://api.github.com/users/skaae/followers","following_url":"https://api.github.com/users/skaae/following{/other_user}","gists_url":"https://api.github.com/users/skaae/gists{/gist_id}","starred_url":"https://api.github.com/users/skaae/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/skaae/subscriptions","organizations_url":"https://api.github.com/users/skaae/orgs","repos_url":"https://api.github.com/users/skaae/repos","events_url":"https://api.github.com/users/skaae/events{/privacy}","received_events_url":"https://api.github.com/users/skaae/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"skaae","id":2623134,"avatar_url":"https://avatars.githubusercontent.com/u/2623134?v=3","gravatar_id":"","url":"https://api.github.com/users/skaae","html_url":"https://github.com/skaae","followers_url":"https://api.github.com/users/skaae/followers","following_url":"https://api.github.com/users/skaae/following{/other_user}","gists_url":"https://api.github.com/users/skaae/gists{/gist_id}","starred_url":"https://api.github.com/users/skaae/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/skaae/subscriptions","organizations_url":"https://api.github.com/users/skaae/orgs","repos_url":"https://api.github.com/users/skaae/repos","events_url":"https://api.github.com/users/skaae/events{/privacy}","received_events_url":"https://api.github.com/users/skaae/received_events","type":"User","site_admin":false},"milestone":null,"comments":6,"created_at":"2015-10-16T18:02:20Z","updated_at":"2015-10-19T14:31:36Z","closed_at":null,"body":"Should we add the correct Glorot gains for `leaky_rectify` and `very_leaky_rectify`. That would be\r\n\r\n```Python\r\nif gain == 'rectify':\r\n    gain = np.sqrt(2)\r\nelif nonlin == 'leaky_rectify':\r\n    gain = np.sqrt(2/(1+0.01**2))\r\nelif nonlin == 'very_leaky_rectify':\r\n    gain = np.sqrt(2/(1+(1/3)**2))\r\n```\r\n\r\nMaybe also add a note to the doc that the correct  init for `leaky_rectify` with `alpha` leakiness is `np.sqrt(2/(1+alpha**2))` "}}