{"action":"opened","issue":{"url":"https://api.github.com/repos/BVLC/caffe/issues/2546","labels_url":"https://api.github.com/repos/BVLC/caffe/issues/2546/labels{/name}","comments_url":"https://api.github.com/repos/BVLC/caffe/issues/2546/comments","events_url":"https://api.github.com/repos/BVLC/caffe/issues/2546/events","html_url":"https://github.com/BVLC/caffe/issues/2546","id":84710224,"number":2546,"title":"Default weight initialization","user":{"login":"MartinThoma","id":1658117,"avatar_url":"https://avatars.githubusercontent.com/u/1658117?v=3","gravatar_id":"","url":"https://api.github.com/users/MartinThoma","html_url":"https://github.com/MartinThoma","followers_url":"https://api.github.com/users/MartinThoma/followers","following_url":"https://api.github.com/users/MartinThoma/following{/other_user}","gists_url":"https://api.github.com/users/MartinThoma/gists{/gist_id}","starred_url":"https://api.github.com/users/MartinThoma/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/MartinThoma/subscriptions","organizations_url":"https://api.github.com/users/MartinThoma/orgs","repos_url":"https://api.github.com/users/MartinThoma/repos","events_url":"https://api.github.com/users/MartinThoma/events{/privacy}","received_events_url":"https://api.github.com/users/MartinThoma/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2015-06-03T18:37:21Z","updated_at":"2015-06-03T18:37:21Z","closed_at":null,"body":"I am currently learning how to use caffe and it took me quite a long time to figure out that I have to set `weight_filler`:\r\n\r\n```text\r\n    weight_filler {\r\n      type: \"gaussian\"\r\n      std: 0.0001\r\n    }\r\n```\r\n\r\nI guess currently there is a constant default (e.g. setting all weights to 0). This should probably be changed to something random. Or at least give a warning if no weight_fillers are used. Because if the weights are initialized to the same values, the neurons will not learn anything different (they will be aligned). (At least with standard gradient descent.)"}}