{"action":"created","issue":{"url":"https://api.github.com/repos/kuz/caffe-with-spearmint/issues/4","labels_url":"https://api.github.com/repos/kuz/caffe-with-spearmint/issues/4/labels{/name}","comments_url":"https://api.github.com/repos/kuz/caffe-with-spearmint/issues/4/comments","events_url":"https://api.github.com/repos/kuz/caffe-with-spearmint/issues/4/events","html_url":"https://github.com/kuz/caffe-with-spearmint/issues/4","id":102665384,"number":4,"title":"Multiple variables are getting mapped to OPTIMIZE_std_1? (instead of _2, _3, ...)","user":{"login":"forresti","id":2020010,"avatar_url":"https://avatars.githubusercontent.com/u/2020010?v=3","gravatar_id":"","url":"https://api.github.com/users/forresti","html_url":"https://github.com/forresti","followers_url":"https://api.github.com/users/forresti/followers","following_url":"https://api.github.com/users/forresti/following{/other_user}","gists_url":"https://api.github.com/users/forresti/gists{/gist_id}","starred_url":"https://api.github.com/users/forresti/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/forresti/subscriptions","organizations_url":"https://api.github.com/users/forresti/orgs","repos_url":"https://api.github.com/users/forresti/repos","events_url":"https://api.github.com/users/forresti/events{/privacy}","received_events_url":"https://api.github.com/users/forresti/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-08-23T22:07:35Z","updated_at":"2015-08-24T22:02:34Z","closed_at":"2015-08-24T14:11:02Z","body":"I've successfully run the caffe-with-spearmint MNIST example, and now I'm moving toward using caffe-with-spearmint for my own application. Right now, I'm interested in optimizing the standard deviation (`std`) of the weight initialization in a Network-in-Network. \r\n\r\nLet me walk you through where things are going wrong...\r\n\r\n1) I set up my `model/trainval.prototxt` with two `std` fields filled in like this:\r\n      `std: OPTIMIZE{\"type\":\"FLOAT\", \"min\": 0.005, \"max\": 0.05}`\r\n\r\n2) In `tmp/template_trainval.prototxt`, these *both* get mapped to `OPTIMIZE_std_1`:\r\n```\r\nlayer {name: \"conv1\"\r\n     convolution_param {weight_filler{ std: OPTIMIZE_std_1 } }\r\n}\r\nlayer {name: \"cccp1\"\r\n     convolution_param {weight_filler{ std: OPTIMIZE_std_1 } } ##(should be OPTIMIZE_std_2)\r\n}\r\n```\r\nThis is odd, because in the MNIST example, I see that optimizing `kernel_size` in multiple layers maps to `OPTIMIZE_kernel_size_1`, `OPTIMIZE_kernel_size_2`, and `OPTIMIZE_kernel_size_3`.\r\n\r\n3) As a result of having two fields that are both OPTIMIZE_kernel_size_1, `tmp/<datetime>_trainval.prototxt` filled in with an optimized value for conv1, but it still OPTIMIZE_std_1 for the next convolutional layer:\r\n```\r\nlayer {name: \"conv1\"\r\n     convolution_param {weight_filler{ std: 0.005 } }\r\n}\r\nlayer {name: \"cccp1\"\r\n     convolution_param {weight_filler{ std: OPTIMIZE_std_1 } }\r\n}\r\n```\r\n4) Caffe naturally doesn't understand what to do with `std: OPTIMIZE_std_1`, so it fails to run training.\r\n\r\n**Any ideas why caffe-with-spearmint isn't filling in `OPTIMIZE_std_2` in the 2nd convolutional layer's `std` field?**\r\n\r\nI put all samples of all 3 files (models/trainval.prototxt, tmp/template_trainval.prototxt, and tmp/datetime_trainval.prototxt) in a gist here:\r\nhttps://gist.github.com/forresti/138d8bb79457a1146607"},"comment":{"url":"https://api.github.com/repos/kuz/caffe-with-spearmint/issues/comments/134393243","html_url":"https://github.com/kuz/caffe-with-spearmint/issues/4#issuecomment-134393243","issue_url":"https://api.github.com/repos/kuz/caffe-with-spearmint/issues/4","id":134393243,"user":{"login":"forresti","id":2020010,"avatar_url":"https://avatars.githubusercontent.com/u/2020010?v=3","gravatar_id":"","url":"https://api.github.com/users/forresti","html_url":"https://github.com/forresti","followers_url":"https://api.github.com/users/forresti/followers","following_url":"https://api.github.com/users/forresti/following{/other_user}","gists_url":"https://api.github.com/users/forresti/gists{/gist_id}","starred_url":"https://api.github.com/users/forresti/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/forresti/subscriptions","organizations_url":"https://api.github.com/users/forresti/orgs","repos_url":"https://api.github.com/users/forresti/repos","events_url":"https://api.github.com/users/forresti/events{/privacy}","received_events_url":"https://api.github.com/users/forresti/received_events","type":"User","site_admin":false},"created_at":"2015-08-24T22:02:34Z","updated_at":"2015-08-24T22:02:34Z","body":"That worked! Thanks a lot!"}}