{"action":"created","issue":{"url":"https://api.github.com/repos/Russell91/ReInspect/issues/10","labels_url":"https://api.github.com/repos/Russell91/ReInspect/issues/10/labels{/name}","comments_url":"https://api.github.com/repos/Russell91/ReInspect/issues/10/comments","events_url":"https://api.github.com/repos/Russell91/ReInspect/issues/10/events","html_url":"https://github.com/Russell91/ReInspect/issues/10","id":113866314,"number":10,"title":"question for python-caffe debug problem","user":{"login":"chenfsjz","id":12003693,"avatar_url":"https://avatars.githubusercontent.com/u/12003693?v=3","gravatar_id":"","url":"https://api.github.com/users/chenfsjz","html_url":"https://github.com/chenfsjz","followers_url":"https://api.github.com/users/chenfsjz/followers","following_url":"https://api.github.com/users/chenfsjz/following{/other_user}","gists_url":"https://api.github.com/users/chenfsjz/gists{/gist_id}","starred_url":"https://api.github.com/users/chenfsjz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/chenfsjz/subscriptions","organizations_url":"https://api.github.com/users/chenfsjz/orgs","repos_url":"https://api.github.com/users/chenfsjz/repos","events_url":"https://api.github.com/users/chenfsjz/events{/privacy}","received_events_url":"https://api.github.com/users/chenfsjz/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-10-28T16:50:46Z","updated_at":"2015-10-31T16:27:31Z","closed_at":null,"body":"@Russell91  I have add another lstm layer in the net , it seems OK in the forward period, but broken down in the when comes to the backward. I use the  spyder,but it cannot  shows backward period on the debug mode. I try to display the information in the code but it does little help.\r\nDoes there some useful methods or tools to debug ."},"comment":{"url":"https://api.github.com/repos/Russell91/ReInspect/issues/comments/152747004","html_url":"https://github.com/Russell91/ReInspect/issues/10#issuecomment-152747004","issue_url":"https://api.github.com/repos/Russell91/ReInspect/issues/10","id":152747004,"user":{"login":"Russell91","id":1069617,"avatar_url":"https://avatars.githubusercontent.com/u/1069617?v=3","gravatar_id":"","url":"https://api.github.com/users/Russell91","html_url":"https://github.com/Russell91","followers_url":"https://api.github.com/users/Russell91/followers","following_url":"https://api.github.com/users/Russell91/following{/other_user}","gists_url":"https://api.github.com/users/Russell91/gists{/gist_id}","starred_url":"https://api.github.com/users/Russell91/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Russell91/subscriptions","organizations_url":"https://api.github.com/users/Russell91/orgs","repos_url":"https://api.github.com/users/Russell91/repos","events_url":"https://api.github.com/users/Russell91/events{/privacy}","received_events_url":"https://api.github.com/users/Russell91/received_events","type":"User","site_admin":false},"created_at":"2015-10-31T16:27:31Z","updated_at":"2015-10-31T16:27:31Z","body":"It is difficult for me to tell exactly. If you're getting nans it is most\nlikely because your new layer is producing them. I would try using only one\nnew layer at a time and making sure everything works well. Also you can use\ngdb for debugging with python! Use gdb - -args python --config config.json\nfor example and set a breakpoint in your c++ code. Make sure to compile\nwith debugging symbols as well if you do this.\nOn Oct 31, 2015 12:27 AM, \"chenfsjz\" <notifications@github.com> wrote:\n\n> I use Pdb to detect the problems of my code. here is the part result of\n> net, the training loss propagated back from the last layer of\n> \"label_loss\".The new layers I have added were att_input23, att_e23 and so\n> on. And these new layer were declared in the vision.hpp.\n> The code can print the variabes in my new layer,like \"top[i]_diff:\n> context_top_diff \"; but it doesn't work in the apollocaffe's original layer\n> such as \"LstmunitLayer\". I don't know what's the reason .\n>\n> Additional, the gradient vanished down after two iterations of lstm，does\n> it maybe my new layer cause the problem!\n>\n> label_loss\n> ip_concat\n> ip_soft_conf23\n> att_ip_conf23\n> att_dropout23\n> att_lstm23\n> att_concat23\n> att_input23\n> context_top_diff:0.000240\n>\n> context bottom_diff: -0.000001\n>\n> att_e_normal23\n> att_e23\n> energy:top_diff 0.000000\n> att_tanh23\n> ind_diff:0.000000\n> inddata:-0.001244\n> context_data:-0.001244\n> ip_soft_conf22\n> att_ip_conf22\n> att_dropout22\n> att_lstm22\n> att_concat22\n> att_input22\n> context_top_diff:nan\n>\n> context bottom_diff: nan\n>\n> —\n> Reply to this email directly or view it on GitHub\n> <https://github.com/Russell91/ReInspect/issues/10#issuecomment-152707322>.\n>\n"}}