{"action":"created","issue":{"url":"https://api.github.com/repos/Theano/Theano/issues/2644","labels_url":"https://api.github.com/repos/Theano/Theano/issues/2644/labels{/name}","comments_url":"https://api.github.com/repos/Theano/Theano/issues/2644/comments","events_url":"https://api.github.com/repos/Theano/Theano/issues/2644/events","html_url":"https://github.com/Theano/Theano/issues/2644","id":62790823,"number":2644,"title":"Get rid of the hack in dnn_conv to use the gradient ops","user":{"login":"abergeron","id":1002504,"avatar_url":"https://avatars.githubusercontent.com/u/1002504?v=3","gravatar_id":"","url":"https://api.github.com/users/abergeron","html_url":"https://github.com/abergeron","followers_url":"https://api.github.com/users/abergeron/followers","following_url":"https://api.github.com/users/abergeron/following{/other_user}","gists_url":"https://api.github.com/users/abergeron/gists{/gist_id}","starred_url":"https://api.github.com/users/abergeron/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/abergeron/subscriptions","organizations_url":"https://api.github.com/users/abergeron/orgs","repos_url":"https://api.github.com/users/abergeron/repos","events_url":"https://api.github.com/users/abergeron/events{/privacy}","received_events_url":"https://api.github.com/users/abergeron/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-03-18T20:25:38Z","updated_at":"2015-03-18T22:15:41Z","closed_at":null,"body":"Timings I did of the convolution indicate that the forward op is much faster when workmem='small' than the gradient ops.  And by much faster I mean 0.5 s vs 10 s for shapes of (64, 3, 227, 227) and (96, 3, 11, 11).\r\n\r\nFor tiny sizes, like (1, 3, 8, 8) and (4, 3, 2, 2), its 5.1e-4 vs 4.5e-4 which is a bit slower for the plain forward of, but not by much.\r\n\r\nWe should disable the hack that tries to use the gradient ops by default and let people that want max speed in all cases use the meta-optimizer for convolution."},"comment":{"url":"https://api.github.com/repos/Theano/Theano/issues/comments/83205214","html_url":"https://github.com/Theano/Theano/issues/2644#issuecomment-83205214","issue_url":"https://api.github.com/repos/Theano/Theano/issues/2644","id":83205214,"user":{"login":"nouiz","id":180987,"avatar_url":"https://avatars.githubusercontent.com/u/180987?v=3","gravatar_id":"","url":"https://api.github.com/users/nouiz","html_url":"https://github.com/nouiz","followers_url":"https://api.github.com/users/nouiz/followers","following_url":"https://api.github.com/users/nouiz/following{/other_user}","gists_url":"https://api.github.com/users/nouiz/gists{/gist_id}","starred_url":"https://api.github.com/users/nouiz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nouiz/subscriptions","organizations_url":"https://api.github.com/users/nouiz/orgs","repos_url":"https://api.github.com/users/nouiz/repos","events_url":"https://api.github.com/users/nouiz/events{/privacy}","received_events_url":"https://api.github.com/users/nouiz/received_events","type":"User","site_admin":false},"created_at":"2015-03-18T22:15:41Z","updated_at":"2015-03-18T22:15:41Z","body":"If it don't speed up anymore, I agree with your direction. But for cudnn\nv1, we should choose to remove support of it or warm about it being not\noptimized anymore or keep the old code for it.\n\nI'm prefer removing the code and warm at dnn init about v1 if the user have\nit.\nLe 18 mars 2015 13:25, \"abergeron\" <notifications@github.com> a écrit :\n\n> Timings I did of the convolution indicate that the forward op is much\n> faster when workmem='small' than the gradient ops. And by much faster I\n> mean 0.5 s vs 10 s for shapes of (64, 3, 227, 227) and (96, 3, 11, 11).\n>\n> For tiny sizes, like (1, 3, 8, 8) and (4, 3, 2, 2), its 5.1e-4 vs 4.5e-4\n> which is a bit slower for the plain forward of, but not by much.\n>\n> We should disable the hack that tries to use the gradient ops by default\n> and let people that want max speed in all cases use the meta-optimizer for\n> convolution.\n>\n> —\n> Reply to this email directly or view it on GitHub\n> <https://github.com/Theano/Theano/issues/2644>.\n>\n"}}