{"action":"created","issue":{"url":"https://api.github.com/repos/mila-udem/blocks/issues/661","labels_url":"https://api.github.com/repos/mila-udem/blocks/issues/661/labels{/name}","comments_url":"https://api.github.com/repos/mila-udem/blocks/issues/661/comments","events_url":"https://api.github.com/repos/mila-udem/blocks/issues/661/events","html_url":"https://github.com/mila-udem/blocks/pull/661","id":79600500,"number":661,"title":"removed transposes to speed up LSTM","user":{"login":"pbrakel","id":1336772,"avatar_url":"https://avatars.githubusercontent.com/u/1336772?v=3","gravatar_id":"","url":"https://api.github.com/users/pbrakel","html_url":"https://github.com/pbrakel","followers_url":"https://api.github.com/users/pbrakel/followers","following_url":"https://api.github.com/users/pbrakel/following{/other_user}","gists_url":"https://api.github.com/users/pbrakel/gists{/gist_id}","starred_url":"https://api.github.com/users/pbrakel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pbrakel/subscriptions","organizations_url":"https://api.github.com/users/pbrakel/orgs","repos_url":"https://api.github.com/users/pbrakel/repos","events_url":"https://api.github.com/users/pbrakel/events{/privacy}","received_events_url":"https://api.github.com/users/pbrakel/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":6,"created_at":"2015-05-22T20:38:35Z","updated_at":"2015-05-23T00:18:14Z","closed_at":"2015-05-22T21:26:15Z","pull_request":{"url":"https://api.github.com/repos/mila-udem/blocks/pulls/661","html_url":"https://github.com/mila-udem/blocks/pull/661","diff_url":"https://github.com/mila-udem/blocks/pull/661.diff","patch_url":"https://github.com/mila-udem/blocks/pull/661.patch"},"body":"Running the @rizar his benchmark using a GTX 580 I got this as a baseline result:\r\n\r\n| | 100|250|1000|2000 |\r\n|---|---|---|---|---|\r\n| SimpleRecurrent|13|16|62|85 |\r\n| GatedRecurrent|25|34|119|232 |\r\n| LSTM|52|97|280|929 |\r\n\r\nAnd this after removing the transpose:\r\n\r\n| | 100|250|1000|2000 |\r\n|---|---|---|---|---|\r\n| SimpleRecurrent|12|16|62|85 |\r\n| GatedRecurrent|25|34|119|231 |\r\n| LSTM|44|85|248|611 |\r\n\r\nSo for larger networks the difference is substantial while for smaller networks the difference is not that big but still nice."},"comment":{"url":"https://api.github.com/repos/mila-udem/blocks/issues/comments/104806047","html_url":"https://github.com/mila-udem/blocks/pull/661#issuecomment-104806047","issue_url":"https://api.github.com/repos/mila-udem/blocks/issues/661","id":104806047,"user":{"login":"nouiz","id":180987,"avatar_url":"https://avatars.githubusercontent.com/u/180987?v=3","gravatar_id":"","url":"https://api.github.com/users/nouiz","html_url":"https://github.com/nouiz","followers_url":"https://api.github.com/users/nouiz/followers","following_url":"https://api.github.com/users/nouiz/following{/other_user}","gists_url":"https://api.github.com/users/nouiz/gists{/gist_id}","starred_url":"https://api.github.com/users/nouiz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nouiz/subscriptions","organizations_url":"https://api.github.com/users/nouiz/orgs","repos_url":"https://api.github.com/users/nouiz/repos","events_url":"https://api.github.com/users/nouiz/events{/privacy}","received_events_url":"https://api.github.com/users/nouiz/received_events","type":"User","site_admin":false},"created_at":"2015-05-23T00:18:14Z","updated_at":"2015-05-23T00:18:14Z","body":"To know the problem, can you run both case with Theano profiler and give us the information? also enable profile_memory=True to get the strides that could affect the timming."}}