{"action":"created","issue":{"url":"https://api.github.com/repos/bartvm/blocks/issues/587","labels_url":"https://api.github.com/repos/bartvm/blocks/issues/587/labels{/name}","comments_url":"https://api.github.com/repos/bartvm/blocks/issues/587/comments","events_url":"https://api.github.com/repos/bartvm/blocks/issues/587/events","html_url":"https://github.com/bartvm/blocks/issues/587","id":68190578,"number":587,"title":"Filling doc gaps for RNNs: example of training vanilla RNN, intro to SequenceGenerator/Readout/etc","user":{"login":"mjwillson","id":4502,"avatar_url":"https://avatars.githubusercontent.com/u/4502?v=3","gravatar_id":"","url":"https://api.github.com/users/mjwillson","html_url":"https://github.com/mjwillson","followers_url":"https://api.github.com/users/mjwillson/followers","following_url":"https://api.github.com/users/mjwillson/following{/other_user}","gists_url":"https://api.github.com/users/mjwillson/gists{/gist_id}","starred_url":"https://api.github.com/users/mjwillson/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mjwillson/subscriptions","organizations_url":"https://api.github.com/users/mjwillson/orgs","repos_url":"https://api.github.com/users/mjwillson/repos","events_url":"https://api.github.com/users/mjwillson/events{/privacy}","received_events_url":"https://api.github.com/users/mjwillson/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":10,"created_at":"2015-04-13T20:46:19Z","updated_at":"2015-04-14T13:31:23Z","closed_at":null,"body":"Hi all\r\n\r\nCurrently working through the nice docs on RNNs at https://github.com/bartvm/blocks/blob/master/docs/rnn.rst -- could I make a plea for just a little bit more info on how to take a SimpleRecurrent and train it with an output layer and a cost function?\r\n\r\nThere's a bit of a gap between these docs, which take you as far as generating a sequence of hidden states with a SimpleRecurrent but don't get you to the point of adding an output layer and a cost function and training the thing, and the code examples (markov chain / reverse words) which use more sophisticated models with attention mechanisms and are abstracted more than the examples in the docs, where it's a bit hard for a newbie to figure out what's going on and apply it to a simpler model.\r\n\r\nMight I humbly suggest extending the rnn docs page with a bit of info about SequenceGenerator/Readout/Emmitter/Feedback, how they all fit together and how you use them to compile a theano function that computes your cost function for the sequence?\r\n\r\nFailing that if anyone has any simpler example code they could point me at for training a more vanilla RNN that'd be awesome.\r\n\r\nThanks and keep up the great work! really impressed at how much has been implemented already in this library, and how good the docs are already. I just need to start simple when it comes to RNNs and work my way up. If anyone has time I think a few more docs along these lines would make the library (whose strength in particular seems to be RNNs) even more accessible :)"},"comment":{"url":"https://api.github.com/repos/bartvm/blocks/issues/comments/92836741","html_url":"https://github.com/bartvm/blocks/issues/587#issuecomment-92836741","issue_url":"https://api.github.com/repos/bartvm/blocks/issues/587","id":92836741,"user":{"login":"rizar","id":654434,"avatar_url":"https://avatars.githubusercontent.com/u/654434?v=3","gravatar_id":"","url":"https://api.github.com/users/rizar","html_url":"https://github.com/rizar","followers_url":"https://api.github.com/users/rizar/followers","following_url":"https://api.github.com/users/rizar/following{/other_user}","gists_url":"https://api.github.com/users/rizar/gists{/gist_id}","starred_url":"https://api.github.com/users/rizar/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rizar/subscriptions","organizations_url":"https://api.github.com/users/rizar/orgs","repos_url":"https://api.github.com/users/rizar/repos","events_url":"https://api.github.com/users/rizar/events{/privacy}","received_events_url":"https://api.github.com/users/rizar/received_events","type":"User","site_admin":false},"created_at":"2015-04-14T13:31:22Z","updated_at":"2015-04-14T13:31:22Z","body":"Sure, I agree that implementing things yourself for the first time is very helpful. Similarly for full understanding of what's going on one might want to implement an RNN from scratch not using bricks. But apart from that language modelling with sequence generator is just less code, since this component was originally designed with this task in mind. "}}