{"action":"created","issue":{"url":"https://api.github.com/repos/karpathy/recurrentjs/issues/4","labels_url":"https://api.github.com/repos/karpathy/recurrentjs/issues/4/labels{/name}","comments_url":"https://api.github.com/repos/karpathy/recurrentjs/issues/4/comments","events_url":"https://api.github.com/repos/karpathy/recurrentjs/issues/4/events","html_url":"https://github.com/karpathy/recurrentjs/issues/4","id":82676242,"number":4,"title":"text prediction","user":{"login":"hardmaru","id":6318110,"avatar_url":"https://avatars.githubusercontent.com/u/6318110?v=3","gravatar_id":"","url":"https://api.github.com/users/hardmaru","html_url":"https://github.com/hardmaru","followers_url":"https://api.github.com/users/hardmaru/followers","following_url":"https://api.github.com/users/hardmaru/following{/other_user}","gists_url":"https://api.github.com/users/hardmaru/gists{/gist_id}","starred_url":"https://api.github.com/users/hardmaru/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hardmaru/subscriptions","organizations_url":"https://api.github.com/users/hardmaru/orgs","repos_url":"https://api.github.com/users/hardmaru/repos","events_url":"https://api.github.com/users/hardmaru/events{/privacy}","received_events_url":"https://api.github.com/users/hardmaru/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-05-30T03:00:06Z","updated_at":"2015-05-30T04:47:49Z","closed_at":null,"body":"Hi Karparthy\r\n\r\nI have trouble understanding a few points in the character prediction demo:\r\n\r\n1) What is the meaning of letter_size?\r\nletter_size = 5; // size of letter embeddings\r\n\r\nMy understanding is that the inputs to the network are just vectors of length 50 (or however many unique characters in our dataset) that look like [0, 0, 0, 0, 1, 0, 0, 0 ... ], and the output is similar\r\n\r\n2)  to tick the model forward, you used 'rowPluck'\r\n x = G.rowPluck(model['Wil'], ix);\r\n\r\nand I think ix is the integer index that represents the character.  I exampled x in inspector and is a value of floats of length letter_size, rather than a large binary vector of length 50\r\n\r\nSo I have a little bit of a hard time what is going on and currently quite puzzled.  Any advice or guidance appreciated!\r\n\r\nThanks\r\n\r\nDavid\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/karpathy/recurrentjs/issues/comments/106989239","html_url":"https://github.com/karpathy/recurrentjs/issues/4#issuecomment-106989239","issue_url":"https://api.github.com/repos/karpathy/recurrentjs/issues/4","id":106989239,"user":{"login":"hardmaru","id":6318110,"avatar_url":"https://avatars.githubusercontent.com/u/6318110?v=3","gravatar_id":"","url":"https://api.github.com/users/hardmaru","html_url":"https://github.com/hardmaru","followers_url":"https://api.github.com/users/hardmaru/followers","following_url":"https://api.github.com/users/hardmaru/following{/other_user}","gists_url":"https://api.github.com/users/hardmaru/gists{/gist_id}","starred_url":"https://api.github.com/users/hardmaru/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hardmaru/subscriptions","organizations_url":"https://api.github.com/users/hardmaru/orgs","repos_url":"https://api.github.com/users/hardmaru/repos","events_url":"https://api.github.com/users/hardmaru/events{/privacy}","received_events_url":"https://api.github.com/users/hardmaru/received_events","type":"User","site_admin":false},"created_at":"2015-05-30T04:47:49Z","updated_at":"2015-05-30T04:47:49Z","body":"\r\nI find the code quite neat and okay-readable and I'm able to learn from it after playing around with it\r\n\r\nI see, so basically we transform a one-hot vector of size 50 (or whatever) into a vector of 5 floats before feeding it in\r\n\r\nI was trying to implement something similar from scratch but got stuck after the output remains to be a bit on the gibberish side after many generations so I wanted take a look at this code for some guidance.  Maybe this form of densed representation rather than 1-hot would help improve the performance\r\n\r\nThanks again\r\n"}}