{"push_id":760254995,"size":1,"distinct_size":1,"ref":"refs/heads/lda-redo-fix","head":"e5d381681b816e79941d33972bf630d7b47c89f9","before":"e11e64e50620fa1063e1498025c5fe071f556258","commits":[{"sha":"e5d381681b816e79941d33972bf630d7b47c89f9","author":{"email":"0f2b20e3abc4354008d6e58b7371dc25884be733@gmail.com","name":"sharat_sc"},"message":"Remove duplication specification of --lda in test model. It is already persisted as \"lda:x\" during serialization.\n\nTraining predictions:\n.\\vw.exe -k -f lda.model -p predictions.wiki.train --initial_t 0 --power_t 0.5 -d ..\\..\\..\\test\\train-sets\\wiki256.dat --lda 10 --lda_rho 1 --lda_alpha 10 --lda_D 256 --lda_epsilon 0.000100 -l 0.1 -b 8\nhttps://gist.github.com/sharatsc/a88f60d6ed08479a5172\n\nTesting predictions with master:\n.\\vw.exe -k -i lda.model -p predictions.wiki.test.wo.alpha.rho -d ..\\..\\..\\test\\train-sets\\wiki256.dat --lda_epsilon 0.000100 -t\nhttps://gist.github.com/sharatsc/73884a2dc4d2ea22ec25\n\nTesting predictions with master where lda_alpha and lda_rho are explicitly specified:\n.\\vw.exe -k -i lda.model -p predictions.wiki.test -d ..\\..\\..\\test\\train-sets\\wiki256.dat --lda_epsilon 0.000100 --lda_rho 1 --lda_alpha 10 -t\nhttps://gist.github.com/sharatsc/e70288cac91c554d8c7d\n\nTesting predictoins w/ fix (note absence of --lda_alpha --lda_rho in the command line)\n.\\vw.exe -k -i lda.model -p predictions.wiki.test -d ..\\..\\..\\test\\train-sets\\wiki256.dat --lda_epsilon 0.000100  -t\nhttps://gist.github.com/sharatsc/a876ec80d72257b24559\n\nBackground information:\nDuring prediction, only the E step (initialization + lda_loop) is required. The following m-step is unecessary. Also evident from Matt hoffman's python reference code on which gensim package is based\nhttps://github.com/piskvorky/gensim/blob/develop/gensim/models/ldamodel.py\nWe can effectively disable the M-step by setting eta=0\n\nI attempted to fix this in and earlier attempt (JohnLangford@882f34f#diff-7b22d2fa788bfde9ca32ef49951e4131) and rolled in back in (JohnLangford@05d5b78#diff-7b22d2fa788bfde9ca32ef49951e4131)\n\nThe mistake was that rho is used as prior in the code where as rho is used as memory parameter in\nhttps://www.cs.princeton.edu/~blei/papers/HoffmanBleiBach2010b.pdf\nI was going by the notation in the paper.","distinct":true,"url":"https://api.github.com/repos/sharatsc/vowpal_wabbit/commits/e5d381681b816e79941d33972bf630d7b47c89f9"}]}