{"action":"created","issue":{"url":"https://api.github.com/repos/piskvorky/gensim/issues/293","labels_url":"https://api.github.com/repos/piskvorky/gensim/issues/293/labels{/name}","comments_url":"https://api.github.com/repos/piskvorky/gensim/issues/293/comments","events_url":"https://api.github.com/repos/piskvorky/gensim/issues/293/events","html_url":"https://github.com/piskvorky/gensim/issues/293","id":57349132,"number":293,"title":"Memory Error - Word2Vec","user":{"login":"dav009","id":1659415,"avatar_url":"https://avatars.githubusercontent.com/u/1659415?v=3","gravatar_id":"","url":"https://api.github.com/users/dav009","html_url":"https://github.com/dav009","followers_url":"https://api.github.com/users/dav009/followers","following_url":"https://api.github.com/users/dav009/following{/other_user}","gists_url":"https://api.github.com/users/dav009/gists{/gist_id}","starred_url":"https://api.github.com/users/dav009/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dav009/subscriptions","organizations_url":"https://api.github.com/users/dav009/orgs","repos_url":"https://api.github.com/users/dav009/repos","events_url":"https://api.github.com/users/dav009/events{/privacy}","received_events_url":"https://api.github.com/users/dav009/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-02-11T17:34:12Z","updated_at":"2015-10-10T12:59:21Z","closed_at":null,"body":"Im running a fairly simple script[1] calling word2vec on a 15G corpus which is already tokenized.I have tried running on a 30G machine, and then on a 60G machine.\r\nBoth leading to the following error:\r\n\r\n```\r\nTraceback (most recent call last):\r\n  File \"word2vec.py\", line 13, in <module>\r\n    read_corpus(\"/mnt/data/corpus\")\r\n  File \"word2vec.py\", line 9, in read_corpus\r\n    model = gensim.models.Word2Vec(sentences, min_count=10, size=500, window=10, sg=1, workers=4)\r\n  File \"/usr/local/lib/python2.7/dist-packages/gensim/models/word2vec.py\", line 312, in __init__\r\n    self.build_vocab(sentences)\r\n  File \"/usr/local/lib/python2.7/dist-packages/gensim/models/word2vec.py\", line 414, in build_vocab\r\n    self.reset_weights()\r\n  File \"/usr/local/lib/python2.7/dist-packages/gensim/models/word2vec.py\", line 524, in reset_weights\r\n    self.syn1 = zeros((len(self.vocab), self.layer1_size), dtype=REAL)\r\nMemoryError\r\n```\r\n\r\nAny clues? Does the script contains something which is not meant to be done ?\r\n\r\n[1] https://gist.github.com/dav009/fb9a42890d3048b3b745"},"comment":{"url":"https://api.github.com/repos/piskvorky/gensim/issues/comments/147087478","html_url":"https://github.com/piskvorky/gensim/issues/293#issuecomment-147087478","issue_url":"https://api.github.com/repos/piskvorky/gensim/issues/293","id":147087478,"user":{"login":"piskvorky","id":610412,"avatar_url":"https://avatars.githubusercontent.com/u/610412?v=3","gravatar_id":"","url":"https://api.github.com/users/piskvorky","html_url":"https://github.com/piskvorky","followers_url":"https://api.github.com/users/piskvorky/followers","following_url":"https://api.github.com/users/piskvorky/following{/other_user}","gists_url":"https://api.github.com/users/piskvorky/gists{/gist_id}","starred_url":"https://api.github.com/users/piskvorky/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/piskvorky/subscriptions","organizations_url":"https://api.github.com/users/piskvorky/orgs","repos_url":"https://api.github.com/users/piskvorky/repos","events_url":"https://api.github.com/users/piskvorky/events{/privacy}","received_events_url":"https://api.github.com/users/piskvorky/received_events","type":"User","site_admin":false},"created_at":"2015-10-10T12:59:21Z","updated_at":"2015-10-10T12:59:21Z","body":"As @sebastien-j says, it's best to give a more detailed report. A link (gist) to the log of your run would be ideal."}}