{"action":"created","issue":{"url":"https://api.github.com/repos/itdxer/neupy/issues/27","labels_url":"https://api.github.com/repos/itdxer/neupy/issues/27/labels{/name}","comments_url":"https://api.github.com/repos/itdxer/neupy/issues/27/comments","events_url":"https://api.github.com/repos/itdxer/neupy/issues/27/events","html_url":"https://github.com/itdxer/neupy/issues/27","id":113257527,"number":27,"title":"Crashes my RAM","user":{"login":"abhigenie92","id":12474640,"avatar_url":"https://avatars.githubusercontent.com/u/12474640?v=3","gravatar_id":"","url":"https://api.github.com/users/abhigenie92","html_url":"https://github.com/abhigenie92","followers_url":"https://api.github.com/users/abhigenie92/followers","following_url":"https://api.github.com/users/abhigenie92/following{/other_user}","gists_url":"https://api.github.com/users/abhigenie92/gists{/gist_id}","starred_url":"https://api.github.com/users/abhigenie92/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/abhigenie92/subscriptions","organizations_url":"https://api.github.com/users/abhigenie92/orgs","repos_url":"https://api.github.com/users/abhigenie92/repos","events_url":"https://api.github.com/users/abhigenie92/events{/privacy}","received_events_url":"https://api.github.com/users/abhigenie92/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/itdxer/neupy/labels/bug","name":"bug","color":"fc2929"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-10-25T22:02:50Z","updated_at":"2015-10-26T11:24:19Z","closed_at":null,"body":"I am using oja's rule on dataset of size 400x156300. It seems to crash my RAM. I am not sure what is causing this. Please help.\r\nI have 12 GB of RAM.\r\nTried using memmap still crash!!\r\n#convert memmap and reduce precision\r\n[num_sample,num_feat]=train_data.shape\r\nfilename = path.join(mkdtemp(), 'train_data.dat')\r\nmemmap_train = np.memmap(filename, dtype='float32', mode='w+', shape=(num_sample,num_feat))\r\nmemmap_train[:] = train_data[:]\r\ndel train_data,test_data\r\n\r\n#apply oja's rule\r\nojanet = algorithms.Oja(minimized_data_size=1250,step=1e-10,verbose=True,show_epoch=1)\r\nojanet.train(memmap_train, epsilon=1e-3,epochs=10000)\r\nred_train_data = ojanet.predict(memmap_train)\r\nojanet.plot_errors(logx=False)\r\npdb.set_trace()"},"comment":{"url":"https://api.github.com/repos/itdxer/neupy/issues/comments/151104819","html_url":"https://github.com/itdxer/neupy/issues/27#issuecomment-151104819","issue_url":"https://api.github.com/repos/itdxer/neupy/issues/27","id":151104819,"user":{"login":"itdxer","id":1621713,"avatar_url":"https://avatars.githubusercontent.com/u/1621713?v=3","gravatar_id":"","url":"https://api.github.com/users/itdxer","html_url":"https://github.com/itdxer","followers_url":"https://api.github.com/users/itdxer/followers","following_url":"https://api.github.com/users/itdxer/following{/other_user}","gists_url":"https://api.github.com/users/itdxer/gists{/gist_id}","starred_url":"https://api.github.com/users/itdxer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/itdxer/subscriptions","organizations_url":"https://api.github.com/users/itdxer/orgs","repos_url":"https://api.github.com/users/itdxer/repos","events_url":"https://api.github.com/users/itdxer/events{/privacy}","received_events_url":"https://api.github.com/users/itdxer/received_events","type":"User","site_admin":false},"created_at":"2015-10-26T11:24:19Z","updated_at":"2015-10-26T11:24:19Z","body":"I identify some memory leakage , but I'm not quit sure about the main source of the problem. I will notice you a soon as I will fix it."}}