{"action":"created","issue":{"url":"https://api.github.com/repos/wimremes/cve-search/issues/75","labels_url":"https://api.github.com/repos/wimremes/cve-search/issues/75/labels{/name}","comments_url":"https://api.github.com/repos/wimremes/cve-search/issues/75/comments","events_url":"https://api.github.com/repos/wimremes/cve-search/issues/75/events","html_url":"https://github.com/wimremes/cve-search/issues/75","id":81904877,"number":75,"title":" db_mgmt_cpe_other_dictionary.py taking a long time","user":{"login":"jimmyfive","id":5302614,"avatar_url":"https://avatars.githubusercontent.com/u/5302614?v=3","gravatar_id":"","url":"https://api.github.com/users/jimmyfive","html_url":"https://github.com/jimmyfive","followers_url":"https://api.github.com/users/jimmyfive/followers","following_url":"https://api.github.com/users/jimmyfive/following{/other_user}","gists_url":"https://api.github.com/users/jimmyfive/gists{/gist_id}","starred_url":"https://api.github.com/users/jimmyfive/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jimmyfive/subscriptions","organizations_url":"https://api.github.com/users/jimmyfive/orgs","repos_url":"https://api.github.com/users/jimmyfive/repos","events_url":"https://api.github.com/users/jimmyfive/events{/privacy}","received_events_url":"https://api.github.com/users/jimmyfive/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":8,"created_at":"2015-05-28T12:24:56Z","updated_at":"2015-05-28T18:06:34Z","closed_at":null,"body":"Not sure if this is an issue or it's just the way it works.  I'm trying to use the software (great idea btw, thank you for doing this).  I'm kind of stuck on the  db_mgmt_cpe_other_dictionary.py script.\r\nIt starts off well, running its thing quickly.  Then after a few hours the process slows way down, according to the progress bar.  It's been running for over 12 hours now.\r\nmongostat\r\nmongostat\r\nconnected to: 127.0.0.1\r\ninsert  query update delete getmore command flushes mapped  vsize    res faults  locked db idx miss %     qr|qw   ar|aw  netIn netOut  conn       time\r\n    *0     *0     *0     *0       0    69|0       0  1.03g   2.3g   472m      0 cvedb:0.0%          0       0|0     1|0     7k     7k     3   05:22:20\r\n    *0     *0     *0     *0       0    71|0       0  1.03g   2.3g   472m      0 cvedb:0.0%          0       0|0     1|0     7k     7k     3   05:22:21\r\n    *0     *0     *0     *0       0    71|0       0  1.03g   2.3g   472m      0 cvedb:0.0%          0       0|0     1|0     7k     7k     3   05:22:22\r\n    *0     *0     *0     *0       0    72|0       1  1.03g   2.3g   472m      0 cvedb:0.0%          0       0|0     1|0     7k     8k     3   05:22:23\r\n    *0     *0     *0     *0       0    69|0       0  1.03g   2.3g   472m      0 cvedb:0.0%          0       0|0     1|0     7k     7k     3   05:22:24\r\n    *0     *0     *0     *0       0    71|0       0  1.03g   2.3g   472m      0 cvedb:0.0%          0       0|0     1|0     7k     7k     3   05:22:25\r\n    *0      3     *0     *0       0    69|0       0  1.03g   2.3g   472m      0 cvedb:0.0%          0       0|0     1|0     7k     7k     3   05:22:26\r\n    *0     *0     *0     *0       0    71|0       0  1.03g   2.3g   472m      0 cvedb:0.0%          0       0|0     1|0     7k     7k     3   05:22:27\r\n    *0     *0     *0     *0       0    71|0       0  1.03g   2.3g   472m      0 cvedb:0.0%          0       0|0     1|0     7k     7k     3   05:22:28\r\n    *0     *0     *0     *0       0    71|0       0  1.03g   2.3g   472m      0 cvedb:0.0%          0       0|0     1|0     7k     7k     3   05:22:29\r\n\r\n\r\n mongotop\r\nconnected to: 127.0.0.1\r\n\r\n                            ns       total        read       write              2015-05-28T12:23:09\r\n                     cvedb.cpe      1967ms      1967ms         0ms\r\n                cvedb.cpeother         2ms         2ms         0ms\r\n          admin.system.indexes         0ms         0ms         0ms\r\n            admin.system.roles         0ms         0ms         0ms\r\n            admin.system.users         0ms         0ms         0ms\r\n          admin.system.version         0ms         0ms         0ms\r\n\r\n                            ns       total        read       write              2015-05-28T12:23:10\r\n                     cvedb.cpe      1917ms      1917ms         0ms\r\n                cvedb.cpeother         1ms         1ms         0ms\r\n          admin.system.indexes         0ms         0ms         0ms\r\n            admin.system.roles         0ms         0ms         0ms\r\n            admin.system.users         0ms         0ms         0ms\r\n          admin.system.version         0ms         0ms         0ms\r\n\r\n                            ns       total        read       write              2015-05-28T12:23:11\r\n                     cvedb.cpe      1958ms      1958ms         0ms\r\n                cvedb.cpeother         1ms         1ms         0ms\r\n          admin.system.indexes         0ms         0ms         0ms\r\n            admin.system.roles         0ms         0ms         0ms\r\n            admin.system.users         0ms         0ms         0ms\r\n          admin.system.version         0ms         0ms         0ms\r\n\r\n\r\nUnix top\r\n  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND\r\n  628 mongodb   20   0 2408028 484064 439436 S  97.1 23.7   1153:57 mongod\r\n 1311 root      20   0  985416 794980   7664 S   2.7 39.0  22:46.23 python3"},"comment":{"url":"https://api.github.com/repos/wimremes/cve-search/issues/comments/106538985","html_url":"https://github.com/wimremes/cve-search/issues/75#issuecomment-106538985","issue_url":"https://api.github.com/repos/wimremes/cve-search/issues/75","id":106538985,"user":{"login":"jimmyfive","id":5302614,"avatar_url":"https://avatars.githubusercontent.com/u/5302614?v=3","gravatar_id":"","url":"https://api.github.com/users/jimmyfive","html_url":"https://github.com/jimmyfive","followers_url":"https://api.github.com/users/jimmyfive/followers","following_url":"https://api.github.com/users/jimmyfive/following{/other_user}","gists_url":"https://api.github.com/users/jimmyfive/gists{/gist_id}","starred_url":"https://api.github.com/users/jimmyfive/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jimmyfive/subscriptions","organizations_url":"https://api.github.com/users/jimmyfive/orgs","repos_url":"https://api.github.com/users/jimmyfive/repos","events_url":"https://api.github.com/users/jimmyfive/events{/privacy}","received_events_url":"https://api.github.com/users/jimmyfive/received_events","type":"User","site_admin":false},"created_at":"2015-05-28T18:06:34Z","updated_at":"2015-05-28T18:06:34Z","body":"Good news, the process took a while but it finished.  Took around 18 hours to complete.\r\n"}}