{"action":"created","issue":{"url":"https://api.github.com/repos/certtools/intelmq/issues/186","labels_url":"https://api.github.com/repos/certtools/intelmq/issues/186/labels{/name}","comments_url":"https://api.github.com/repos/certtools/intelmq/issues/186/comments","events_url":"https://api.github.com/repos/certtools/intelmq/issues/186/events","html_url":"https://github.com/certtools/intelmq/issues/186","id":81935722,"number":186,"title":"Multiprocessing per queue is not supported","user":{"login":"adulau","id":3309,"avatar_url":"https://avatars.githubusercontent.com/u/3309?v=3","gravatar_id":"","url":"https://api.github.com/users/adulau","html_url":"https://github.com/adulau","followers_url":"https://api.github.com/users/adulau/followers","following_url":"https://api.github.com/users/adulau/following{/other_user}","gists_url":"https://api.github.com/users/adulau/gists{/gist_id}","starred_url":"https://api.github.com/users/adulau/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/adulau/subscriptions","organizations_url":"https://api.github.com/users/adulau/orgs","repos_url":"https://api.github.com/users/adulau/repos","events_url":"https://api.github.com/users/adulau/events{/privacy}","received_events_url":"https://api.github.com/users/adulau/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/certtools/intelmq/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":18,"created_at":"2015-05-28T13:52:12Z","updated_at":"2015-05-29T14:36:42Z","closed_at":null,"body":"Multiprocessing per queue is not supported. If you have to process a huge dataset and only a single process is handling a queue, you are time bound with DNS resolution or alike. It would be nice to ensure that you can handle multiple processes for handling a single queue. "},"comment":{"url":"https://api.github.com/repos/certtools/intelmq/issues/comments/106829551","html_url":"https://github.com/certtools/intelmq/issues/186#issuecomment-106829551","issue_url":"https://api.github.com/repos/certtools/intelmq/issues/186","id":106829551,"user":{"login":"Rafiot","id":248875,"avatar_url":"https://avatars.githubusercontent.com/u/248875?v=3","gravatar_id":"","url":"https://api.github.com/users/Rafiot","html_url":"https://github.com/Rafiot","followers_url":"https://api.github.com/users/Rafiot/followers","following_url":"https://api.github.com/users/Rafiot/following{/other_user}","gists_url":"https://api.github.com/users/Rafiot/gists{/gist_id}","starred_url":"https://api.github.com/users/Rafiot/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Rafiot/subscriptions","organizations_url":"https://api.github.com/users/Rafiot/orgs","repos_url":"https://api.github.com/users/Rafiot/repos","events_url":"https://api.github.com/users/Rafiot/events{/privacy}","received_events_url":"https://api.github.com/users/Rafiot/received_events","type":"User","site_admin":false},"created_at":"2015-05-29T14:36:42Z","updated_at":"2015-05-29T14:36:42Z","body":"The schema I did yesterday is for one queue.\r\n\r\nin my terminology, Alienvault-collector is one queue, alienvault-parser is one queue, cymru-to-asn is one queue.\r\n\r\nit doesn't make any sense to have multiple alienvault parser so we would not have multiple processes but the parser could be started multiple times, on multiple files and obviously cymru-to-asn will be started multiple times"}}