{"action":"created","issue":{"url":"https://api.github.com/repos/certtools/intelmq/issues/345","labels_url":"https://api.github.com/repos/certtools/intelmq/issues/345/labels{/name}","comments_url":"https://api.github.com/repos/certtools/intelmq/issues/345/comments","events_url":"https://api.github.com/repos/certtools/intelmq/issues/345/events","html_url":"https://github.com/certtools/intelmq/pull/345","id":108026541,"number":345,"title":"ENH: improve error handling","user":{"login":"SYNchroACK","id":4184292,"avatar_url":"https://avatars.githubusercontent.com/u/4184292?v=3","gravatar_id":"","url":"https://api.github.com/users/SYNchroACK","html_url":"https://github.com/SYNchroACK","followers_url":"https://api.github.com/users/SYNchroACK/followers","following_url":"https://api.github.com/users/SYNchroACK/following{/other_user}","gists_url":"https://api.github.com/users/SYNchroACK/gists{/gist_id}","starred_url":"https://api.github.com/users/SYNchroACK/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SYNchroACK/subscriptions","organizations_url":"https://api.github.com/users/SYNchroACK/orgs","repos_url":"https://api.github.com/users/SYNchroACK/repos","events_url":"https://api.github.com/users/SYNchroACK/events{/privacy}","received_events_url":"https://api.github.com/users/SYNchroACK/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/certtools/intelmq/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"open","locked":false,"assignee":{"login":"sebix","id":199050,"avatar_url":"https://avatars.githubusercontent.com/u/199050?v=3","gravatar_id":"","url":"https://api.github.com/users/sebix","html_url":"https://github.com/sebix","followers_url":"https://api.github.com/users/sebix/followers","following_url":"https://api.github.com/users/sebix/following{/other_user}","gists_url":"https://api.github.com/users/sebix/gists{/gist_id}","starred_url":"https://api.github.com/users/sebix/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sebix/subscriptions","organizations_url":"https://api.github.com/users/sebix/orgs","repos_url":"https://api.github.com/users/sebix/repos","events_url":"https://api.github.com/users/sebix/events{/privacy}","received_events_url":"https://api.github.com/users/sebix/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/certtools/intelmq/milestones/2","html_url":"https://github.com/certtools/intelmq/milestones/Release%201","labels_url":"https://api.github.com/repos/certtools/intelmq/milestones/2/labels","id":719078,"number":2,"title":"Release 1","description":"","creator":{"login":"SYNchroACK","id":4184292,"avatar_url":"https://avatars.githubusercontent.com/u/4184292?v=3","gravatar_id":"","url":"https://api.github.com/users/SYNchroACK","html_url":"https://github.com/SYNchroACK","followers_url":"https://api.github.com/users/SYNchroACK/followers","following_url":"https://api.github.com/users/SYNchroACK/following{/other_user}","gists_url":"https://api.github.com/users/SYNchroACK/gists{/gist_id}","starred_url":"https://api.github.com/users/SYNchroACK/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SYNchroACK/subscriptions","organizations_url":"https://api.github.com/users/SYNchroACK/orgs","repos_url":"https://api.github.com/users/SYNchroACK/repos","events_url":"https://api.github.com/users/SYNchroACK/events{/privacy}","received_events_url":"https://api.github.com/users/SYNchroACK/received_events","type":"User","site_admin":false},"open_issues":33,"closed_issues":169,"state":"open","created_at":"2014-07-12T18:19:52Z","updated_at":"2015-09-25T19:22:01Z","due_on":"2014-08-31T07:00:00Z","closed_at":null},"comments":6,"created_at":"2015-09-23T23:21:04Z","updated_at":"2015-09-29T10:58:18Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/certtools/intelmq/pulls/345","html_url":"https://github.com/certtools/intelmq/pull/345","diff_url":"https://github.com/certtools/intelmq/pull/345.diff","patch_url":"https://github.com/certtools/intelmq/pull/345.patch"},"body":""},"comment":{"url":"https://api.github.com/repos/certtools/intelmq/issues/comments/144026648","html_url":"https://github.com/certtools/intelmq/pull/345#issuecomment-144026648","issue_url":"https://api.github.com/repos/certtools/intelmq/issues/345","id":144026648,"user":{"login":"SYNchroACK","id":4184292,"avatar_url":"https://avatars.githubusercontent.com/u/4184292?v=3","gravatar_id":"","url":"https://api.github.com/users/SYNchroACK","html_url":"https://github.com/SYNchroACK","followers_url":"https://api.github.com/users/SYNchroACK/followers","following_url":"https://api.github.com/users/SYNchroACK/following{/other_user}","gists_url":"https://api.github.com/users/SYNchroACK/gists{/gist_id}","starred_url":"https://api.github.com/users/SYNchroACK/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/SYNchroACK/subscriptions","organizations_url":"https://api.github.com/users/SYNchroACK/orgs","repos_url":"https://api.github.com/users/SYNchroACK/repos","events_url":"https://api.github.com/users/SYNchroACK/events{/privacy}","received_events_url":"https://api.github.com/users/SYNchroACK/received_events","type":"User","site_admin":false},"created_at":"2015-09-29T10:58:18Z","updated_at":"2015-09-29T10:58:18Z","body":"> You can deactivate the message dumping by adding this to conf in mocked_config in lib/test.py and tests/lib/bot.py:\r\n> \r\n> \"error_dump_message\": False,\r\n> but it does not solve the problem. dump_message is only called when an error occured and it is catched.\r\n> \r\n> What errors do we see?\r\n> \r\n> test-bot: INFO: Start processing.\r\n> test-bot: DEBUG: Receiving Message.\r\n> test-bot: ERROR: Bot has found a problem.\r\n> Traceback (most recent call last):\r\n> File \"/home/sebastian/dev/intelmq/intelmq/lib/bot.py\", line 96, in start\r\n> self.process()\r\n> File \"/home/sebastian/dev/intelmq/intelmq/tests/bots/test_dummy_bot.py\", line 40, in process\r\n> report = self.receive_message()\r\n> File \"/home/sebastian/dev/intelmq/intelmq/lib/bot.py\", line 239, in receive_message\r\n> message = self.source_pipeline.receive()\r\n> File \"/home/sebastian/dev/intelmq/intelmq/lib/pipeline.py\", line 198, in receive\r\n> first_msg = self.state[self.source_queue].pop(0)\r\n> IndexError: pop from empty list\r\n> test-bot: INFO: Last Correct Message(event): None.\r\n> test-bot: INFO: Current Message(event): None.\r\n> In many cases, the error occurs on the second message, the processing of the first succeeded.\r\n> \r\n> Another maybe related issue I see is the memory consumption. My nosetests processes got killed after consumed huge amounts of memory and no processes in tests. Looks like a memory leak in a infinite loop...\r\n> \r\n> Please don't forget to apply PEP8 to your code changes after fixing the issues.\r\n\r\nIt seems to me that is an isse in Pythonlist class, right? I think we should merge"}}