{"action":"created","issue":{"url":"https://api.github.com/repos/robotframework/robotframework/issues/1926","labels_url":"https://api.github.com/repos/robotframework/robotframework/issues/1926/labels{/name}","comments_url":"https://api.github.com/repos/robotframework/robotframework/issues/1926/comments","events_url":"https://api.github.com/repos/robotframework/robotframework/issues/1926/events","html_url":"https://github.com/robotframework/robotframework/issues/1926","id":57767558,"number":1926,"title":"Memory Error with Rebot","user":{"login":"dhoomakethu","id":9276974,"avatar_url":"https://avatars.githubusercontent.com/u/9276974?v=3","gravatar_id":"","url":"https://api.github.com/users/dhoomakethu","html_url":"https://github.com/dhoomakethu","followers_url":"https://api.github.com/users/dhoomakethu/followers","following_url":"https://api.github.com/users/dhoomakethu/following{/other_user}","gists_url":"https://api.github.com/users/dhoomakethu/gists{/gist_id}","starred_url":"https://api.github.com/users/dhoomakethu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dhoomakethu/subscriptions","organizations_url":"https://api.github.com/users/dhoomakethu/orgs","repos_url":"https://api.github.com/users/dhoomakethu/repos","events_url":"https://api.github.com/users/dhoomakethu/events{/privacy}","received_events_url":"https://api.github.com/users/dhoomakethu/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-02-16T05:52:15Z","updated_at":"2015-02-16T07:56:58Z","closed_at":"2015-02-16T07:56:58Z","body":"Hi,\r\n\r\nWe are trying to generate reports and log out of a huge output.xml (>700MB) with rebot utility but unfortunately we are getting MemoryError (error trace below) .\r\n\r\nI have already tried --splitlog, --removekeywords with out any success.\r\nI tried searching the open and closed bugs for this issue and could found some options to avoid this issue while running the tests but We do not have much time to run these tests again . Any suggestions or hints to overcome this issue is highly appreciated.\r\n\r\nSanjay\r\n\r\n###############################################################################\r\nC:\\Users\\skvenkatesh\\Desktop>rebot -d C:\\Users\\skvenkatesh\\Desktop\\parser --spli\r\ntlog --removekeywords passed output.xml\r\nTraceback (most recent call last):\r\n  File \"C:\\Python27\\lib\\runpy.py\", line 162, in _run_module_as_main\r\n    \"__main__\", fname, loader, pkg_name)\r\n  File \"C:\\Python27\\lib\\runpy.py\", line 72, in _run_code\r\n    exec code in run_globals\r\n  File \"C:\\Python27\\lib\\site-packages\\robot\\rebot.py\", line 381, in <module>\r\n    rebot_cli(sys.argv[1:])\r\n  File \"C:\\Python27\\lib\\site-packages\\robot\\rebot.py\", line 345, in rebot_cli\r\n    Rebot().execute_cli(arguments)\r\n  File \"C:\\Python27\\lib\\site-packages\\robot\\utils\\application.py\", line 44, in e\r\nxecute_cli\r\n    rc = self._execute(arguments, options)\r\n  File \"C:\\Python27\\lib\\site-packages\\robot\\utils\\application.py\", line 94, in _\r\nexecute\r\n    error, details = get_error_details()\r\n  File \"C:\\Python27\\lib\\site-packages\\robot\\utils\\error.py\", line 45, in get_err\r\nor_details\r\n    details = ErrorDetails()\r\n  File \"C:\\Python27\\lib\\site-packages\\robot\\utils\\error.py\", line 58, in ErrorDe\r\ntails\r\n    raise exc_value\r\nMemoryError\r\n"},"comment":{"url":"https://api.github.com/repos/robotframework/robotframework/issues/comments/74471011","html_url":"https://github.com/robotframework/robotframework/issues/1926#issuecomment-74471011","issue_url":"https://api.github.com/repos/robotframework/robotframework/issues/1926","id":74471011,"user":{"login":"pekkaklarck","id":114985,"avatar_url":"https://avatars.githubusercontent.com/u/114985?v=3","gravatar_id":"","url":"https://api.github.com/users/pekkaklarck","html_url":"https://github.com/pekkaklarck","followers_url":"https://api.github.com/users/pekkaklarck/followers","following_url":"https://api.github.com/users/pekkaklarck/following{/other_user}","gists_url":"https://api.github.com/users/pekkaklarck/gists{/gist_id}","starred_url":"https://api.github.com/users/pekkaklarck/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pekkaklarck/subscriptions","organizations_url":"https://api.github.com/users/pekkaklarck/orgs","repos_url":"https://api.github.com/users/pekkaklarck/repos","events_url":"https://api.github.com/users/pekkaklarck/events{/privacy}","received_events_url":"https://api.github.com/users/pekkaklarck/received_events","type":"User","site_admin":false},"created_at":"2015-02-16T07:56:58Z","updated_at":"2015-02-16T07:56:58Z","body":"We have tried to make output.xml processing as memory efficient as possible, but there's always a limit when memory runs out. I'm not particularly interested to do more memory profiling at the moment, but I'm definitely interested in findings if someone else wants to take a look at that.\r\n\r\nYou have some workarounds:\r\n\r\n- Get more memory. It's so cheap nowadays that there's no excuse not to have 16GB on machines that need to process such big outputs. This is likely the easiest solution.\r\n\r\n- Avoid constructs that create big nested keyword structures (and thus increase output.xml size) such as for loops and Wait Until Keyword Succeeds keyword. Try to replace them with code moved to test libraries.\r\n\r\n- If you cannot avoid such structures, try using `--flattenkeywords` to flatten them. This option saves a lot more memory during output.xml processing than `--removekeywords`. See User Guide for details.\r\n\r\n- Split test execution to smaller pieces. If you want to get one combined report, you need to post process those individual output.xml files before combination to avoid same memory error than when processing one big file, though."}}