{"action":"created","issue":{"url":"https://api.github.com/repos/attardi/wikiextractor/issues/2","labels_url":"https://api.github.com/repos/attardi/wikiextractor/issues/2/labels{/name}","comments_url":"https://api.github.com/repos/attardi/wikiextractor/issues/2/comments","events_url":"https://api.github.com/repos/attardi/wikiextractor/issues/2/events","html_url":"https://github.com/attardi/wikiextractor/issues/2","id":67527312,"number":2,"title":" 'maximum template recursion' error after a few hours","user":{"login":"agoyaliitk","id":9080303,"avatar_url":"https://avatars.githubusercontent.com/u/9080303?v=3","gravatar_id":"","url":"https://api.github.com/users/agoyaliitk","html_url":"https://github.com/agoyaliitk","followers_url":"https://api.github.com/users/agoyaliitk/followers","following_url":"https://api.github.com/users/agoyaliitk/following{/other_user}","gists_url":"https://api.github.com/users/agoyaliitk/gists{/gist_id}","starred_url":"https://api.github.com/users/agoyaliitk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/agoyaliitk/subscriptions","organizations_url":"https://api.github.com/users/agoyaliitk/orgs","repos_url":"https://api.github.com/users/agoyaliitk/repos","events_url":"https://api.github.com/users/agoyaliitk/events{/privacy}","received_events_url":"https://api.github.com/users/agoyaliitk/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":15,"created_at":"2015-04-10T07:00:00Z","updated_at":"2015-04-21T15:45:18Z","closed_at":"2015-04-15T10:02:17Z","body":"Can you explain why this error occurs?\r\nI used the updated version of the script uploaded yesterday.\r\nNow it's giving this error.\r\n\r\n\r\nTraceback (most recent call last):\r\n  File \"./WikiExtractor.py\", line 1797, in <module>\r\n    main()\r\n  File \"./WikiExtractor.py\", line 1793, in main\r\n    process_data(input_file, args.templates, output_splitter)\r\n  File \"./WikiExtractor.py\", line 1621, in process_data\r\n    extract(id, title, page, output)\r\n  File \"./WikiExtractor.py\", line 132, in extract\r\n    text = clean(text)\r\n  File \"./WikiExtractor.py\", line 1256, in clean\r\n    text = expandTemplates(text)\r\n  File \"./WikiExtractor.py\", line 307, in expandTemplates\r\n    res += expandTemplate(text[s+2:e-2], depth+l)\r\n  File \"./WikiExtractor.py\", line 808, in expandTemplate\r\n    ret = expandTemplates(template, depth + 1)\r\n  File \"./WikiExtractor.py\", line 307, in expandTemplates\r\n    res += expandTemplate(text[s+2:e-2], depth+l)\r\n  File \"./WikiExtractor.py\", line 769, in expandTemplate\r\n    params = templateParams(parts[1:], depth)\r\n  File \"./WikiExtractor.py\", line 396, in templateParams\r\n    parameters = [expandTemplates(p, frame) for p in parameters]\r\n  File \"./WikiExtractor.py\", line 307, in expandTemplates\r\n    res += expandTemplate(text[s+2:e-2], depth+l)\r\n  File \"./WikiExtractor.py\", line 769, in expandTemplate\r\n    params = templateParams(parts[1:], depth)\r\n  File \"./WikiExtractor.py\", line 396, in templateParams\r\n    parameters = [expandTemplates(p, frame) for p in parameters]\r\n  File \"./WikiExtractor.py\", line 307, in expandTemplates\r\n    res += expandTemplate(text[s+2:e-2], depth+l)\r\n  File \"./WikiExtractor.py\", line 808, in expandTemplate\r\n    ret = expandTemplates(template, depth + 1)\r\n  File \"./WikiExtractor.py\", line 313, in expandTemplates\r\n    res += text[cur:]\r\nMemoryError\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/attardi/wikiextractor/issues/comments/94845642","html_url":"https://github.com/attardi/wikiextractor/issues/2#issuecomment-94845642","issue_url":"https://api.github.com/repos/attardi/wikiextractor/issues/2","id":94845642,"user":{"login":"attardi","id":356002,"avatar_url":"https://avatars.githubusercontent.com/u/356002?v=3","gravatar_id":"","url":"https://api.github.com/users/attardi","html_url":"https://github.com/attardi","followers_url":"https://api.github.com/users/attardi/followers","following_url":"https://api.github.com/users/attardi/following{/other_user}","gists_url":"https://api.github.com/users/attardi/gists{/gist_id}","starred_url":"https://api.github.com/users/attardi/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/attardi/subscriptions","organizations_url":"https://api.github.com/users/attardi/orgs","repos_url":"https://api.github.com/users/attardi/repos","events_url":"https://api.github.com/users/attardi/events{/privacy}","received_events_url":"https://api.github.com/users/attardi/received_events","type":"User","site_admin":false},"created_at":"2015-04-21T15:45:18Z","updated_at":"2015-04-21T15:45:18Z","body":"To all of you who complained about memory or speed problems with \nWikiExtractor, I released a new version that performs better and keeps a \ncache of parsed templates.\n\nI have tested it on the English Wikipedia and it runs 5 times faster, \nwhile using 20% more memory (4GB).\nThere were also numerous bug fixes.\n\nThere is also a new command line option --xml that attempts to produce \nHTML instead of pure text, preserving headings, lists and links.\n\nThank you for your patience.\n\n-- Beppe Attardi\n"}}