{"action":"created","issue":{"url":"https://api.github.com/repos/translate/pootle/issues/3548","labels_url":"https://api.github.com/repos/translate/pootle/issues/3548/labels{/name}","comments_url":"https://api.github.com/repos/translate/pootle/issues/3548/comments","events_url":"https://api.github.com/repos/translate/pootle/issues/3548/events","html_url":"https://github.com/translate/pootle/issues/3548","id":55488262,"number":3548,"title":"refresh_stats --calculate-wordcount is dangerous and expensive","user":{"login":"dwaynebailey","id":647438,"avatar_url":"https://avatars.githubusercontent.com/u/647438?v=3","gravatar_id":"","url":"https://api.github.com/users/dwaynebailey","html_url":"https://github.com/dwaynebailey","followers_url":"https://api.github.com/users/dwaynebailey/followers","following_url":"https://api.github.com/users/dwaynebailey/following{/other_user}","gists_url":"https://api.github.com/users/dwaynebailey/gists{/gist_id}","starred_url":"https://api.github.com/users/dwaynebailey/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dwaynebailey/subscriptions","organizations_url":"https://api.github.com/users/dwaynebailey/orgs","repos_url":"https://api.github.com/users/dwaynebailey/repos","events_url":"https://api.github.com/users/dwaynebailey/events{/privacy}","received_events_url":"https://api.github.com/users/dwaynebailey/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-01-26T14:31:34Z","updated_at":"2015-05-20T12:58:25Z","closed_at":null,"body":"If you run ``refresh_stats --calculate-wordcount`` it will create a job per unit.  Thus a relatively small project could spawn a massive amount of jobs and chock legitimate jobs.  The name looks harmless and looks in fact like something you want to choose.  It was used to help transition ``WORDCOUNT_FUNC`` changes.\r\n\r\nSo the use may still be useful.  So I would suggestion doing some or all of the following:\r\n\r\n1. Rename the option and mark it as expensive.\r\n2. Add a ``low`` priority queue where this and other tasks could reside."},"comment":{"url":"https://api.github.com/repos/translate/pootle/issues/comments/103875453","html_url":"https://github.com/translate/pootle/issues/3548#issuecomment-103875453","issue_url":"https://api.github.com/repos/translate/pootle/issues/3548","id":103875453,"user":{"login":"julen","id":16768,"avatar_url":"https://avatars.githubusercontent.com/u/16768?v=3","gravatar_id":"","url":"https://api.github.com/users/julen","html_url":"https://github.com/julen","followers_url":"https://api.github.com/users/julen/followers","following_url":"https://api.github.com/users/julen/following{/other_user}","gists_url":"https://api.github.com/users/julen/gists{/gist_id}","starred_url":"https://api.github.com/users/julen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/julen/subscriptions","organizations_url":"https://api.github.com/users/julen/orgs","repos_url":"https://api.github.com/users/julen/repos","events_url":"https://api.github.com/users/julen/events{/privacy}","received_events_url":"https://api.github.com/users/julen/received_events","type":"User","site_admin":false},"created_at":"2015-05-20T12:58:25Z","updated_at":"2015-05-20T12:58:25Z","body":"So `--calculate-wordcount` should be [moved away from `refresh_stats`](https://github.com/translate/pootle/commit/fffcce4e6dbea7eb357cacf56ed8f235107bab01#commitcomment-11282376) into its own standalone command (note it's not even available in `refresh_stats_rq`)."}}