{"action":"created","issue":{"url":"https://api.github.com/repos/Automattic/kue/issues/716","labels_url":"https://api.github.com/repos/Automattic/kue/issues/716/labels{/name}","comments_url":"https://api.github.com/repos/Automattic/kue/issues/716/comments","events_url":"https://api.github.com/repos/Automattic/kue/issues/716/events","html_url":"https://github.com/Automattic/kue/issues/716","id":108104311,"number":716,"title":"Does kue fail after a few million tasks ?","user":{"login":"AaronO","id":949223,"avatar_url":"https://avatars.githubusercontent.com/u/949223?v=3","gravatar_id":"","url":"https://api.github.com/users/AaronO","html_url":"https://github.com/AaronO","followers_url":"https://api.github.com/users/AaronO/followers","following_url":"https://api.github.com/users/AaronO/following{/other_user}","gists_url":"https://api.github.com/users/AaronO/gists{/gist_id}","starred_url":"https://api.github.com/users/AaronO/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AaronO/subscriptions","organizations_url":"https://api.github.com/users/AaronO/orgs","repos_url":"https://api.github.com/users/AaronO/repos","events_url":"https://api.github.com/users/AaronO/events{/privacy}","received_events_url":"https://api.github.com/users/AaronO/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/Automattic/kue/labels/Discussion","name":"Discussion","color":"bfd4f2"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":8,"created_at":"2015-09-24T10:40:52Z","updated_at":"2015-09-24T19:45:19Z","closed_at":null,"body":"Every time we reach about ~10,000,000 tasks, `kue` / `redis` seems to get stuck. It can add new tasks to `redis` but `kue` stops consuming tasks so they just pile up ...\r\n\r\nI was wondering if anyone else has experienced this issue with `kue` in production and has an idea why `kue` would fail ?"},"comment":{"url":"https://api.github.com/repos/Automattic/kue/issues/comments/143030191","html_url":"https://github.com/Automattic/kue/issues/716#issuecomment-143030191","issue_url":"https://api.github.com/repos/Automattic/kue/issues/716","id":143030191,"user":{"login":"behrad","id":2151889,"avatar_url":"https://avatars.githubusercontent.com/u/2151889?v=3","gravatar_id":"","url":"https://api.github.com/users/behrad","html_url":"https://github.com/behrad","followers_url":"https://api.github.com/users/behrad/followers","following_url":"https://api.github.com/users/behrad/following{/other_user}","gists_url":"https://api.github.com/users/behrad/gists{/gist_id}","starred_url":"https://api.github.com/users/behrad/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/behrad/subscriptions","organizations_url":"https://api.github.com/users/behrad/orgs","repos_url":"https://api.github.com/users/behrad/repos","events_url":"https://api.github.com/users/behrad/events{/privacy}","received_events_url":"https://api.github.com/users/behrad/received_events","type":"User","site_admin":false},"created_at":"2015-09-24T19:45:19Z","updated_at":"2015-09-24T19:45:19Z","body":"please verify that the list being BLPOPed contains items.. ( for each job on your inactive, you should have a single item (=1) in it's corresponding list. Actually what watchStuckJob does is always checking if that list is sync with inactive ZSET (containing enough items to be BLPOPed)\r\nif your issue is the helper list being emptied while you have jobs in inactive ZSET, I wonder why watchStuckJobs isn't working!!!"}}