{"action":"created","issue":{"url":"https://api.github.com/repos/cBio/cbio-cluster/issues/172","labels_url":"https://api.github.com/repos/cBio/cbio-cluster/issues/172/labels{/name}","comments_url":"https://api.github.com/repos/cBio/cbio-cluster/issues/172/comments","events_url":"https://api.github.com/repos/cBio/cbio-cluster/issues/172/events","html_url":"https://github.com/cBio/cbio-cluster/issues/172","id":49098360,"number":172,"title":"Array jobs not being cleared from Q after completion","user":{"login":"KjongLehmann","id":2054148,"avatar_url":"https://avatars.githubusercontent.com/u/2054148?v=3","gravatar_id":"","url":"https://api.github.com/users/KjongLehmann","html_url":"https://github.com/KjongLehmann","followers_url":"https://api.github.com/users/KjongLehmann/followers","following_url":"https://api.github.com/users/KjongLehmann/following{/other_user}","gists_url":"https://api.github.com/users/KjongLehmann/gists{/gist_id}","starred_url":"https://api.github.com/users/KjongLehmann/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/KjongLehmann/subscriptions","organizations_url":"https://api.github.com/users/KjongLehmann/orgs","repos_url":"https://api.github.com/users/KjongLehmann/repos","events_url":"https://api.github.com/users/KjongLehmann/events{/privacy}","received_events_url":"https://api.github.com/users/KjongLehmann/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/cBio/cbio-cluster/labels/bug","name":"bug","color":"d4c5f9"},{"url":"https://api.github.com/repos/cBio/cbio-cluster/labels/Torque/Moab%20scheduler","name":"Torque/Moab scheduler","color":"009800"},{"url":"https://api.github.com/repos/cBio/cbio-cluster/labels/torqueupdate","name":"torqueupdate","color":"fad8c7"},{"url":"https://api.github.com/repos/cBio/cbio-cluster/labels/vendorticket","name":"vendorticket","color":"5319e7"}],"state":"open","locked":false,"assignee":{"login":"tatarsky","id":6439722,"avatar_url":"https://avatars.githubusercontent.com/u/6439722?v=3","gravatar_id":"","url":"https://api.github.com/users/tatarsky","html_url":"https://github.com/tatarsky","followers_url":"https://api.github.com/users/tatarsky/followers","following_url":"https://api.github.com/users/tatarsky/following{/other_user}","gists_url":"https://api.github.com/users/tatarsky/gists{/gist_id}","starred_url":"https://api.github.com/users/tatarsky/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tatarsky/subscriptions","organizations_url":"https://api.github.com/users/tatarsky/orgs","repos_url":"https://api.github.com/users/tatarsky/repos","events_url":"https://api.github.com/users/tatarsky/events{/privacy}","received_events_url":"https://api.github.com/users/tatarsky/received_events","type":"User","site_admin":false},"milestone":null,"comments":162,"created_at":"2014-11-17T14:50:31Z","updated_at":"2015-02-06T19:33:04Z","closed_at":null,"body":"This may be related to issue 170, but completed array jobs do not seem to be removed from the Q. In my case I can still see 2513464-2513471."},"comment":{"url":"https://api.github.com/repos/cBio/cbio-cluster/issues/comments/73298273","html_url":"https://github.com/cBio/cbio-cluster/issues/172#issuecomment-73298273","issue_url":"https://api.github.com/repos/cBio/cbio-cluster/issues/172","id":73298273,"user":{"login":"KjongLehmann","id":2054148,"avatar_url":"https://avatars.githubusercontent.com/u/2054148?v=3","gravatar_id":"","url":"https://api.github.com/users/KjongLehmann","html_url":"https://github.com/KjongLehmann","followers_url":"https://api.github.com/users/KjongLehmann/followers","following_url":"https://api.github.com/users/KjongLehmann/following{/other_user}","gists_url":"https://api.github.com/users/KjongLehmann/gists{/gist_id}","starred_url":"https://api.github.com/users/KjongLehmann/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/KjongLehmann/subscriptions","organizations_url":"https://api.github.com/users/KjongLehmann/orgs","repos_url":"https://api.github.com/users/KjongLehmann/repos","events_url":"https://api.github.com/users/KjongLehmann/events{/privacy}","received_events_url":"https://api.github.com/users/KjongLehmann/received_events","type":"User","site_admin":false},"created_at":"2015-02-06T19:33:04Z","updated_at":"2015-02-06T19:33:04Z","body":"So, I restarted running some bigger batches of jobs again and there is a curious observation here. I just submitted a set of 10 array jobs (500 slots each) to the cluster. Interestingly, the total count of jobs does not add up to 5K. Doing a more detailed check, half of the array jobs are missing a considerable number of slots in the scheduler. I do believe this is related to the old issue and thus posted here. It does not seem to crash the scheduler anymore though."}}