{"action":"created","issue":{"url":"https://api.github.com/repos/dmwm/CRABClient/issues/4573","labels_url":"https://api.github.com/repos/dmwm/CRABClient/issues/4573/labels{/name}","comments_url":"https://api.github.com/repos/dmwm/CRABClient/issues/4573/comments","events_url":"https://api.github.com/repos/dmwm/CRABClient/issues/4573/events","html_url":"https://github.com/dmwm/CRABClient/pull/4573","id":115930235,"number":4573,"title":"Fixes for crab report command. Fixes #4522","user":{"login":"AndresTanasijczuk","id":6575844,"avatar_url":"https://avatars.githubusercontent.com/u/6575844?v=3","gravatar_id":"","url":"https://api.github.com/users/AndresTanasijczuk","html_url":"https://github.com/AndresTanasijczuk","followers_url":"https://api.github.com/users/AndresTanasijczuk/followers","following_url":"https://api.github.com/users/AndresTanasijczuk/following{/other_user}","gists_url":"https://api.github.com/users/AndresTanasijczuk/gists{/gist_id}","starred_url":"https://api.github.com/users/AndresTanasijczuk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AndresTanasijczuk/subscriptions","organizations_url":"https://api.github.com/users/AndresTanasijczuk/orgs","repos_url":"https://api.github.com/users/AndresTanasijczuk/repos","events_url":"https://api.github.com/users/AndresTanasijczuk/events{/privacy}","received_events_url":"https://api.github.com/users/AndresTanasijczuk/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"AndresTanasijczuk","id":6575844,"avatar_url":"https://avatars.githubusercontent.com/u/6575844?v=3","gravatar_id":"","url":"https://api.github.com/users/AndresTanasijczuk","html_url":"https://github.com/AndresTanasijczuk","followers_url":"https://api.github.com/users/AndresTanasijczuk/followers","following_url":"https://api.github.com/users/AndresTanasijczuk/following{/other_user}","gists_url":"https://api.github.com/users/AndresTanasijczuk/gists{/gist_id}","starred_url":"https://api.github.com/users/AndresTanasijczuk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AndresTanasijczuk/subscriptions","organizations_url":"https://api.github.com/users/AndresTanasijczuk/orgs","repos_url":"https://api.github.com/users/AndresTanasijczuk/repos","events_url":"https://api.github.com/users/AndresTanasijczuk/events{/privacy}","received_events_url":"https://api.github.com/users/AndresTanasijczuk/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/dmwm/CRABClient/milestones/76","html_url":"https://github.com/dmwm/CRABClient/milestones/CRAB3%20February%202016","labels_url":"https://api.github.com/repos/dmwm/CRABClient/milestones/76/labels","id":1304062,"number":76,"title":"CRAB3 February 2016","description":"Issues that should be solved for the CRAB3 release to be deployed in February 2016.","creator":{"login":"belforte","id":1837785,"avatar_url":"https://avatars.githubusercontent.com/u/1837785?v=3","gravatar_id":"","url":"https://api.github.com/users/belforte","html_url":"https://github.com/belforte","followers_url":"https://api.github.com/users/belforte/followers","following_url":"https://api.github.com/users/belforte/following{/other_user}","gists_url":"https://api.github.com/users/belforte/gists{/gist_id}","starred_url":"https://api.github.com/users/belforte/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/belforte/subscriptions","organizations_url":"https://api.github.com/users/belforte/orgs","repos_url":"https://api.github.com/users/belforte/repos","events_url":"https://api.github.com/users/belforte/events{/privacy}","received_events_url":"https://api.github.com/users/belforte/received_events","type":"User","site_admin":false},"open_issues":10,"closed_issues":5,"state":"open","created_at":"2015-09-14T10:37:08Z","updated_at":"2015-12-18T15:01:22Z","due_on":"2016-01-18T23:00:00Z","closed_at":null},"comments":79,"created_at":"2015-11-09T17:53:10Z","updated_at":"2015-12-19T10:21:36Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/dmwm/CRABClient/pulls/4573","html_url":"https://github.com/dmwm/CRABClient/pull/4573","diff_url":"https://github.com/dmwm/CRABClient/pull/4573.diff","patch_url":"https://github.com/dmwm/CRABClient/pull/4573.patch"},"body":"On top of what is discussed in #4522, I also: \r\n* Removed --usedbs option, because in the report the output/input datasets lumis are always returned (the input datasets lumis from a file saved at data discovery time).\r\n* Added --failed option (feel free to suggest a better name): accepts a comma-separated list of jobs states, e.g. `--failed=failed,killed`, in which case the report will return as the not-processed lumis the lumis that all jobs in those states should have processed. Otherwise the default for not-processed lumis is = lumis in run_and_lumis.tar.gz - processed lumis.\r\n\r\nThis PR has a counterpart in the server: https://github.com/dmwm/CRABServer/pull/5046. The server PR is backward compatible with current client and with old tasks."},"comment":{"url":"https://api.github.com/repos/dmwm/CRABClient/issues/comments/165972034","html_url":"https://github.com/dmwm/CRABClient/pull/4573#issuecomment-165972034","issue_url":"https://api.github.com/repos/dmwm/CRABClient/issues/4573","id":165972034,"user":{"login":"AndresTanasijczuk","id":6575844,"avatar_url":"https://avatars.githubusercontent.com/u/6575844?v=3","gravatar_id":"","url":"https://api.github.com/users/AndresTanasijczuk","html_url":"https://github.com/AndresTanasijczuk","followers_url":"https://api.github.com/users/AndresTanasijczuk/followers","following_url":"https://api.github.com/users/AndresTanasijczuk/following{/other_user}","gists_url":"https://api.github.com/users/AndresTanasijczuk/gists{/gist_id}","starred_url":"https://api.github.com/users/AndresTanasijczuk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AndresTanasijczuk/subscriptions","organizations_url":"https://api.github.com/users/AndresTanasijczuk/orgs","repos_url":"https://api.github.com/users/AndresTanasijczuk/repos","events_url":"https://api.github.com/users/AndresTanasijczuk/events{/privacy}","received_events_url":"https://api.github.com/users/AndresTanasijczuk/received_events","type":"User","site_admin":false},"created_at":"2015-12-19T10:21:36Z","updated_at":"2015-12-19T10:21:36Z","body":"@belforte Do you remember what we talked about the --recovery option? Recap: We said that it should accept three values: 1) 'notFinished', 2) 'notPublished', 3) 'failed', and that in each case the list of lumis for the recovery task (what we were always calling \"missingLumis\") should be calculated as:\r\n1) the lumis that the task should have processed (the runsAndLumis tarball) minus what has successfully been processed (up to transfers and filemetadata upload, but not necessarily publication);\r\n2) the lumis in the input dataset minus the published lumis;\r\n3) the lumis that should have been analyzed by failed jobs.\r\nI was thinking if 2) is useful at all, or instead should it be more appropriate to do: the lumis that the task should have processed (the runsAndLumis tarball) minus what has been published. Actually, in that case 1) and 2) will become the same once we integrate the publication as a step of the task that the DAG FINAL node will monitor."}}