{"action":"created","issue":{"url":"https://api.github.com/repos/dmwm/WMCore/issues/6093","labels_url":"https://api.github.com/repos/dmwm/WMCore/issues/6093/labels{/name}","comments_url":"https://api.github.com/repos/dmwm/WMCore/issues/6093/comments","events_url":"https://api.github.com/repos/dmwm/WMCore/issues/6093/events","html_url":"https://github.com/dmwm/WMCore/issues/6093","id":98636765,"number":6093,"title":"Dashboard reporting trying to (mistakenly ?) process failed jobs","user":{"login":"hufnagel","id":1798355,"avatar_url":"https://avatars.githubusercontent.com/u/1798355?v=3","gravatar_id":"","url":"https://api.github.com/users/hufnagel","html_url":"https://github.com/hufnagel","followers_url":"https://api.github.com/users/hufnagel/followers","following_url":"https://api.github.com/users/hufnagel/following{/other_user}","gists_url":"https://api.github.com/users/hufnagel/gists{/gist_id}","starred_url":"https://api.github.com/users/hufnagel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hufnagel/subscriptions","organizations_url":"https://api.github.com/users/hufnagel/orgs","repos_url":"https://api.github.com/users/hufnagel/repos","events_url":"https://api.github.com/users/hufnagel/events{/privacy}","received_events_url":"https://api.github.com/users/hufnagel/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-08-02T20:54:27Z","updated_at":"2015-08-03T14:05:23Z","closed_at":null,"body":"While looking at what the job accounting is reporting to add better debugging options for the missing file registration, I am going through the job accountant log output in general.\r\n\r\n#6092 removes spurious error messages related to the Dashboard reporting trying to interpret logArchive, LogCollect and Sqlite output in an event processing context (which fails of course).\r\n\r\nThere is another problem with the Dashboard reporting though, it also tries to analyze job output from failed jobs, which then also fails because the job report does not have the information needed.\r\n\r\nExample\r\n\r\n2015-08-02 15:34:26,982:INFO:AccountantWorker:Handling /data/tier0/srv/wmagent/1.9.97/install/tier0/JobCreator/JobCache/Repack_Run253201_StreamALCALUMIPIXELS/Repack/JobCollection_294592_0/job_631497/Report.0.pkl\r\n2015-08-02 15:34:26,997:INFO:AccountantWorker:Handling /data/tier0/srv/wmagent/1.9.97/install/tier0/JobCreator/JobCache/Express_Run253201_StreamExpressCosmics/Express/JobCollection_294628_0/job_631543/Report.0.pkl\r\n2015-08-02 15:34:27,011:INFO:AccountantWorker:Handling /data/tier0/srv/wmagent/1.9.97/install/tier0/JobCreator/JobCache/Express_Run253201_StreamExpressCosmics/Express/JobCollection_294649_0/job_631571/Report.0.pkl\r\n2015-08-02 15:34:27,030:INFO:AccountantWorker:Handling /data/tier0/srv/wmagent/1.9.97/install/tier0/JobCreator/JobCache/Express_Run253201_StreamExpressCosmics/Express/JobCollection_294644_0/job_631565/Report.0.pkl\r\n2015-08-02 15:34:27,034:ERROR:AccountantWorker:I have a bad jobReport for 631565\r\n2015-08-02 15:34:27,048:INFO:AccountantWorker:Handling /data/tier0/srv/wmagent/1.9.97/install/tier0/JobCreator/JobCache/Express_Run253201_StreamExpressCosmics/Express/JobCollection_294646_0/job_631567/Report.0.pkl\r\n2015-08-02 15:34:27,581:INFO:DashboardReporter:Handling 4 jobs\r\n2015-08-02 15:34:27,584:ERROR:DashboardReporter:Output module logArchive has a file /store/unmerged/data/logs/prod/2015/8/2/Repack_Run253201_StreamALCALUMIPIXELS/Repack/0000/0/Repack-bc39a8d8-3918-11e5-95c3-001e67abf228-0-logArchive.tar\\\r\n.gz with incomplete info\r\n2015-08-02 15:34:27,587:ERROR:DashboardReporter:Output module logArchive has a file /store/unmerged/express/logs/prod/2015/8/2/Express_Run253201_StreamExpressCosmics/Express/0000/0/Express-b90e9d3e-3919-11e5-95c3-001e67abf228-0-logArchi\\\r\nve.tar.gz with incomplete info\r\n2015-08-02 15:34:27,590:ERROR:DashboardReporter:Output module logArchive has a file /store/unmerged/express/logs/prod/2015/8/2/Express_Run253201_StreamExpressCosmics/Express/0000/0/Express-43917c1a-391a-11e5-95c3-001e67abf228-0-logArchi\\\r\nve.tar.gz with incomplete info\r\n2015-08-02 15:34:27,594:ERROR:DashboardReporter:Output module logArchive has a file /store/unmerged/express/logs/prod/2015/8/2/Express_Run253201_StreamExpressCosmics/Express/0000/0/Express-2c7bb7f2-391a-11e5-95c3-001e67abf228-0-logArchi\\\r\nve.tar.gz with incomplete info\r\n2015-08-02 15:34:27,782:INFO:DashboardReporter:Handling 1 jobs\r\n2015-08-02 15:34:27,784:ERROR:DashboardReporter:Output module write_ExpressCosmics_FEVT has a file /store/unmerged/express/Run2015B/ExpressCosmics/FEVT/Express-v1/000/253/201/00000/write_ExpressCosmics_FEVT.root with incomplete info\r\n2015-08-02 15:34:27,784:ERROR:DashboardReporter:Output module write_StreamExpressCosmics_ALCARECO has a file /store/unmerged/express/Run2015B/StreamExpressCosmics/ALCARECO/Express-v1/000/253/201/00000/write_StreamExpressCosmics_ALCARECO\\\r\n.root with incomplete info\r\n2015-08-02 15:34:27,785:ERROR:DashboardReporter:Output module write_StreamExpressCosmics_DQMIO has a file /store/unmerged/express/Run2015B/StreamExpressCosmics/DQMIO/Express-v1/000/253/201/00000/write_StreamExpressCosmics_DQMIO.root wit\\\r\nh incomplete info\r\n2015-08-02 15:34:27,786:ERROR:DashboardReporter:Output module logArchive has a file /store/unmerged/express/logs/prod/2015/8/2/Express_Run253201_StreamExpressCosmics/Express/0000/0/Express-154db9fe-391a-11e5-95c3-001e67abf228-0-logArchi\\\r\nve.tar.gz with incomplete info\r\n\r\nThe Dashboard reporting code should be changed to limit what it reports for failed jobs and not try to do things that are known to not work (and then clutter the logs with lots of spurious error messages)."},"comment":{"url":"https://api.github.com/repos/dmwm/WMCore/issues/comments/127252614","html_url":"https://github.com/dmwm/WMCore/issues/6093#issuecomment-127252614","issue_url":"https://api.github.com/repos/dmwm/WMCore/issues/6093","id":127252614,"user":{"login":"hufnagel","id":1798355,"avatar_url":"https://avatars.githubusercontent.com/u/1798355?v=3","gravatar_id":"","url":"https://api.github.com/users/hufnagel","html_url":"https://github.com/hufnagel","followers_url":"https://api.github.com/users/hufnagel/followers","following_url":"https://api.github.com/users/hufnagel/following{/other_user}","gists_url":"https://api.github.com/users/hufnagel/gists{/gist_id}","starred_url":"https://api.github.com/users/hufnagel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hufnagel/subscriptions","organizations_url":"https://api.github.com/users/hufnagel/orgs","repos_url":"https://api.github.com/users/hufnagel/repos","events_url":"https://api.github.com/users/hufnagel/events{/privacy}","received_events_url":"https://api.github.com/users/hufnagel/received_events","type":"User","site_admin":false},"created_at":"2015-08-03T14:05:23Z","updated_at":"2015-08-03T14:05:23Z","body":"Ok, I can get back to it later then myself..."}}