{"action":"opened","issue":{"url":"https://api.github.com/repos/gap-system/gap/issues/305","labels_url":"https://api.github.com/repos/gap-system/gap/issues/305/labels{/name}","comments_url":"https://api.github.com/repos/gap-system/gap/issues/305/comments","events_url":"https://api.github.com/repos/gap-system/gap/issues/305/events","html_url":"https://github.com/gap-system/gap/issues/305","id":113389898,"number":305,"title":"Extracting runtimes from TestDirectory logs","user":{"login":"alex-konovalov","id":5751387,"avatar_url":"https://avatars.githubusercontent.com/u/5751387?v=3","gravatar_id":"","url":"https://api.github.com/users/alex-konovalov","html_url":"https://github.com/alex-konovalov","followers_url":"https://api.github.com/users/alex-konovalov/followers","following_url":"https://api.github.com/users/alex-konovalov/following{/other_user}","gists_url":"https://api.github.com/users/alex-konovalov/gists{/gist_id}","starred_url":"https://api.github.com/users/alex-konovalov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alex-konovalov/subscriptions","organizations_url":"https://api.github.com/users/alex-konovalov/orgs","repos_url":"https://api.github.com/users/alex-konovalov/repos","events_url":"https://api.github.com/users/alex-konovalov/events{/privacy}","received_events_url":"https://api.github.com/users/alex-konovalov/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2015-10-26T16:07:09Z","updated_at":"2015-10-26T16:07:09Z","closed_at":null,"body":"I've discovered that this functionality is broken for a while in the master branch. In the stable branch, the log has\r\n```\r\n...\r\ntesting: /mnt/disk2/hudson-slave/workspace/GAP-stable/GAPCOPTS/64build/GAPGMP/\\\r\nnogmp/GAPTARGET/standard/label/64bit/GAP-git-stable-snapshot/tst/primsan.tst\r\nprimsan.tst            89646        1399788    (next ~ 2021 sec)\r\ntesting: /mnt/disk2/hudson-slave/workspace/GAP-stable/GAPCOPTS/64build/GAPGMP/\\\r\nnogmp/GAPTARGET/standard/label/64bit/GAP-git-stable-snapshot/tst/bugfix.tst\r\nbugfix.tst           1900219          80617    (next ~ 1750 sec)\r\ntesting: /mnt/disk2/hudson-slave/workspace/GAP-stable/GAPCOPTS/64build/GAPGMP/\\\r\nnogmp/GAPTARGET/standard/label/64bit/GAP-git-stable-snapshot/tst/grpconst.tst\r\ngrpconst.tst         1104244         187952\r\n-------------------------------------------\r\ntotal                  48357        3623339\r\n```\r\nso I can extract the runtime with\r\n```\r\ngrep \"^${GTEST}\" `ls dev/log/teststandard1_*` | sed -e 's/  */ /g' | cut -f 3 -d ' ' >> dev/log/plot${GTEST}1.txt\r\n```\r\nwhere GTEST is in `arithlst hash2 primsan xgap grppcnrm grpmat grpperm matrix grplatt bugfix grpprmcs grpconst` to build plots in Jenkins to track the performance of selected tests.\r\n\r\nNow in the master branch the log looks like\r\n```\r\ntesting: /mnt/disk2/hudson-slave/workspace/GAP-dev/GAPCOPTS/64build/GAPGMP/nog\\\r\nmp/GAPTARGET/standard/label/64bit/GAP-git-snapshot/tst/teststandard/grpperm.ts\\\r\nt\r\n1799980000              6039         298039   ( next ~345 sec )\r\ntesting: /mnt/disk2/hudson-slave/workspace/GAP-dev/GAPCOPTS/64build/GAPGMP/nog\\\r\nmp/GAPTARGET/standard/label/64bit/GAP-git-snapshot/tst/teststandard/helpsys.ts\\\r\nt\r\n2178880000              2317         940175   ( next ~662 sec )\r\ntesting: /mnt/disk2/hudson-slave/workspace/GAP-dev/GAPCOPTS/64build/GAPGMP/nog\\\r\nmp/GAPTARGET/standard/label/64bit/GAP-git-snapshot/tst/teststandard/arithlst.t\\\r\nst\r\n2776240000              5659         490570   ( next ~2009 sec )\r\ntesting: /mnt/disk2/hudson-slave/workspace/GAP-dev/GAPCOPTS/64build/GAPGMP/nog\\\r\nmp/GAPTARGET/standard/label/64bit/GAP-git-snapshot/tst/teststandard/primsan.ts\\\r\nt\r\n9058150000              6337        1429254\r\n-------------------------------------------\r\ntotal                   6451        3693479\r\n```\r\nSince there is no name of the test file in the same line with the runtime, it's no longer possible to extract the runtime in the same way (also, I do not understand what's the meaning of the third number which appears in that line). \r\n\r\nOne approach would be to fix this by adding the filename to the line in question. Another could consider going further and providing a way to save, accumulate and compare such data, triggering an alert in case of significant performance regressions. There were some ideas about that in the past. "}}