{"action":"created","issue":{"url":"https://api.github.com/repos/JuliaLang/julia/issues/11709","labels_url":"https://api.github.com/repos/JuliaLang/julia/issues/11709/labels{/name}","comments_url":"https://api.github.com/repos/JuliaLang/julia/issues/11709/comments","events_url":"https://api.github.com/repos/JuliaLang/julia/issues/11709/events","html_url":"https://github.com/JuliaLang/julia/issues/11709","id":88241701,"number":11709,"title":"Revive performance regression testing?","user":{"login":"johnmyleswhite","id":22064,"avatar_url":"https://avatars.githubusercontent.com/u/22064?v=3","gravatar_id":"","url":"https://api.github.com/users/johnmyleswhite","html_url":"https://github.com/johnmyleswhite","followers_url":"https://api.github.com/users/johnmyleswhite/followers","following_url":"https://api.github.com/users/johnmyleswhite/following{/other_user}","gists_url":"https://api.github.com/users/johnmyleswhite/gists{/gist_id}","starred_url":"https://api.github.com/users/johnmyleswhite/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/johnmyleswhite/subscriptions","organizations_url":"https://api.github.com/users/johnmyleswhite/orgs","repos_url":"https://api.github.com/users/johnmyleswhite/repos","events_url":"https://api.github.com/users/johnmyleswhite/events{/privacy}","received_events_url":"https://api.github.com/users/johnmyleswhite/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/JuliaLang/julia/labels/test","name":"test","color":"e102d8"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":37,"created_at":"2015-06-14T20:14:34Z","updated_at":"2015-06-17T19:07:44Z","closed_at":null,"body":"As discussed in #11683, it would be great to revive some kind of performance regression testing so that we don't slowly accumulate perf problems.\r\n\r\nIn an ideal world, we'd standardize on a system that non-Base packages could use as well. But for now it would be good to just get Base being tested for perf rigorously again."},"comment":{"url":"https://api.github.com/repos/JuliaLang/julia/issues/comments/112916150","html_url":"https://github.com/JuliaLang/julia/issues/11709#issuecomment-112916150","issue_url":"https://api.github.com/repos/JuliaLang/julia/issues/11709","id":112916150,"user":{"login":"IainNZ","id":692635,"avatar_url":"https://avatars.githubusercontent.com/u/692635?v=3","gravatar_id":"","url":"https://api.github.com/users/IainNZ","html_url":"https://github.com/IainNZ","followers_url":"https://api.github.com/users/IainNZ/followers","following_url":"https://api.github.com/users/IainNZ/following{/other_user}","gists_url":"https://api.github.com/users/IainNZ/gists{/gist_id}","starred_url":"https://api.github.com/users/IainNZ/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/IainNZ/subscriptions","organizations_url":"https://api.github.com/users/IainNZ/orgs","repos_url":"https://api.github.com/users/IainNZ/repos","events_url":"https://api.github.com/users/IainNZ/events{/privacy}","received_events_url":"https://api.github.com/users/IainNZ/received_events","type":"User","site_admin":false},"created_at":"2015-06-17T19:07:44Z","updated_at":"2015-06-17T19:07:44Z","body":"@johnmyleswhite thats an interesting perspective... I guess one thing that is clear is that arithmetic mean isn't inherently wrong without some definition of what wrong (or right) is. I've basically seen and done some playing around myself and found that arithmetic mean did some fairly unintuitive things when the ratios are not uniformly >= or <= 1, and that the geometric mean was a better way to capture it in a single number - I think thats what these papers are getting at. Would be interesting to formalize it though."}}