{"action":"created","issue":{"url":"https://api.github.com/repos/rust-lang/rust/issues/11010","labels_url":"https://api.github.com/repos/rust-lang/rust/issues/11010/labels{/name}","comments_url":"https://api.github.com/repos/rust-lang/rust/issues/11010/comments","events_url":"https://api.github.com/repos/rust-lang/rust/issues/11010/events","html_url":"https://github.com/rust-lang/rust/issues/11010","id":24387846,"number":11010,"title":"The benchmark harness runs a minimum of 300 iterations.","user":{"login":"huonw","id":1203825,"avatar_url":"https://avatars.githubusercontent.com/u/1203825?v=3","gravatar_id":"","url":"https://api.github.com/users/huonw","html_url":"https://github.com/huonw","followers_url":"https://api.github.com/users/huonw/followers","following_url":"https://api.github.com/users/huonw/following{/other_user}","gists_url":"https://api.github.com/users/huonw/gists{/gist_id}","starred_url":"https://api.github.com/users/huonw/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/huonw/subscriptions","organizations_url":"https://api.github.com/users/huonw/orgs","repos_url":"https://api.github.com/users/huonw/repos","events_url":"https://api.github.com/users/huonw/events{/privacy}","received_events_url":"https://api.github.com/users/huonw/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/rust-lang/rust/labels/A-benchmarks","name":"A-benchmarks","color":"d7e102"},{"url":"https://api.github.com/repos/rust-lang/rust/labels/A-libs","name":"A-libs","color":"d7e102"},{"url":"https://api.github.com/repos/rust-lang/rust/labels/I-enhancement","name":"I-enhancement","color":"e10c02"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2013-12-16T23:11:17Z","updated_at":"2015-10-26T21:34:48Z","closed_at":null,"body":"After the change to handle benches taking longer than 1 ms, the test runner will run a minimum of 50 + 5 * 50 iterations of the piece of code of interest. This should probably scale back for very slow functions (at the cost of statistical accuracy)."},"comment":{"url":"https://api.github.com/repos/rust-lang/rust/issues/comments/151291316","html_url":"https://github.com/rust-lang/rust/issues/11010#issuecomment-151291316","issue_url":"https://api.github.com/repos/rust-lang/rust/issues/11010","id":151291316,"user":{"login":"briansmith","id":16816,"avatar_url":"https://avatars.githubusercontent.com/u/16816?v=3","gravatar_id":"","url":"https://api.github.com/users/briansmith","html_url":"https://github.com/briansmith","followers_url":"https://api.github.com/users/briansmith/followers","following_url":"https://api.github.com/users/briansmith/following{/other_user}","gists_url":"https://api.github.com/users/briansmith/gists{/gist_id}","starred_url":"https://api.github.com/users/briansmith/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/briansmith/subscriptions","organizations_url":"https://api.github.com/users/briansmith/orgs","repos_url":"https://api.github.com/users/briansmith/repos","events_url":"https://api.github.com/users/briansmith/events{/privacy}","received_events_url":"https://api.github.com/users/briansmith/received_events","type":"User","site_admin":false},"created_at":"2015-10-26T21:34:48Z","updated_at":"2015-10-26T21:34:48Z","body":"This affects [crypto-bench](https://github.com/briansmith/crypto-bench), in particular the PBKDF2 benchmarks. 300 seems like an arbitrary number, so it would be good to at least ensure that the minimum is based on some science."}}