{"action":"created","issue":{"url":"https://api.github.com/repos/JuliaLang/julia/issues/10952","labels_url":"https://api.github.com/repos/JuliaLang/julia/issues/10952/labels{/name}","comments_url":"https://api.github.com/repos/JuliaLang/julia/issues/10952/comments","events_url":"https://api.github.com/repos/JuliaLang/julia/issues/10952/events","html_url":"https://github.com/JuliaLang/julia/pull/10952","id":70308433,"number":10952,"title":"WIP: Run travis tests under rr","user":{"login":"garrison","id":91987,"avatar_url":"https://avatars.githubusercontent.com/u/91987?v=3","gravatar_id":"","url":"https://api.github.com/users/garrison","html_url":"https://github.com/garrison","followers_url":"https://api.github.com/users/garrison/followers","following_url":"https://api.github.com/users/garrison/following{/other_user}","gists_url":"https://api.github.com/users/garrison/gists{/gist_id}","starred_url":"https://api.github.com/users/garrison/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/garrison/subscriptions","organizations_url":"https://api.github.com/users/garrison/orgs","repos_url":"https://api.github.com/users/garrison/repos","events_url":"https://api.github.com/users/garrison/events{/privacy}","received_events_url":"https://api.github.com/users/garrison/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/JuliaLang/julia/labels/test","name":"test","color":"e102d8"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":27,"created_at":"2015-04-23T05:02:55Z","updated_at":"2015-04-28T15:23:32Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/JuliaLang/julia/pulls/10952","html_url":"https://github.com/JuliaLang/julia/pull/10952","diff_url":"https://github.com/JuliaLang/julia/pull/10952.diff","patch_url":"https://github.com/JuliaLang/julia/pull/10952.patch"},"body":"This is an experiment to see how feasible it is to run tests under [`rr`](http://rr-project.org/), inspired by [discussion here](https://github.com/JuliaLang/julia/pull/10738#issuecomment-95374001)."},"comment":{"url":"https://api.github.com/repos/JuliaLang/julia/issues/comments/97104533","html_url":"https://github.com/JuliaLang/julia/pull/10952#issuecomment-97104533","issue_url":"https://api.github.com/repos/JuliaLang/julia/issues/10952","id":97104533,"user":{"login":"garrison","id":91987,"avatar_url":"https://avatars.githubusercontent.com/u/91987?v=3","gravatar_id":"","url":"https://api.github.com/users/garrison","html_url":"https://github.com/garrison","followers_url":"https://api.github.com/users/garrison/followers","following_url":"https://api.github.com/users/garrison/following{/other_user}","gists_url":"https://api.github.com/users/garrison/gists{/gist_id}","starred_url":"https://api.github.com/users/garrison/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/garrison/subscriptions","organizations_url":"https://api.github.com/users/garrison/orgs","repos_url":"https://api.github.com/users/garrison/repos","events_url":"https://api.github.com/users/garrison/events{/privacy}","received_events_url":"https://api.github.com/users/garrison/received_events","type":"User","site_admin":false},"created_at":"2015-04-28T15:23:32Z","updated_at":"2015-04-28T15:23:32Z","body":"Per @ihnorton's comment and others, it seems that we really want `rr` running on separate infrastructure from our main tests.  The purpose of existing tests is to tell us whether a commit passes all tests.  Since `rr` runs on a single core, doing this for all tests will influence the results and lead to us missing race conditions.\r\n\r\nThe purpose of the `rr` workers, on the other hand, is to have a good log of test failures (and not necessarily be the thing that tells us definitively whether a build is good or bad).  For this reason the behavior of the `rr` build bots should probably be slightly different too. If the `rr` builder is ahead -- i.e. it has built and run the latest commit on master and on each branch until there was success or failure -- we could even have it repeatedly run the test suite on the latest `master` build until it finds a failure or something else is committed, in the hopes of catching an intermittent bug."}}