Where do our flaky tests come from?

Topic created · 1 Posts · 342 Visualizações

    Flaky (nondeterministic) tests, however, are different. Flaky tests are tests that exhibit both a passing and a failing result with the same code. Given this, a test failure may or may not mean that there’s a new problem. And trying to recreate the failure, by rerunning the test with the same version of code, may or may not result in a passing test. We start viewing these tests as unreliable and eventually they lose their value. If the root cause is nondeterminism in the production code, ignoring the test means ignoring a production bug.

    Leia mais em https://testing.googleblog.com/2017/04/where-do-our-flaky-tests-come-from.html