Skip to content

Commit 29ab55c

Browse files
docs: update quarantine retry clarification (#15)
1 parent d4b0b5d commit 29ab55c

2 files changed

Lines changed: 7 additions & 5 deletions

File tree

‎src/content/docs/explanation/dashboard-analytics.mdx‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -108,7 +108,7 @@ A suite can pass even when it contains failed quarantined tests. Quarantine norm
108108

109109
Quarantined tests have a **Quarantined** badge in test run tables and on the test run page. Select the badge to view the rule that applied to that run. The association remains visible after the rule expires or is deactivated.
110110

111-
For example, `testRun.outcome = fail` still includes quarantined failures. When investigating a quarantined test, use its individual outcomes and retry history to judge whether it has recovered; a passing suite alone does not show that the test is healthy.
111+
For example, `testRun.outcome = fail` still includes quarantined failures. Quarantined tests run once without retries, so use their outcomes across subsequent suite runs to judge whether they have recovered; a passing suite alone does not show that a test is healthy.
112112

113113
See [Quarantine tests](/docs/guides/quarantine-tests) to create, expire, or deactivate rules and understand which failures still block a suite.
114114

‎src/content/docs/guides/quarantine-tests.mdx‎

Lines changed: 6 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -13,7 +13,8 @@ import QuarantineSuiteResults from "../../../assets/quarantine-suite-results.png
1313

1414
Quarantine lets you keep selected tests running while you investigate a known
1515
failure or flaky test. When a quarantined test fails, the suite does not fail.
16-
Endform still records their actual results, retries, and metrics.
16+
Quarantined tests run once without retries. Endform still records their actual
17+
results and metrics.
1718

1819
Use a quarantine rule when you want to keep collecting evidence while allowing
1920
the rest of your suite to determine whether CI passes. Tests still execute and
@@ -116,10 +117,11 @@ quarantined.
116117

117118
## What quarantine changes
118119

119-
Quarantine changes whether a test failure blocks the suite. It does not change
120-
how the test executes:
120+
Quarantine changes retry behavior and whether a test failure blocks the suite:
121121

122-
- Configured retries still run, including immediate and isolated retries.
122+
- Quarantined tests run once and are not retried, even when the project has
123+
retries configured. This applies to both immediate and isolated retry
124+
strategies. Tests outside quarantine keep their configured retries.
123125
- Quarantined test failures do not count toward `maxFailures`.
124126
- Actual test outcomes and metrics remain in Endform's history, so you can see
125127
whether the test is recovering.

0 commit comments

Comments
 (0)