Skip to content

process(testing): per-project test strategy; affected tests per change, full suite at deploy-ready - #409

Closed
MendixMau wants to merge 1 commit into
masterfrom
feat/test-strategy-per-project
Closed

MendixMau wants to merge 1 commit into
masterfrom
feat/test-strategy-per-project

Conversation

@MendixMau

@MendixMau MendixMau commented Oct 16, 2026 •

Copy link
Copy Markdown
Owner

Superseded: split into three PRs. Please close this one.

The original description follows for reference.


…e, full suite at deploy-ready

Per change the default is now the gate plus the affected unit tests and journeys only. The
full e2e and the full unit suite run at deploy-ready, and each project records its own choice
with the developer in the existing CAC-5 Offer (PROJECT.md "## Test strategy").

- project-bin/affected-tests.sh (new): subjects from exec.sh --subjects, transitive callers
  from one batched SHOW CALLERS OF ... TRANSITIVE call, then the .test.mdl and journey files
  owed at the moment's scope (none / affected / module / full). Prints run lines; never runs
  a model-writing test; says "callers NOT MEASURED" without a model.
- exec.sh: --subjects advisory mode; per-step seconds in the summary and the BUILD-LOG
  detail; the logic lane no longer says the full suite runs at module close.
- testing-shape.md, iterative-build-loop.md, existing-app-change.md, conversion-runbook.md:
  module close runs the module's tests, deploy-ready runs everything. Baseline 75,225 to
  75,221 words.
- checkpoint-build.md: the test strategy table in the Stage 5 Offer.

Field run: a five-app lab project (Mendix 11.15, mxcli v0.26.0), three real change scripts on
a scratch copy: 0 to 1 of 20 journey files selected per change, first call 19 s, later 3 s.
Golden callers output captured from mxcli v0.26.0 (fixtures/affected-tests/CAPTURE.txt).

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@MendixMau

Copy link
Copy Markdown
Owner Author

Split into #413 (step timing), #416 (affected-tests, advisory) and #417 (docs and default shift, held until the test-strategy A/B). Closing this one in favour of those three.

@MendixMau MendixMau closed this Oct 16, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant