Skip to content

Ratchet Studio Pro checker warnings (and Best Practice Recommender if headless) #351

Open

Description

@MendixMau

Source: external reviewer feedback (2026-10-14).

Now: we ratchet mxcli lint findings. mx check blocks only on errors; its warnings are not ratcheted.

Proposal: capture the mx check warning count per code into a baseline, and fail on a rise (same model as lint-gate). Probe whether the Best Practice Recommender can run headless; if it can, ratchet it too.

Value: medium-high.


Generated by Claude Code

Activity

  1. MendixMau commented on Oct 14, 2026

    @MendixMau
    OwnerAuthor

    Gain test case

    Metric: new Studio Pro checker warnings that reach the gate unnoticed.

    • Bench: captured mx check output before and after a script that adds a known warning (e.g. an unused variable, an empty validation message).
    • Before: gate passes (0% caught). Target: gate fails on any rise per warning code (100%), and passes when counts are equal or lower.
    • Field check: warning count trend across one full build; target is monotone non-increasing unless a human re-baselines.

    Generated by Claude Code

  2. MendixMau commented on Oct 14, 2026

    @MendixMau
    OwnerAuthor

    Tier: every exec (seconds budget). The Studio Pro warning ratchet runs on every exec, beside the lint ratchet. This applies per skills/testing-shape.md §3 "Check tiers" once #364 lands. Until this issue is built, the table marks it as "(planned: #351)".


    Generated by Claude Code

  3. MendixMau commented on Oct 14, 2026

    @MendixMau
    OwnerAuthor

    Correction to my comment above: review of #364 renamed "tiers" to check moments, so that it does not collide with testing-shape.md §1's "No tiers". This issue sits in the every exec moment, which has a budget of about 1 minute because mxbuild dominates it. The placement itself is unchanged.


    Generated by Claude Code

  4. added a commit that references this issue on Oct 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions