Skip to content

Keep browser smoke tests from rewriting tracked screenshots by default #46

Closed

Description

@blackopsrepl

PR #45 exposed a separate browser-test maintenance issue: running make ci-local / the browser smoke path can rewrite tracked screenshot baselines such as screenshots/rail-timeline-narrow.png.

The attempted cleanup in #45 used a pre-push hook to restore screenshots after CI, but the underlying problem should be handled in the browser test workflow instead. Validation commands should not leave tracked screenshot files modified.

Expected direction:

  • Browser smoke tests should write transient screenshots to an untracked temp/artifact path, or compare against baselines without mutating them.
  • Intentional baseline refreshes should use an explicit update command or documented maintainer flow.
  • make ci-local should finish with a clean worktree when there is no intentional visual change.
  • Any fix should avoid Git hooks or post-test commands that reset tracked files behind the contributor's back.

Related: #45

Activity

  1. added a commit that references this issue on May 13, 2026
    9b5495b
  2. blackopsrepl commented on May 13, 2026

    @blackopsrepl
    ContributorAuthor

    Fixed by #47, which moves ordinary browser smoke screenshots to target/browser-smoke/screenshots/ and keeps tracked screenshots/ refreshes behind the explicit make screenshots-update maintainer flow.

    Closing this as resolved. @benabel, please rebase #45 on current main and drop the .pre-commit-config.yaml screenshot cleanup hook now that the browser test workflow fix has landed.

  3. added a commit that references this issue on May 14, 2026
    1a46734
  4. added a commit that references this issue on May 21, 2026
    9c5891f
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions