While smoke-testing a timeline fix in channel streaming-message-overlap, desktop_inspect in accessibility mode failed repeatedly on a Google Chrome window (window 474, title "Ace") that pixels mode captured fine:
DESKTOP_ERROR: The desktop observation provider returned inconsistent response evidence: window-context window title..
At the time (before #156), without an action snapshot the agent could not click into the app, so the smoke test moved to a Playwright-driven Chrome for Testing outside Ace's tools.
Status (Oct 6)
The Accessibility-mode title mismatch is not fixed; it reproduced again on Oct 6 (details). #156 mitigates it for pointer input: pixel inspection now returns a single-use snapshot that authorizes exact-window point clicks, scrolls and drags. Element-based actions, text selection and insertion still need a working Accessibility snapshot.
Part of #8.
While smoke-testing a timeline fix in channel streaming-message-overlap,
desktop_inspectin accessibility mode failed repeatedly on a Google Chrome window (window 474, title "Ace") that pixels mode captured fine:At the time (before #156), without an action snapshot the agent could not click into the app, so the smoke test moved to a Playwright-driven Chrome for Testing outside Ace's tools.
Status (Oct 6)
The Accessibility-mode title mismatch is not fixed; it reproduced again on Oct 6 (details). #156 mitigates it for pointer input: pixel inspection now returns a single-use snapshot that authorizes exact-window point clicks, scrolls and drags. Element-based actions, text selection and insertion still need a working Accessibility snapshot.
Part of #8.