Repository navigation
test: fail on rejected Prismic requests and keep credentials out of traces - #293
Merged
Merged
Conversation
…traces Playwright's `APIResponse.ok` is a method, so `assert(res.ok)` never failed. A rejected sign-in looped until the test timed out. Traces record request bodies, so setup, teardown and the toolbar tests, which log in to Prismic, are no longer traced. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The toolbar script now loads `shell.html` instead of `iframe.html`. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Nobody uses the CI traces or the uploaded Playwright report. When CI fails, we reproduce the failure locally. Remove the global trace setting, the per-project and per-spec `trace: "off"` opt-outs, and the step that uploads `playwright-report/`. Without traces, the e2e account credentials cannot get into public CI artifacts through a missed per-spec opt-out. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01L1dGD7TcFZH71ay5zFABEv
Member
|
Let's just disable traces on CI altogether. We don't look at them, and if something fails, we can check it locally. Generated by Claude Code |
angeloashmore
approved these changes
Nov 9, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
res.okis a method on Playwright'sAPIResponse, soassert(res.ok)never failed. Nowres.ok().angelo.ashmore+test@prismic.io, then update theE2E_PRISMIC_PASSWORDsecret.Also updates the toolbar test selector: the toolbar now loads
shell.htmlinstead ofiframe.html.Created with Claude Opus 5.5 in Claude Code.
Note
Medium Risk
Changes fix silent test passes on failed API calls and reduce credential leakage in CI, but alter e2e auth assertions and CI debugging artifacts.
Overview
E2E infrastructure now fails when Prismic API calls return non-OK responses by calling Playwright’s
APIResponse.ok()(andstatus()where needed) instead of asserting the truthyokproperty, which never triggered failures. Wroom login also asserts aprismic-authsession cookie after sign-in, and repository teardown tolerates a 404 on the retry delete path when the first attempt returns 500.Credential and CI artifact exposure is reduced by dropping the global
trace: on-first-retrysetting fromplaywright.config.tsand removing the workflow step that uploadedplaywright-report/artifacts. Toolbar coverage is aligned with the current embed by targetingshell.htmlinstead ofiframe.htmlin the iframe locator.Operators should rotate the E2E Prismic account password and refresh
E2E_PRISMIC_PASSWORDif traces may have captured sign-in payloads.Reviewed by Cursor Bugbot for commit 2bcbd37. Bugbot is set up for automated code reviews on this repo. Configure here.