Skip to content

Add Judge Trudy verdicts - #47

Merged
caitlynmayers merged 11 commits into
mainfrom
judge-trudy-verdicts
Oct 29, 2026
Merged

caitlynmayers merged 11 commits into
mainfrom
judge-trudy-verdicts

Conversation

@caitlynmayers

@caitlynmayers caitlynmayers commented Oct 28, 2026 •

Copy link
Copy Markdown
Collaborator

Add a home for Judge Trudy verdicts: Design Infra's rulings on how Wonder Blocks is meant to be used, and the follow-up work they create. The prototype builder skill's audit reads them, so every prototype gets the same rulings instead of each person's copy of the skill.

Starts with the four rulings from the practice display settings prototype:

  • Ruling 1: layout through a component's documented styles prop (position, margins, size, alignment) isn't drift; visual overrides are. No guideline yet.
  • Ruling 2: the practice content panel is a Wonder Blocks gap. It needs scaffolding components, not a Card swap. Links to Surfaces and elevations.
  • Ruling 3: the drawing toolbar's close button attaching to its tool group isn't drift. The pattern is used only there. It also flags a separate accessibility issue with the button's name and aria-expanded.
  • Ruling 4: the drawing toolbar's native <input type="color"> isn't drift. Scoped to that one instance, not a general rule about native controls.

Discussion: #design-infra thread, https://khanacademy.slack.com/archives/C0BHXK7RFFE/p1793208713508319

Issue: none

The rulings also render as a Verdicts docs page (__docs__/verdicts.mdx), generated from the two JSON
files by pnpm verdicts:page. pnpm verdicts:check runs in the Build check workflow and fails if the page
is out of date with them. The page is tagged !dev to keep it out of the left nav — note that Storybook
10.3.5 still lists it; it's reachable by URL and over the MCP docs tools either way.

Test plan:

  • Open verdicts/verdicts.json and check the four entries match the rulings in the Slack thread.
  • Confirm a change under verdicts/ requests review from Design Infra.

🤖 Generated with Claude Code

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@caitlynmayers caitlynmayers self-assigned this Oct 28, 2026
@caitlynmayers
caitlynmayers requested a review from a team as a code owner October 28, 2026 20:57
@caitlynmayers
caitlynmayers requested a review from a team October 28, 2026 20:58
@github-actions

github-actions Bot commented Oct 28, 2026 •

Copy link
Copy Markdown

A new build was pushed to Chromatic! 🚀

https://6a5008743971119020a6233b-oljvfdlvrt.chromatic.com/

caitlynmayers and others added 10 commits October 28, 2026 17:06
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Adds scripts/build-verdicts-page.mjs, which writes __docs__/verdicts.mdx
with every ruling as literal markdown and the two JSON files in fenced
blocks, so tools reading the page over MCP get the rulings as text and
can parse the raw data.

pnpm verdicts:check runs in the Build check workflow and fails if the
page is out of date with the JSON.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
The page is reference data for the prototype builder's audit, not a
guideline, so it shouldn't sit in the left nav beside them.

Note: this drops the `dev` tag from the index as intended, but Storybook
10.3.5 still lists the entry in the sidebar. The page stays reachable by
URL and over the MCP docs tools either way.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Regenerates __docs__/verdicts.mdx so pnpm verdicts:check stays green.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Adds verdicts/evaluations/ with the scaffolding-surfaces evaluation, and
links it from Ruling 2 and Follow-up 2. Regenerates the docs page.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
The evaluation block reached only the page's raw JSON, so a reader saw
no sign that Ruling 2 had been scored. Renders outcome, score and path
on the ruling and on its follow-up.

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
@caitlynmayers
caitlynmayers merged commit 7b2a06e into main Oct 29, 2026
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants