ci: cover template overlays in CLI install/build e2e

[devin-ai-integration]

What

CLI End to End only ever scaffolded the default overlay, so overlay dependency sets (LangGraph, Vercel AI SDK, Vercel Eve) and their lockfile handling in create-app were never installed or built in CI. This adds overlay coverage without multiplying the existing 26-job OS × package-manager matrix by 4.

The new jobs immediately caught two real problems, fixed here:

1. openui-cloud's vercel-eve overlay failed next build — its tsconfig was missing the allowImportingTsExtensions / exclude: ["agent"] that the self-hosted overlay has, so agent/tools/get_weather.ts (which imports ../../src/lib/tools/get-weather.ts by design, for Eve's ESM module map) tripped TS5097.
2. The e2e jobs were not actually testing the checkout's templates: checkoutSource/fetchSourceFile always fetch thesysdev/openui@main, so a PR touching templates/** ran its CLI against main's templates.

Changes

• Extracted the scaffold → verify-package-manager → build steps into a composite action .github/actions/cli-scaffold-e2e, parameterized by template, backend-framework, node-version, package-manager, package-manager-version. The CLI invocation now always passes --backend-framework.
• New cli-e2e-overlays job: {openui-cloud, openui-self-hosted} × {langgraph, vercel-ai-sdk, vercel-eve} × {npm, pnpm} = 12 jobs on ubuntu / Node 24 / package-manager major 11. Overlays only change dependencies and app code, so the OS and package-manager-major spread stays on the default overlay (cli-e2e, unchanged in coverage).
• CLI: OPENUI_SOURCE_DIR env var makes checkoutSource/fetchSourceFile read templates and templates.json from a local source checkout instead of GitHub main; the composite action sets it to github.workspace so the jobs test the commit under test. Unset (i.e. for users) behavior is unchanged.
• templates/openui-cloud/overlays/vercel-eve/tsconfig.json: added allowImportingTsExtensions and excluded agent, matching the self-hosted overlay.
• Workflow paths filters now include the composite action.

Note the composite action forces shell: bash for the run steps (composite steps must declare a shell); on the Windows jobs those steps previously defaulted to pwsh.

Not touched: cli-template-package-managers.yml, which diffs resolved deps of the template directories themselves — overlays are not standalone installable directories, so that one has no overlay analogue.

Test Plan

• actionlint clean
• Locally packed the CLI and ran openui create --template openui-cloud --backend-framework vercel-eve with OPENUI_SOURCE_DIR pointing at the checkout: scaffold + npm install + next build all pass with the tsconfig fix (this also exercises the new local-source path)
• The workflow's own paths filter makes this PR run the full matrix, including the 12 new overlay jobs

Checklist

• I linked a related issue, if applicable
• I updated docs/README when needed (no doc surface changed)
• I considered backwards compatibility

Link to Devin session: https://app.devin.ai/sessions/c594d3982aa447a39e419b32bdea004a
Open in Devin Desktop: https://app.devin.ai/desktop/session/c594d3982aa447a39e419b32bdea004a?variant=devin

[devin-ai-integration]

🤖 Devin AI Engineer

I'll be helping with this pull request! Here's what you should know:

✅ I will automatically:

• Address comments on this PR. Add '(aside)' to your comment to have me ignore it.
• Look at CI failures and help fix them

Note: I can only respond to comments from users who have write access to this repository.

⚙️ Control Options:

• Disable automatic comment, CI, and merge conflict monitoring

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Actions	Updated
openui-docs	Ready	Preview	Sep 10, 2026 10:12am UTC