Skip to content

feat(aio): align AI observability signal source - #75594

Merged
gantoine merged 1 commit into
masterfrom
feat/aio-evaluation-report-signal-source
Jul 30, 2026
Merged

feat(aio): align AI observability signal source#75594
gantoine merged 1 commit into
masterfrom
feat/aio-evaluation-report-signal-source

Conversation

@Radu-Raicea

Copy link
Copy Markdown
Member

Problem

The web app AI observability source should match the Self-driving inbox source in PostHog/code#4006. Both surfaces need to describe the same setup and toggle evaluation report signals.

Changes

  • Align the AI observability source description and evaluations docs link with PostHog Code.
  • Cover the web toggle contract so it creates an llm_analytics source config with the evaluation_report source type.

No screenshot is included because the card layout is unchanged. This only updates its copy and link.

How did you test this code?

  • Automated logic coverage for the regression where the web toggle could create a different source type from PostHog Code.
  • Frontend lint, formatting, and CI preflight passed.
  • The full TypeScript check was run but is blocked by existing SelectTriggerIcon export errors in unchanged error tracking files.

👉 Stay up-to-date with PostHog coding conventions for a smoother review.

Automatic notifications

  • Publish to changelog?
  • Alert Sales and Marketing teams?

Docs update

No docs change is needed. The source card now points to the existing AI evaluations documentation.

🤖 Agent context

Autonomy: Human-driven (agent-assisted)

Codex Desktop prepared this change in the current task at the direction of Radu-Raicea. Skills used: /github, /writing-user-facing-copy, /writing-tests, /adopting-generated-api-types, /posthog-efficient-validation, /running-ci-preflight, and /create-pr.

Fresh master already used evaluation_report for the web toggle and backend gate. The change therefore aligns the visible source-card contract and adds focused regression coverage without changing the backend API.

@Radu-Raicea Radu-Raicea self-assigned this Jul 30, 2026
@trunk-io

trunk-io Bot commented Jul 30, 2026

Copy link
Copy Markdown

😎 Merged manually by @gantoine - details.

@Radu-Raicea
Radu-Raicea marked this pull request as ready for review July 30, 2026 15:16
@Radu-Raicea Radu-Raicea added the stamphog Request AI approval (no full review) label Jul 30, 2026
@github-actions

github-actions Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

🦔 Hogbox preview · ✅ ready

▶ Open the preview

🔑 Login test@posthog.com / 12345678 (demo data)
🧩 Running this PR's backend and frontend, on the PostHog :master base
🔗 Link stable across rebuilds — a re-push swaps the box underneath, the URL stays
🔒 Access tailnet only (PostHog VPN)
🛠️ Admin inspect & debug state in hogland
💤 Idle sleeps after ~30 min idle (snapshot to S3, zero node cost) and wakes on your next visit in ~30s, behind a brief "waking up" screen

commit 68a9471 · box box-782a159fe7a5 · ready in 852s (push → usable) · build log · rebuilds on every push, torn down on close

@pr-assigner-resolver-posthog
pr-assigner-resolver-posthog Bot requested a review from a team July 30, 2026 15:17
@greptile-apps

greptile-apps Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

Reviews (1): Last reviewed commit: "feat(aio): align AI observability signal..." | Re-trigger Greptile

@stamphog stamphog Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Small, low-risk frontend copy change (description/docs link) plus a matching regression test for the toggle's source-config contract; no risky-territory surface touched and diff matches the description.

  • Author wrote 0% of the modified lines and has 6 merged PRs in these paths (familiarity MODERATE).
  • 👍 on the PR from greptile-apps[bot], hex-security-app[bot].
Gate mechanics and policy version
Gate Result
prerequisites all clear
deny-list no deny categories matched
size 6L, 1F substantive, 30L/2F incl. docs/generated/snapshots — within ceiling
tier T1-agent / T1b-small (30L, 2F, single-area, feat)
stamphog 2.0.0b3 .stamphog/policy.yml @ 8fa3274 · reviewed head 68a9471

@github-actions

github-actions Bot commented Jul 30, 2026

Copy link
Copy Markdown
Contributor

🤖 CI report

⚠️ Bundle size — 🔺 +12 B (+0.0%)

Uncompressed size of every built .js bundle, compared against the base branch.

Total: 65.29 MiB · 🔺 +12 B (+0.0%)

No file changed by more than 1000 B.

Posted automatically by build-bundle-size-report · uncompressed bytes from dist-report

Eager graph — within budget

How much code each root ships on the eager path — downloaded and parsed before the surface is interactive. Measured from the esbuild output chunks (post-tree-shake, static imports only); lazy import() / React.lazy chunks are not counted.

Root Eager (shipped) Δ vs base Budget
entry (logged-out pages, app bootstrap)
src/index.tsx
1.24 MiB · 22 files no change ███░░░░░░░ 27.6% of 4.51 MiB
authenticated shell (every logged-in page)
src/scenes/AuthenticatedShell.tsx
8.11 MiB · 3,020 files no change ████████░░ 83.5% of 9.71 MiB

🟢 node_modules/monaco-editor/ stays out of src/index.tsx
🟢 src/lib/components/ActivityLog/describers stays out of src/index.tsx
🟢 [object Object] stays out of src/index.tsx
🟢 [object Object] stays out of src/index.tsx
🟢 node_modules/monaco-editor/ stays out of src/scenes/AuthenticatedShell.tsx
🟢 src/lib/components/ActivityLog/describers stays out of src/scenes/AuthenticatedShell.tsx
🟢 [object Object] stays out of src/scenes/AuthenticatedShell.tsx
🟢 [object Object] stays out of src/scenes/AuthenticatedShell.tsx

Largest files eagerly shipped from src/index.tsx
Size File
126.8 KiB ../node_modules/.pnpm/react-dom@18.3.1_react@18.3.1/node_modules/react-dom/cjs/react-dom.production.min.js
24.6 KiB ../node_modules/.pnpm/buffer@6.0.3/node_modules/buffer/index.js
6.3 KiB ../node_modules/.pnpm/react@18.3.1/node_modules/react/cjs/react.production.min.js
4.5 KiB ../node_modules/.pnpm/@jspm+core@2.1.0/node_modules/@jspm/core/nodelibs/browser/process.js
3.9 KiB ../node_modules/.pnpm/scheduler@0.23.2/node_modules/scheduler/cjs/scheduler.production.min.js
1.4 KiB ../node_modules/.pnpm/base64-js@1.5.1/node_modules/base64-js/index.js
1.3 KiB src/RootErrorBoundary.tsx
912 B ../node_modules/.pnpm/ieee754@1.2.1/node_modules/ieee754/index.js
789 B src/scenes/ChunkLoadErrorBoundary.tsx
762 B src/index.tsx
Largest files eagerly shipped from src/scenes/AuthenticatedShell.tsx
Size File
285.3 KiB ../node_modules/.pnpm/posthog-js@1.408.2/node_modules/posthog-js/dist/rrweb.js
267.7 KiB ../node_modules/.pnpm/@posthog+icons@0.38.0_react-dom@18.3.1_react@18.3.1__react@18.3.1/node_modules/@posthog/icons/dist/posthog-icons.es.js
235.5 KiB src/taxonomy/core-filter-definitions-by-group.json
226.5 KiB ../node_modules/.pnpm/posthog-js@1.408.2/node_modules/posthog-js/dist/module.js
154.3 KiB ../node_modules/.pnpm/re2js@0.4.1/node_modules/re2js/build/index.esm.js
126.8 KiB ../node_modules/.pnpm/react-dom@18.3.1_react@18.3.1/node_modules/react-dom/cjs/react-dom.production.min.js
105.2 KiB src/lib/api.ts
94.7 KiB ../packages/quill/packages/quill/dist/index.js
93.3 KiB ../node_modules/.pnpm/prosemirror-view@1.40.1/node_modules/prosemirror-view/dist/index.js
90.6 KiB ../node_modules/.pnpm/@tiptap+core@3.20.6_@tiptap+pm@3.20.6/node_modules/@tiptap/core/dist/index.js

Posted automatically by check-eager-graph · sizes are eager output bytes (shipped, post-tree-shake) from the esbuild metafile · part of #32479

Toolbar bundle — eager 2.18 MiB within budget

What the toolbar ships to customer pages, measured from the esbuild output (minified, post-tree-shake). The eager set is the entry plus everything statically imported from it — fetched before any feature runs; deferred chunks load lazily. The eager guardrail is 5.72 MiB. Each output file must also stay below 10 MB, where CloudFront stops compressing it. The module boundary is enforced separately by check-toolbar-graph.

Metric Size Δ vs base Budget
Eager (shipped)
entry + static imports
2.18 MiB · 17 files no change ████░░░░░░ 38.2% of 5.72 MiB
Deferred (lazy) 2.07 MiB · 33 files no change n/a — loads on demand
Loader dist/toolbar.js 1.1 KiB no change █░░░░░░░░░ 5.8% of 19.5 KiB
Largest eagerly-shipped chunks
Size File
717.7 KiB dist/toolbar/toolbar-app-UQPPHLFT.css
546.1 KiB dist/toolbar/chunk-chunk-MNXC4WAP.js
484.4 KiB dist/toolbar/chunk-chunk-F4F6H6OV.js
133.6 KiB dist/toolbar/chunk-chunk-Q5OQ5H3C.js
131.8 KiB dist/toolbar/chunk-chunk-T5KY5WYR.js
71.0 KiB dist/toolbar/toolbar-app-CJCB4VSF.js
69.0 KiB dist/toolbar/chunk-chunk-27JL52RE.js
35.6 KiB dist/toolbar/chunk-chunk-WZNJIMFN.js
20.9 KiB dist/toolbar/chunk-chunk-EATXZQER.js
12.2 KiB dist/toolbar/chunk-chunk-PIK3PADE.js

Posted automatically by check-toolbar-size · sizes are toolbar output bytes (shipped, post-tree-shake) from the esbuild metafile

Dist folder size — 🔺 +23 B (+0.0%)

Total size of the built frontend/dist folder (all assets), compared against the base branch.

Total: 1368.96 MiB · 🔺 +23 B (+0.0%)

Playwright — all passed

All tests passed.

View test results →

@gantoine
gantoine merged commit bdb8f15 into master Jul 30, 2026
298 of 312 checks passed
@gantoine
gantoine deleted the feat/aio-evaluation-report-signal-source branch July 30, 2026 16:57
@deployment-status-posthog

deployment-status-posthog Bot commented Jul 30, 2026

Copy link
Copy Markdown

Deploy status

Environment Status Deployed At Workflow
dev ✅ Deployed 2026-07-30 17:47 UTC Run
prod-us ✅ Deployed 2026-07-30 18:06 UTC Run
prod-eu ✅ Deployed 2026-07-30 18:05 UTC Run

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

stamphog Request AI approval (no full review)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants