Skip to content

Commit e110211

Browse files
committed
Record live CI publication and paired 7B diagnostic evidence
1 parent 501e35d commit e110211

4 files changed

Lines changed: 77 additions & 2 deletions

File tree

‎docs/Development/AdaptiveSpeculationEvidence-2026-10-05.md‎

Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -141,3 +141,36 @@ Initial sampling, draft prefill and catch-up after plain rounds can cost more
141141
than speculation saves. No speed improvement is guaranteed. No NVIDIA run,
142142
MTP-family support, broad corpus qualification, statistical paired speed
143143
claim, commit/push or deployment is established by this checkpoint.
144+
145+
## Additional 7B diagnostic and hosted delivery
146+
147+
Executable revision `501e35d` is pushed; full hosted verification and public
148+
JSON publication succeed (see `CiPublicationAudit-2026-10-05.md`). Hosted
149+
Metal skips are real: Apple's paravirtual device reports GPU family zero.
150+
Local real Metal coverage above is separate from that hosted evidence.
151+
152+
An additional existing Qwen2.5-7B-Instruct-1M Q8_0 source was losslessly
153+
prepared with the C# compiler, source SHA-256
154+
`d81ca8ca04442ed5ff7d036fa546183170b8269281380bed977431a5449c84b2` and package
155+
identity `9c1e2aca1f23bcc51f06802cac5e9e25e2835e0f9a6988faf92971a2c3986a16`
156+
(the identity is not a whole-file hash). External draft: prepared 0.5B Q8_0,
157+
without layer drop. Metal/f16 KV, eight threads, context 512, the same
158+
37-token chat prompt as the earlier 7B diagnostic, and 256 generated tokens.
159+
One warm-up per mode and three alternating measured fresh-process pairs.
160+
Final compiler/helper/12 generation processes and the C# reporter exit 0;
161+
every fixed and auto output has all 256 tokens in the same order as its paired
162+
dense output. Raw prompt, tokens, JSON/stderr, C# reporter, orchestration,
163+
summary and fuller limits are under `artifacts/adaptive-speculation/seven-billion/`.
164+
165+
| Mode | Median generation wall ms | Median reported decode tokens/s |
166+
|---|---:|---:|
167+
| Dense | 13085.350 | 20.313 |
168+
| Fixed 3 | 10466.081 | 26.105 |
169+
| Auto cap 3 | 12371.546 | 24.239 |
170+
171+
Fixed 3 remains fastest here, and remains the default. Adaptive choices vary
172+
by round, including zero in the third. Other user-owned CPU work exists on
173+
the shared host; identical load/thermal conditions are not established.
174+
Only three pairs on one prompt/model pair, with no semantic answer-quality
175+
or statistical speedup verdict. This does not close `TASK-SPC-005` or add
176+
these local diagnostic rows to the public hosted benchmark stream.

‎docs/Development/CiPublicationAudit-2026-10-05.md‎

Lines changed: 33 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -79,3 +79,36 @@ unsafe content injection, schema or data ownership change. Pinned Actions,
7979
run/attempt freshness, hash validation and bounded root-member extraction stay
8080
in place. New hosted completion and public source-revision confirmation are
8181
required before this task is marked verified.
82+
83+
## Delivered executable/workflow revision `501e35d`
84+
85+
[verify #28](https://github.com/managedcode/Synapse/actions/runs/37290201607),
86+
[performance #16](https://github.com/managedcode/Synapse/actions/runs/37290201688)
87+
and the final [Pages deployment](https://github.com/managedcode/Synapse/actions/runs/37293092158)
88+
all succeed. .NET, Rust checks and JSON publication succeed on every runner.
89+
90+
| .NET runner | Total | Passed | Failed | Skipped |
91+
|---|---:|---:|---:|---:|
92+
| osx-arm64 | 577 | 530 | 0 | 47 |
93+
| linux-x64 | 577 | 529 | 0 | 48 |
94+
| win-x64 | 577 | 529 | 0 | 48 |
95+
96+
The new performance report contains 22/22 expected artifacts, no missing or
97+
invalid artifacts, and 124 rows: 12 matched and 112 unreviewed variants.
98+
The canonical HTTPS JSON equals the uploaded Pages artifact byte-independent
99+
JSON projection exactly. Its generation time is
100+
`2026-10-05T09:56:20.2981639+00:00`; verification and performance both retain
101+
source SHA `501e35dbeab34468205f3e5f34679daa050f9c09`. Every original benchmark
102+
row field/value is unchanged by site publication (optional model enrichment
103+
is excluded from that equality comparison). No missing test artifacts.
104+
The live browser renders these new counts, scopes, run numbers and SHA.
105+
106+
The performance-triggered publication initially kept the still-running
107+
verification stream's previous completed SHA, explicitly shown separately.
108+
Verification completion automatically caused a second publication with both
109+
new streams. Its deploy job queued without an allocated runner or pending
110+
approval, then completed successfully; it was not cancelled or bypassed.
111+
The red/green source regression checks failure conditions; no hosted failure
112+
or timeout branch was deliberately fault-injected. Raw final JSON, producer
113+
artifacts, Pages artifact and watch logs remain in the ignored audit directory.
114+
This post-delivery record changes documentation only.

‎synapse.plan.md‎

Lines changed: 6 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,9 @@
55
- [x] Inspect hosted runs, actual test JSON and the live metrics endpoint.
66
- [x] Red contract test, independent Rust checks and bounded .NET step timeout.
77
- [x] Website 25/25, format/build and workflow lint; preserve actual skips.
8-
- [ ] New hosted delivery evidence (see `website.plan.md`).
8+
- [x] Hosted `verify` 37290201607, performance 37290201688 and Pages
9+
37293092158 succeed for executable/workflow revision `501e35d`; canonical
10+
public JSON and rendered counts match the uploaded artifact exactly.
911

1012
## 2026-10-05 measured speculative depth (`TASK-SPC-005`)
1113

@@ -15,6 +17,9 @@
1517
- [x] Format/build/analyzers, 18 focused tests, coverage, Rust and manual
1618
security/architecture review. Full .NET gate remains unverified: the local
1719
35-minute run was stopped after a reproduced evaluation child timeout.
20+
Subsequent hosted full suites succeed: 577 discovered tests per OS, zero
21+
failures, 47/48 genuine skips; this does not resolve the local timeout or
22+
confer unavailable GPU qualification.
1823
- [ ] Paired real-model speed/quality qualification including short requests,
1924
warm-up and drift; broader runtime and benchmark tasks stay open.
2025

‎website.plan.md‎

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -52,4 +52,8 @@ This does not close the statistical benchmark or broader runtime plans.
5252
independent of earlier failures after toolchain installation.
5353
- [x] Focused Website 25/25, format/build/workflow lint and evidence review;
5454
`docs/Development/CiPublicationAudit-2026-10-05.md` records exact scope.
55-
- [ ] Deliver the workflow and confirm a new hosted verification/publication.
55+
- [x] Deliver the workflow at `501e35d` and confirm hosted verification,
56+
performance JSON and Pages; the canonical endpoint and browser display the
57+
exact new artifact, including 577 tests per OS and 124 benchmark rows.
58+
Failure conditions have a red/green source contract; hosted failure/timeout
59+
branches were not deliberately fault-injected. Broader qualification stays open.

0 commit comments

Comments
 (0)