OpenAI API Instrumentation (e.g. seed, logprobs, echo, an array prompt) - #1353

Open

monotophic wants to merge 11 commits into

JustVugg:devfrom

monotophic:api/server-surfaces

Commits on Sep 15, 2026

feat(api): accept and discard per-request seed (documented no-op)

monotophic
and
claude
committed
35bcbbc
fix(api): defer the Anthropic streaming 200 until the engine accepts the prompt

monotophic
and
claude
committed
8cf2d16
feat(api): serve OpenAI-style logprobs and prompt echo on the glm engine

monotophic
and
claude
committed
e8a0816
feat(api): accept array and token-id prompts on /v1/completions

monotophic
and
claude
committed
3e0b69f
fix(api): fail closed on an unsupported group_score opt-in

monotophic
and
claude
committed
9d85a9f
feat(api): drain group-scoring frames a future engine may emit

monotophic
and
claude
committed
7291390
fix(api): check every server->engine frame write

monotophic
and
claude
committed
39d69b2
fix(api): drop Engine.generate()'s pending-map entry on every exit

monotophic
and
claude
committed
3693607
test(api): cover the token-id prompt budget and the batch's shared slot

monotophic
and
claude
committed
b323297
test(api): pin the committed-stream write-failure path and the deferred Anthropic stream

monotophic
and
claude
committed
5160811
test(api): compare the lm-eval fixture digest on LF-normalised bytes

monotophic
and
claude
committed
2edcea6