[TRTLLM-17269][refactor] Add per-dialect error renderers in serve/exception_handling by JunyiXu-nv · Pull Request #21566 · NVIDIA/TensorRT-LLM

[TRTLLM-17261][test] Add route, middleware-order and shim-identity snapshots and a CPU test seam for trtllm-serve

JunyiXu-nv

committed

b291cca

[TRTLLM-17261][test] Record the trtllm-serve route reference and test baselines at the merge base

JunyiXu-nv

committed

c9311ab

[TRTLLM-17261][test] Cover the attached-frontend route registration in the snapshot matrix

JunyiXu-nv

committed

81b0350

[None][test] Address review of the serve snapshot and layering tests

JunyiXu-nv

committed

2eb184a

[TRTLLM-17261][test] Refresh the serve route reference and baselines on the current main

JunyiXu-nv

committed

5138e15

[None][test] Make the route snapshot and the object.new ratchet fail on silent regressions

JunyiXu-nv

committed

045a69e

[TRTLLM-17262][refactor] Shared middleware package for the aggregated and disaggregated servers

JunyiXu-nv

committed

1a3a615

[TRTLLM-17262][refactor] ServerArrivalTimeMiddleware keeps an existing request state

JunyiXu-nv

committed

a0aa0df

[TRTLLM-17261][refactor] Move the msgpack route classes to tensorrt_llm/serve/_base/msgspec_route.py

JunyiXu-nv

committed

68344ed

[TRTLLM-17261][refactor] Add the trtllm-serve router skeleton and serve the system endpoints through it

JunyiXu-nv

committed

9f4a48e

[TRTLLM-17261][infra] Multi-GPU triggers and type checking for the new serve packages

JunyiXu-nv

committed

caf3a29

[TRTLLM-17261][test] Register the system router in the multi-frontend tests that build routes by hand

JunyiXu-nv

committed

4a6325d

[TRTLLM-17261][test] Match a request instead of reading route paths in the OpenEngine metrics test

JunyiXu-nv

committed

7e29509

[TRTLLM-17261][test] Classify endpoint-package imports by the imported name

JunyiXu-nv

committed

d3aacdd

[TRTLLM-17263][test] Pin the chat completion handler's HTTP answers before splitting it

JunyiXu-nv

committed

543322f

[TRTLLM-17263][refactor] Move the chat SSE generator to tensorrt_llm/serve/_base/sse.py

JunyiXu-nv

committed

6174ee4

[TRTLLM-17263][refactor] Split openai_chat into a typed create_chat_completion and an HTTP wrapper

JunyiXu-nv

committed

bd6b3d7

[TRTLLM-17263][infra] Type-check tensorrt_llm/serve/_base/errors.py

JunyiXu-nv

committed

936cc54

[TRTLLM-17263][test] Stub the chat response as a ChatCompletionResponse in the multimodal prompt test

JunyiXu-nv

committed

974e4bd

[TRTLLM-17263][test] Pin that an unencodable chat response is answered 400 without a traceback

JunyiXu-nv

committed

d8c56b5

[TRTLLM-17269][chore] Merge the router skeleton branch into the middleware package branch as the base for the shared app assembly

JunyiXu-nv

committed

bbea912

[TRTLLM-17269][refactor] Add build_http_app and serve_uvicorn, the shared assembly of the trtllm-serve apps

JunyiXu-nv

committed

633a332

[TRTLLM-17269][refactor] Build the aggregated and disaggregated trtllm-serve apps with build_http_app and serve_uvicorn

JunyiXu-nv

committed

24f9585

[TRTLLM-17269][chore] Merge the typed chat core branch into the shared app assembly branch as the base for the per-dialect error renderers

JunyiXu-nv

committed

7b5d307

[TRTLLM-17269][test] Pin the validation-error answers of both trtllm-serve apps before rendering them per dialect

JunyiXu-nv

committed

0cd4354

[TRTLLM-17269][refactor] Add the dialect-neutral serving errors, the error boundary and the per-dialect error registry

JunyiXu-nv

committed

fba3195

[TRTLLM-17269][refactor] Register trtllm-serve error renderers per wire dialect

JunyiXu-nv

committed

1c1172c

[TRTLLM-17269][test] Check the error modules' VisualGen imports with a layering contract

JunyiXu-nv

committed

0bbc9ee

Navigation Menu

Repository navigation

[TRTLLM-17269][refactor] Add per-dialect error renderers in serve/exception_handling - #21566

[TRTLLM-17269][refactor] Add per-dialect error renderers in serve/exception_handling#21566
JunyiXu-nv wants to merge 28 commits into
NVIDIA:mainfrom
JunyiXu-nv:dev-junyix-feat-serve-exception-handling

Commits on Nov 4, 2026

[TRTLLM-17261][test] Add route, middleware-order and shim-identity snapshots and a CPU test seam for trtllm-serve

[TRTLLM-17261][test] Record the trtllm-serve route reference and test baselines at the merge base

[TRTLLM-17261][test] Cover the attached-frontend route registration in the snapshot matrix

[None][test] Address review of the serve snapshot and layering tests

[TRTLLM-17261][test] Refresh the serve route reference and baselines on the current main

[None][test] Make the route snapshot and the object.new ratchet fail on silent regressions

[TRTLLM-17262][refactor] Shared middleware package for the aggregated and disaggregated servers

[TRTLLM-17262][refactor] ServerArrivalTimeMiddleware keeps an existing request state

[TRTLLM-17261][refactor] Move the msgpack route classes to tensorrt_llm/serve/_base/msgspec_route.py

[TRTLLM-17261][refactor] Add the trtllm-serve router skeleton and serve the system endpoints through it

[TRTLLM-17261][infra] Multi-GPU triggers and type checking for the new serve packages

[TRTLLM-17261][test] Register the system router in the multi-frontend tests that build routes by hand

[TRTLLM-17261][test] Match a request instead of reading route paths in the OpenEngine metrics test

[TRTLLM-17261][test] Classify endpoint-package imports by the imported name

[TRTLLM-17263][test] Pin the chat completion handler's HTTP answers before splitting it

[TRTLLM-17263][refactor] Move the chat SSE generator to tensorrt_llm/serve/_base/sse.py

[TRTLLM-17263][refactor] Split openai_chat into a typed create_chat_completion and an HTTP wrapper

[TRTLLM-17263][infra] Type-check tensorrt_llm/serve/_base/errors.py

[TRTLLM-17263][test] Stub the chat response as a ChatCompletionResponse in the multimodal prompt test

[TRTLLM-17263][test] Pin that an unencodable chat response is answered 400 without a traceback

[TRTLLM-17269][chore] Merge the router skeleton branch into the middleware package branch as the base for the shared app assembly

[TRTLLM-17269][refactor] Add build_http_app and serve_uvicorn, the shared assembly of the trtllm-serve apps

[TRTLLM-17269][refactor] Build the aggregated and disaggregated trtllm-serve apps with build_http_app and serve_uvicorn

[TRTLLM-17269][chore] Merge the typed chat core branch into the shared app assembly branch as the base for the per-dialect error renderers

[TRTLLM-17269][test] Pin the validation-error answers of both trtllm-serve apps before rendering them per dialect

[TRTLLM-17269][refactor] Add the dialect-neutral serving errors, the error boundary and the per-dialect error registry

[TRTLLM-17269][refactor] Register trtllm-serve error renderers per wire dialect

[TRTLLM-17269][test] Check the error modules' VisualGen imports with a layering contract