[TRTLLM-17269][refactor] Extract the shared HTTP app assembly into serve/_base/app_builder.py by JunyiXu-nv · Pull Request #21556 · NVIDIA/TensorRT-LLM

[TRTLLM-17261][test] Add route, middleware-order and shim-identity snapshots and a CPU test seam for trtllm-serve

JunyiXu-nv

committed

b291cca

[TRTLLM-17261][test] Record the trtllm-serve route reference and test baselines at the merge base

JunyiXu-nv

committed

c9311ab

[TRTLLM-17261][test] Cover the attached-frontend route registration in the snapshot matrix

JunyiXu-nv

committed

81b0350

[None][test] Address review of the serve snapshot and layering tests

JunyiXu-nv

committed

2eb184a

[TRTLLM-17261][test] Refresh the serve route reference and baselines on the current main

JunyiXu-nv

committed

5138e15

[None][test] Make the route snapshot and the object.new ratchet fail on silent regressions

JunyiXu-nv

committed

045a69e

[TRTLLM-17262][refactor] Shared middleware package for the aggregated and disaggregated servers

JunyiXu-nv

committed

1a3a615

[TRTLLM-17262][refactor] ServerArrivalTimeMiddleware keeps an existing request state

JunyiXu-nv

committed

a0aa0df

[TRTLLM-17261][refactor] Move the msgpack route classes to tensorrt_llm/serve/_base/msgspec_route.py

JunyiXu-nv

committed

68344ed

[TRTLLM-17261][refactor] Add the trtllm-serve router skeleton and serve the system endpoints through it

JunyiXu-nv

committed

9f4a48e

[TRTLLM-17261][infra] Multi-GPU triggers and type checking for the new serve packages

JunyiXu-nv

committed

caf3a29

[TRTLLM-17261][test] Register the system router in the multi-frontend tests that build routes by hand

JunyiXu-nv

committed

4a6325d

[TRTLLM-17261][test] Match a request instead of reading route paths in the OpenEngine metrics test

JunyiXu-nv

committed

7e29509

[TRTLLM-17261][test] Classify endpoint-package imports by the imported name

JunyiXu-nv

committed

d3aacdd

[TRTLLM-17269][chore] Merge the router skeleton branch into the middleware package branch as the base for the shared app assembly

JunyiXu-nv

committed

bbea912

[TRTLLM-17269][refactor] Add build_http_app and serve_uvicorn, the shared assembly of the trtllm-serve apps

JunyiXu-nv

committed

633a332

[TRTLLM-17269][refactor] Build the aggregated and disaggregated trtllm-serve apps with build_http_app and serve_uvicorn

JunyiXu-nv

committed

24f9585

Navigation Menu

Repository navigation

[TRTLLM-17269][refactor] Extract the shared HTTP app assembly into serve/_base/app_builder.py - #21556

[TRTLLM-17269][refactor] Extract the shared HTTP app assembly into serve/_base/app_builder.py#21556
JunyiXu-nv wants to merge 17 commits into
NVIDIA:mainfrom
JunyiXu-nv:dev-junyix-feat-serve-shared-app-assembly

Commits on Nov 4, 2026

[TRTLLM-17261][test] Add route, middleware-order and shim-identity snapshots and a CPU test seam for trtllm-serve

[TRTLLM-17261][test] Record the trtllm-serve route reference and test baselines at the merge base

[TRTLLM-17261][test] Cover the attached-frontend route registration in the snapshot matrix

[None][test] Address review of the serve snapshot and layering tests

[TRTLLM-17261][test] Refresh the serve route reference and baselines on the current main

[None][test] Make the route snapshot and the object.new ratchet fail on silent regressions

[TRTLLM-17262][refactor] Shared middleware package for the aggregated and disaggregated servers

[TRTLLM-17262][refactor] ServerArrivalTimeMiddleware keeps an existing request state

[TRTLLM-17261][refactor] Move the msgpack route classes to tensorrt_llm/serve/_base/msgspec_route.py

[TRTLLM-17261][refactor] Add the trtllm-serve router skeleton and serve the system endpoints through it

[TRTLLM-17261][infra] Multi-GPU triggers and type checking for the new serve packages

[TRTLLM-17261][test] Register the system router in the multi-frontend tests that build routes by hand

[TRTLLM-17261][test] Match a request instead of reading route paths in the OpenEngine metrics test

[TRTLLM-17261][test] Classify endpoint-package imports by the imported name

[TRTLLM-17269][chore] Merge the router skeleton branch into the middleware package branch as the base for the shared app assembly

[TRTLLM-17269][refactor] Add build_http_app and serve_uvicorn, the shared assembly of the trtllm-serve apps

[TRTLLM-17269][refactor] Build the aggregated and disaggregated trtllm-serve apps with build_http_app and serve_uvicorn