[TRTLLM-17263][refactor] Split the chat handler into a typed core and lift the SSE generator into serve/_base - #21515

[TRTLLM-17263][refactor] Split the chat handler into a typed core and lift the SSE generator into serve/_base#21515

JunyiXu-nv wants to merge 18 commits into

NVIDIA:mainNVIDIA/TensorRT-LLM:mainfrom

JunyiXu-nv:dev-junyix-feat-serve-typed-chat-coreJunyiXu-nv/TensorRT-LLM:dev-junyix-feat-serve-typed-chat-coreCopy head branch name to clipboard