Skip to content

Pull requests: NVIDIA/TensorRT-LLM

New pull request New
140 Open 552 Closed
140 Open 552 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

infra: add pre-commit check to github actions
#3129 opened Mar 27, 2025 by tburt-nv Loading…
8
feat: Cohere2ForCausalLM support (Command-A, Command-R7B)
#3128 opened Mar 27, 2025 by aikitoria Loading…
feat: FP8 Rowwise quantization support for Cohere models
#3127 opened Mar 27, 2025 by aikitoria Loading…
[draft]chore: update libcutlass library with FP4 quantize linear layout change
#3126 opened Mar 27, 2025 by nv-guomingz Loading…
3
infra: update concurrency control
#3120 opened Mar 27, 2025 by niukuo Loading…
5
chore: Stabilize ABI boundary for internal kernel library
#3117 opened Mar 27, 2025 by tongyuantongyu • Draft
@tongyuantongyu
3
fix: Reverse graph size order
#3116 opened Mar 27, 2025 by jiahanc Loading…
3
refactor:[AutoDeploy] Enhance RoPE support
#3115 opened Mar 26, 2025 by Fridah-nv • Draft
1 of 3 tasks
chore: add sqlite to rocky container
#3114 opened Mar 26, 2025 by tburt-nv • Draft
fix: Early exit cmake if find_library() does not find any lib
#3113 opened Mar 26, 2025 by WilliamTambellini Loading…
11
citest
#3110 opened Mar 26, 2025 by tensorrt-cicd Loading…
@niukuo
4
infra: [TRTLLM-4308] Add Bot help
#3107 opened Mar 26, 2025 by ZhanruiSunCh Loading…
7
fix: Fix C++ decoder synchronization in PyTorch
#3106 opened Mar 26, 2025 by dcampora Loading…
4
feat: Optionally split MoE inputs into chunks to reduce GPU memory usage
#3104 opened Mar 26, 2025 by jinyangyuan-nvidia • Draft
@jinyangyuan-nvidia
8
refactor: Simplify disableLookahead and improve numDecodingEngineTokens handling
#3103 opened Mar 26, 2025 by Funatiq Loading…
3
perf: Enhance LLM API perf
#3102 opened Mar 26, 2025 by kaiyux • Draft
chore: Ucx ip port remove mpi depend
#3101 opened Mar 26, 2025 by chuangz0 Loading…
15
infra: Support get file change for github PR
#3098 opened Mar 26, 2025 by ZhanruiSunCh Loading…
31
infra: Add test list name check
#3097 opened Mar 26, 2025 by EmmaQiaoCh Loading…
15
bug: Fix hang bug when context server doesn't have enough capacity for KV Cache
#3095 opened Mar 26, 2025 by Tabrizian Loading…
11
test: tests[CI]: remove closed bugs
#3094 opened Mar 26, 2025 by xinhe-nv Loading…
3
perf: Add optimizations for deepseek in min latency mode
#3093 opened Mar 26, 2025 by zongfeijing Loading…
@zongfeijing
18
feat: Run PyExecutor's inference flow to estimate max_num_tokens for kv_cache_manager
#3092 opened Mar 26, 2025 by HuiGao-NV Loading…
@HuiGao-NV
32
chore: Blossom debug hook
#3091 opened Mar 26, 2025 by yiqingy0 Loading…
@yiqingy0
6
fix: dist-serving streaming mode returns http 500
#3087 opened Mar 26, 2025 by zhengd-nv Loading…
15
ProTip! Adding no:label will show everything without a label.