Skip to content

Pull requests: neuralmagic/gateway-api-inference-extension

New pull request New
9 Open 32 Closed
9 Open 32 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

feat: Add scripts for kubernetes dev env using vLLM and vLLM-p2p help wanted Extra attention is needed WIP
#60 opened Apr 25, 2025 by kfirtoledo Loading…
12
Minor fixes in instructions for deploying dev k8s env
#58 opened Apr 24, 2025 by elevran Loading…
1
Report lint errors on new code only
#54 opened Apr 24, 2025 by elevran Loading…
Session affinity scorer
#52 opened Apr 24, 2025 by mayabar Loading…
Prefix Aware Scorer
#48 opened Apr 23, 2025 by oglok Loading…
7
Add scorer based on active loras
#43 opened Apr 22, 2025 by mayabar Loading…
Add second vLLM-sim instance to allow for routing
#41 opened Apr 21, 2025 by oglok Loading…
5
Fix in scorer manager in picking the best target
#35 opened Apr 20, 2025 by mayabar Loading…
4
Implemented KVCacheAwareScorer
#34 opened Apr 19, 2025 by vMaroon Loading…
19
ProTip! Type g i on any issue or pull request to go back to the issue listing page.