Skip to content

chore: bump nixl verison to 0.7.0 #3936

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 7 commits into
base: main
Choose a base branch
from
+11 −11
Open

chore: bump nixl verison to 0.7.0 #3936

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
f368984
bump nixl verison to 0.7.0
nv-tusharma Oct 28, 2025
3e9cb3f
Merge branch 'main' into tusharma/bump-nixl-0.7.0
nv-tusharma Oct 28, 2025
374bc35
Add build.sh to vllm filter for internal pipeline trigger
nv-tusharma Oct 28, 2025
9748b38
fix how ci variables are processed
nv-tusharma Oct 28, 2025
edf59f8
host ci variables in arrays to prevent CI from splitting arguments to…
nv-tusharma Oct 28, 2025
a120057
Merge branch 'main' into tusharma/bump-nixl-0.7.0
nv-tusharma Oct 29, 2025
62416ba
Merge branch 'main' into tusharma/bump-nixl-0.7.0
nv-tusharma Oct 29, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion container/Dockerfile
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ ARG SCCACHE_REGION=""

# NIXL configuration
ARG NIXL_UCX_REF=v1.19.0
ARG NIXL_REF=0.6.0
ARG NIXL_REF=0.7.0

# Python configuration
ARG PYTHON_VERSION=3.12
Expand Down
2 changes: 1 addition & 1 deletion container/build.sh
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -115,7 +115,7 @@ NONE_BASE_IMAGE_TAG="25.01-cuda12.8-devel-ubuntu24.04"
SGLANG_BASE_IMAGE="nvcr.io/nvidia/cuda-dl-base"
SGLANG_BASE_IMAGE_TAG="25.01-cuda12.8-devel-ubuntu24.04"

NIXL_REF=0.6.0
NIXL_REF=0.7.0
NIXL_UCX_REF=v1.19.0
NIXL_UCX_EFA_REF=9d2b88a1f67faf9876f267658bd077b379b8bb76

Expand Down
4 changes: 2 additions & 2 deletions docs/reference/support-matrix.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -58,14 +58,14 @@ If you are using a **GPU**, the following GPU models and architectures are suppo
| :----------------- | :---------- | :------------------------------------ | :----------- |
| ai-dynamo | 0.6.1 | >=2.28 | |
| ai-dynamo-runtime | 0.6.1 | >=2.28 (Python 3.12 has known issues) | |
| NIXL | 0.6.0 | >=2.27 | >=11.8 |
| NIXL | 0.7.0 | >=2.27 | >=11.8 |

### Build Dependency

| **Build Dependency** | **Version** |
| :------------------- | :------------------------------------------------------------------------------- |
| **TensorRT-LLM** | 1.1.0rc5 |
| **NIXL** | 0.6.0 |
| **NIXL** | 0.7.0 |
| **vLLM** | 0.10.1.1 |
| **SGLang** | 0.5.3rc0 |

Expand Down
4 changes: 2 additions & 2 deletions lib/bindings/python/Cargo.lock
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion lib/llm/Cargo.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -95,7 +95,7 @@ dialoguer = { version = "0.11", default-features = false, features = [

# block_manager
aligned-vec = { version = "0.6.4", optional = true }
nixl-sys = { version = "=0.6.0", optional = true }
nixl-sys = { version = "=0.7.0", optional = true }
cudarc = { workspace = true, optional = true }
ndarray = { version = "0.16", optional = true }
nix = { version = "0.26", optional = true }
Expand Down
4 changes: 2 additions & 2 deletions pyproject.toml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -54,13 +54,13 @@ trtllm =[

vllm = [
"uvloop",
"nixl<=0.6.0",
"nixl<=0.7.0",
"vllm[flashinfer]==0.10.2",
]

sglang = [
"uvloop",
"nixl<=0.6.0",
"nixl<=0.7.0",
"sglang[all]==0.5.4.post1",
]

Expand Down
Loading