Skip to content

Conversation

@dagil-nvidia
Copy link
Contributor

@dagil-nvidia dagil-nvidia commented Nov 24, 2025

Update Support Matrix Documentation

Summary

Comprehensive update to the Dynamo support matrix to reflect ARM64 platform support, updated backend versions, new CUDA compatibility information, and newly available distribution packages for v0.7.0.

Changes

Platform Support

  • ARM64: Upgraded from "Experimental" to "Supported" status
  • Ubuntu 24.04 ARM64: Upgraded from "Experimental" to "Supported"
  • Removed experimental ARM64 warning callout (previously in Hardware Compatibility section)
  • Removed note about ARM64 Linux support being experimental (previously in Platform Architecture Compatibility section)

Backend Versions (Build Dependencies)

  • TensorRT-LLM: Updated from 1.1.0rc5 to 12.0rc2
  • vLLM: Updated from 0.10.1.1 to 0.11.0
  • SGLang: Updated from 0.5.3rc0 to 0.5.3.post4
  • NIXL: Remains at 0.7.1 (reordered in table)

New: CUDA Support by Framework Section

Added new table documenting CUDA version support for each framework:

  • SGLang: CUDA 12.8
  • TensorRT-LLM: CUDA 13.0
  • vLLM: CUDA 12.8

Build Support Section Updates

Wheels

  • Expanded description to include PyPI links for all distributed packages
  • Added kvbm (new in v0.7.0) as standalone package
  • Links to PyPI for:

Container Images

  • Dynamo Runtime Images: Updated from "AMD64 only" to "multi-arch (x86 & ARM64 compatible)"
  • Dynamo Kubernetes Operator Images: Updated from "AMD64 only" to "multi-arch (x86 & ARM64 compatible)"
  • Dynamo Frontend Images:
    • NEW section added
    • Marked as "New as of Dynamo v0.7.0"
    • Multi-arch support (x86 & ARM64)
    • Link to dynamo-frontend

Helm Charts

  • Reformatted as bullet list for consistency
  • Links to all three charts maintained

NEW: Rust Crates Section

Added new section documenting published Rust crates:

Testing

  • Documentation builds without errors
  • All PyPI links are valid and accessible
  • All NGC container links are valid and accessible
  • All crates.io links are valid and accessible
  • Table formatting renders correctly
  • CUDA version information is accurate

Related Issues


Signed-off-by: dagil-nvidia [email protected]

Summary by CodeRabbit

Documentation

  • ARM64 support upgraded from experimental to officially supported status
  • Added CUDA compatibility matrix detailing Dynamo version mappings across supported frameworks
  • Expanded build and deployment options with multi-architecture container images and Rust crates
  • Updated hardware compatibility information and removed experimental status warnings

✏️ Tip: You can customize this high-level summary in your review settings.

@dagil-nvidia dagil-nvidia self-assigned this Nov 24, 2025
@copy-pr-bot
Copy link

copy-pr-bot bot commented Nov 24, 2025

This pull request requires additional validation before any workflows can run on NVIDIA's runners.

Pull request vetters can view their responsibilities here.

Contributors can view more details about this message here.

@coderabbitai
Copy link
Contributor

coderabbitai bot commented Nov 24, 2025

Walkthrough

Documentation updates to the support matrix covering ARM64 promotion from experimental to supported status, addition of CUDA framework version mappings, and expansion of multi-architecture build and deployment artifacts including new frontend images and Rust crates distributions.

Changes

Cohort / File(s) Summary
Support Matrix Documentation
docs/reference/support-matrix.md
Updated Hardware Compatibility section with ARM64 promoted to Supported status; removed experimental warnings. Added new CUDA Support by Framework table with Dynamo version mappings for SGLang, TensorRT-LLM, and vLLM. Expanded Build Support sections with multi-architecture wheels, container images, and Rust crates listings. Replaced AMD64-only runtime containers with multi-arch distributions and added standalone Dynamo Frontend Images.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~12 minutes

  • Verify accuracy of version mappings and framework support table entries
  • Confirm ARM64 status change is consistent across all referenced sections
  • Validate multi-architecture image and package naming conventions

Poem

🐰 ARM64 hops from dream to real,
Multi-arch wonders help us feel,
New tables bloom, new crates align,
Frontend images bright and fine,
Docs refresh with vibrant gleam! ✨

Pre-merge checks

✅ Passed checks (3 passed)
Check name Status Explanation
Description check ✅ Passed The PR description comprehensively covers all required template sections with detailed information about changes, platform support updates, backend versions, new CUDA support table, and build support section updates with appropriate links and a testing checklist.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Title check ✅ Passed The title accurately and concisely captures the primary change: updating the support matrix documentation for Dynamo 0.7.0, which aligns with the comprehensive updates detailed in the PR objectives.

Tip

📝 Customizable high-level summaries are now available in beta!

You can now customize how CodeRabbit generates the high-level summary in your pull requests — including its content, structure, tone, and formatting.

  • Provide your own instructions using the high_level_summary_instructions setting.
  • Format the summary however you like (bullet lists, tables, multi-section layouts, contributor stats, etc.).
  • Use high_level_summary_in_walkthrough to move the summary from the description to the walkthrough section.

Example instruction:

"Divide the high-level summary into five sections:

  1. 📝 Description — Summarize the main change in 50–60 words, explaining what was done.
  2. 📓 References — List relevant issues, discussions, documentation, or related PRs.
  3. 📦 Dependencies & Requirements — Mention any new/updated dependencies, environment variable changes, or configuration updates.
  4. 📊 Contributor Summary — Include a Markdown table showing contributions:
    | Contributor | Lines Added | Lines Removed | Files Changed |
  5. ✔️ Additional Notes — Add any extra reviewer context.
    Keep each section concise (under 200 words) and use bullet or numbered lists for clarity."

Note: This feature is currently in beta for Pro-tier users, and pricing will be announced later.


Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@dagil-nvidia
Copy link
Contributor Author

/ok to test e75610d

@dagil-nvidia dagil-nvidia changed the title docs: update support matrix for Dynamo 0.7.0 fixed version of TRTLLM Nov 24, 2025
@dagil-nvidia
Copy link
Contributor Author

/ok to test 2401667

@dagil-nvidia dagil-nvidia changed the title fixed version of TRTLLM docs: update support matrix for Dynamo 0.7.0 Nov 24, 2025
@dagil-nvidia dagil-nvidia enabled auto-merge (squash) November 24, 2025 21:10
@dagil-nvidia
Copy link
Contributor Author

/ok to test d1f23b7

@dagil-nvidia dagil-nvidia merged commit 25fd32a into main Nov 24, 2025
25 checks passed
@dagil-nvidia dagil-nvidia deleted the dagil-nvidia/support-matrix-update-11232025 branch November 24, 2025 21:14
dagil-nvidia added a commit that referenced this pull request Nov 24, 2025
nv-tusharma pushed a commit that referenced this pull request Nov 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants