moe support for llama4 and mllama4 #740

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Open

cxcxflying wants to merge 1 commit into vllm-project:main from cxcxflying:main

cxcxflying commented Apr 30, 2025

What this PR does / why we need it?

Does this PR introduce any user-facing change?

How was this patch tested?


          moe support for llama4

23fc5a1

github-actions bot added the module:ops label

Collaborator

Yikun commented Apr 30, 2025

Awesome! Thanks for you contributions!

Here is a very simple guide to help you address CI failure: https://vllm-ascend.readthedocs.io/en/latest/developer_guide/contributing.html
Pls to add [New Model]: Llama 4 #471 as related issue
Free feel to add multiple authors if any other guys help the PR: https://docs.github.com/en/pull-requests/committing-changes-to-your-project/creating-and-editing-commits/creating-a-commit-with-multiple-authors
Please also add test note to help others review, like: [New Model]: Llama 4 #471 (comment)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels