Skip to content
/ ms-swift Public

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, Qwen2-Audio, Ovis2, InternVL3, Llava, GLM4v, Phi4, ...) (AAAI 2025).

swift.readthedocs.io/zh-cn/latest/

License

Apache-2.0 license
8.1k stars 697 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

modelscope/ms-swift

Error
Looks like something went wrong!

About

Use PEFT or Full-parameter to CPT/SFT/DPO/GRPO 500+ LLMs (Qwen3, Qwen3-MoE, Llama4, InternLM3, DeepSeek-R1, ...) and 200+ MLLMs (Qwen2.5-VL, Qwen2.5-Omni, Qwen2-Audio, Ovis2, InternVL3, Llava, GLM4v, Phi4, ...) (AAAI 2025).

swift.readthedocs.io/zh-cn/latest/

Topics

deploy llama lora embedding omni liger peft multimodal sft megatron rft llm internvl qwen2-vl deepseek-r1 grpo open-r1 qwen3 llama4 qwen3-moe

Resources

Readme

License

Apache-2.0 license

Code of conduct

Code of conduct

Security policy

Security policy
Activity
Custom properties

Stars

8.1k stars

Watchers

42 watching

Forks

697 forks
Report repository

Releases 48

v3.5.0 Latest
Jun 8, 2025
+ 47 releases

Packages

No packages published

Contributors 64

+ 50 contributors

Languages