Skip to content
/ QLLM Public

[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"

arxiv.org/abs/2310.08041

License

Apache-2.0 license
38 stars 4 forks Branches Tags Activity
Star
Notifications You must be signed in to change notification settings

ModelTC/QLLM

Error
Looks like something went wrong!

About

[ICLR 2024] This is the official PyTorch implementation of "QLLM: Accurate and Efficient Low-Bitwidth Quantization for Large Language Models"

arxiv.org/abs/2310.08041

Topics

transformers pytorch llama quantization post-training-quantization llm llama2

Resources

Readme

License

Apache-2.0 license
Activity
Custom properties

Stars

38 stars

Watchers

8 watching

Forks

4 forks
Report repository

Releases

No releases published

Packages

No packages published

Contributors 2

Languages