Skip to content

Issues: linkedin/Liger-Kernel

2024 Q4 Roadmap
#285 opened Sep 30, 2024 by ByronHsu
Open
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

45 Open 69 Closed
45 Open 69 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[RFC] Liger FlexChunkLoss: Supporting various alignment (DPO, ORPO, IRPO, CPO, etc) and distillation (KL divergence, cosine_similarity, earth_mover_distance, etc) loss functions
#371 opened Nov 8, 2024 by shivam15s
@shivam15s
Convergence test for gemma2
#370 opened Nov 8, 2024 by Tcc0403
LigerCrossEntropyLoss is not patched for latest transformers models
#369 opened Nov 8, 2024 by Tcc0403
Keyword arguments for liger functional
#368 opened Nov 8, 2024 by Tcc0403
byron's issue tracker
#355 opened Nov 5, 2024 by ByronHsu
6
cross entropy kernel: inplace modification of input
#343 opened Nov 4, 2024 by mgrabban
2
Overlap matrix multiplication (needs tensor core) and other things like activation (needs cuda core and memory bandwidth) to speed up
#341 opened Nov 4, 2024 by fzyzcjy
Possible support for weighted average loss calculation in FusedLinearCrossEntropy kernel
#338 opened Nov 1, 2024 by ChenlongDeng
FSDP fails with [ lm_head ] layer
#332 opened Oct 31, 2024 by gotzmann
5
Cross entropy for packing
#329 opened Oct 29, 2024 by fzyzcjy
6
Logits seems to be missing
#328 opened Oct 28, 2024 by fzyzcjy
4
Training LLaVA with the Liger kernel results in degraded performance.
#319 opened Oct 22, 2024 by y-rok
1
mllama patch modifies nn.LayerNorm globally
#315 opened Oct 19, 2024 by tyler-romero
3
Empty Medusa head tensors
#309 opened Oct 14, 2024 by vkc1vk
2
Add end-to-end example of mllama
#301 opened Oct 10, 2024 by shivam15s
@shivam15s
2024 Q4 Roadmap
#285 opened Sep 30, 2024 by ByronHsu
Add TVD (Total variation distance) Kernel feature
#281 opened Sep 28, 2024 by qingquansong
1
@saurabhkoshatwar
3
In-place operations in triton kernel might result in incorrect gradient calculations bug Something isn't working
#272 opened Sep 26, 2024 by Tcc0403
1
3
Encountered errors when reproducing lightning training example
#271 opened Sep 26, 2024 by ReginaZh
3
Choice of num_warps
#266 opened Sep 22, 2024 by Edenzzzz
7
Loss does not drop when using Liger Kernel at Qwen2.5
#257 opened Sep 19, 2024 by Se-Hun
11
ValueError when Loading Qwen2-VL Model with Liger Kernel
#249 opened Sep 16, 2024 by rahatarinasir
1
Support for Cohere models
#248 opened Sep 15, 2024 by nyxkrage
1
Is not compatible with DoRA? bug Something isn't working
#245 opened Sep 11, 2024 by gotzmann
1
Reasons for upcasting the logits dtype outside the kernel
#241 opened Sep 10, 2024 by yzhangcs
7
ProTip! Find all open issues with in progress development work with linked:pr.