Experimenting with differential attention#2314

Merged

rwightman merged 2 commits intomainfrom

Dec 5, 2025

Commits on Dec 5, 2025

Implement diff attention in own layer file. Add support to vision_transformer.py and naflexivt.py ViTs
rwightman
committed
ParallelScalingBlock needs extra args even if not used
rwightman
committed