Skip to content

[release/0.4][New features] Support FlashMask with 512/512 and 576/512 head dimensions - #1736

Open
risemeup1111 wants to merge 1 commit into
PaddlePaddle:release/0.4from
risemeup1111:cherry-pick/1724/release/0.4
Open

[release/0.4][New features] Support FlashMask with 512/512 and 576/512 head dimensions#1736
risemeup1111 wants to merge 1 commit into
PaddlePaddle:release/0.4from
risemeup1111:cherry-pick/1724/release/0.4

Conversation

@risemeup1111

Copy link
Copy Markdown
Contributor

PR Category

Operator Mechanism

PR Types

New features

Description

开启 paddlefleet flashmask d512/dv512 d576/dv512 的支持

是否引起精度变化

Cherry-pick of #1724 to release/0.4.

Merged in dev: #1724

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants