[Benchmark] template attention kernel and test

[Sibylau]

Stacked PRs:

• ->[Benchmark] template attention kernel and test #824

---

[Benchmark] template attention kernel and test

[Sibylau]

tritonbench accuracy check passes:

code generation journal check passes:

[yf225]

Thanks! We will probably need to look into the performance side of attention kernels too. The perf of regular attention kernels is currently being worked on, and after it's done we might need to revise the kernel in this PR to match the pattern better. So I'll put it on hold until we get the attention perf work done (should be soon, in preparation for PTC).

[Sibylau]

Thanks! We will probably need to look into the performance side of attention kernels too. The perf of regular attention kernels is currently being worked on, and after it's done we might need to revise the kernel in this PR to match the pattern better. So I'll put it on hold until we get the attention perf work done (should be soon, in preparation for PTC).

Thank you! Happy to help revise the kernel to match performance.