Search results

Experiment: releasing WG2 right after QK issue gives only marginal gains

Status: Open.

#14 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 15, 2026

GQA WS IntraWGOverlap: SASS analysis identifies FA3 split-accumulator as root cause of 10% gap

Status: Open.

#13 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 14, 2026

Cycle-level profiling: IntraWG/InterWG overlap breakdown (TileOPs vs FA3)

Status: Open.

#12 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 13, 2026

NCU Profile: GqaFwdWsPersistentKernel bottleneck analysis (llama8b-4k, H200)

Status: Open.

#11 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 10, 2026

Add warp-specialized GQA kernels (fwd + bwd) — target >=80% FA3 on H200

Status: Open.

#10 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 7, 2026

FA3-aligned WS GQA: working implementations and IntraWGOverlap roadmap

Status: Open.

#9 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 5, 2026

TileLang: T.ws blocks incorrectly alias shared memory across parallel warp groups

Status: Open.

#8 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 5, 2026

3-WG WS GEMM 2-Tile: Full-size fragments, correct & fast

Status: Open.

#7 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 3, 2026

3-WG Split-KV GQA Forward: Working Implementation

Status: Open.

#6 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 3, 2026

TileLang Bug: T.ws(1,2) merged multi-WG consumer produces incorrect GEMM results

Status: Open.

#5 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 3, 2026

GQA Forward: Warp Specialization (FA3-aligned) — Findings & Blockers

Status: Open.

#4 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 3, 2026

GQA Forward FA3-style WGMMA Overlap: Analysis & Implementation Path

Status: Open.

#3 In superAngGao/TileOPs-report-static;

· superAngGao opened on Apr 3, 2026