ggml-cuda: MoE MMQ tile sizing + D=256 flash-attn tuning on RDNA3.5#35
Closed
roberteg16 wants to merge 3 commits into
Closed
ggml-cuda: MoE MMQ tile sizing + D=256 flash-attn tuning on RDNA3.5#35roberteg16 wants to merge 3 commits into
roberteg16 wants to merge 3 commits into