Zyphra ZYFA: FP8 FlashAttention for AMD MI355X, Up to 1.76x Faster
MarkTechPost
Zyphra has released ZYFA, open-source FP8 and BF16 prefill attention kernels for AMD Instinct MI355X accelerators.
Zyphra has launched ZYFA, a set of open-source FP8 and BF16 prefill attention kernels specifically optimized for the AMD Instinct MI355X. According to the release, the new FP8 kernels operate up to 1.76 times faster than AMD's AITER on real model activations. Additionally, the kernels demonstrate significantly lower error rates at a head dimension of 128.
Why it matters: The release provides developers using AMD hardware with faster and more accurate attention kernels for AI workloads.