Headline finding
M2XFP narrows the 4-bit LLM quantization accuracy gap by achieving on average a 70.63% reduction in accuracy loss compared to MXFP4 and a 37.30% reduction relative to NVFP4 on LLM benchmarks, while delivering up to 1.91x speedup and 1.75x energy savings over state-of-the-art accelerators.
The reported 70.63% and 37.30% accuracy loss reductions match the Table 2 averages, and the 1.91x speedup and 1.75x energy savings are supported by the normalized latency and energy comparisons in Figure 13.
“Evaluation results demonstrate that our method substantially narrows the accuracy gap, achieving on average a 70.63% reduction in accuracy loss compared to MXFP4 and a 37.30% reduction relative to the latest NVFP4 on LLM benchmarks. Furthermore, our design delivers up to 1.91× speedup and 1.75× energy savings over state-of-the-art accelerators.” · Show in paper