Headline finding
Across Qwen3-8B and Qwen3-14B under W4A4 quantization with MXFP4, NVFP4, and HiF4, a SoScale variant achieves the best average downstream accuracy in every model-format group, preserving 96.44% to 97.17% of BF16 average accuracy under MXFP4, 98.99% to 99.20% under NVFP4, and 98.38% to 99.40% under HiF4, outperforming RTN, GPTQ, local ScaleSearch, and BlockRotation baselines.
The reported relative BF16 percentages and improvements over the strongest non-SoScale baselines and ScaleSearch match the exact values in Table 2.
“Across both Qwen3 models and all three FP4 formats, a SoScale variant obtains the best average score in every model-format group, preserving 96.44%–97.17% of the BF16 average accuracy under MXFP4, 98.99%–99.20% under NVFP4, and 98.38%–99.40% under HiF4. Compared with the strongest non-SoScale baseline in each group, the best SoScale variant improves the average score by 0.21 to 0.77 percentage points; relative to local ScaleSearch, the gains are 0.47 to 1.10 points.” · Show in paper