Headline finding
Harness-Bench's evaluation of seven native harnesses across ten backends on 274 general tasks and seven backends on 26 multimodal tasks reveals substantial, model-dependent performance differences where no single harness performs best across all ten backends.
The full-suite tables (Tables 2 and 3) directly show that no single harness leads across all ten backends on general tasks or all seven backends on multimodal tasks.
“We evaluate seven harnesses with ten backends on general tasks and seven on multimodal tasks, using paired comparisons on shared tasks. Our evaluation reveals substantial, model-dependent performance differences: no harness performs best across all ten backends, and GLM-5.3’s general-task full-credit rate varies by 13.5 percentage points across harnesses.” · Show in paper