Headline finding
Agentic LLM workloads occupy a hardware regime that no prior inference benchmark captures, characterized by a dual pressure of compute-bound prefill and KV-cache capacity saturation that separates agentic serving from chat.
The benchmark comparison, saturation sweeps, and roofline/capacity analyses directly support the claim that agentic workloads exhibit this dual-pressure regime uncaptured by prior benchmarks.
“Agentic LLM workloads occupy a hardware regime that no prior inference benchmark captures. Across 22 workload profiles, 9 models, and 14 GPU configurations (3,197 sweep rows, 148,077 NCU records), AGENTPERFBENCH identifies a dual pressure that separates agentic serving from chat.” · Show in paper