Headline finding
Compression ratio alone is a poor predictor of end-to-end performance for KV-cache compression methods, motivating workload-aware selection rather than one-size-fits-all compression.
The joint evaluation across task quality, TTFT, throughput, and realized compression ratio clearly demonstrates that compression ratio alone does not predict end-to-end system or quality outcomes.
“The results show that the compression ratio alone is a poor predictor of end-to-end performance.” · Show in paper