Headline finding
Learned, globally calibrated KV eviction (DBTrimKV) substantially reduces KV memory while matching or surpassing full-cache inference across diverse long-context language, vision-language reasoning, and multi-turn dialogue benchmarks, suggesting it is both a compression technique and a mechanism for improving long-context reasoning.
The experimental results across Tables 1, 2, 3, 7 and Figure 5 directly support that DBTrimKV reduces KV memory while matching or surpassing full-cache inference across all tested benchmark categories.
“Across diverse long-context language and vision-language reasoning, and multi-turn dialogue benchmarks, our method substantially reduces KV memory while matching or surpassing full-cache inference. These results suggest that learned, globally calibrated KV eviction is not only a compression technique, but also a mechanism for improving long-context reasoning.” · Show in paper