English

Density-aware Soft Context Compression with Semi-Dynamic Compression Ratio

Computation and Language 2026-03-30 v1

Abstract

Soft context compression reduces the computational workload of processing long contexts in LLMs by encoding long context into a smaller number of latent tokens. However, existing frameworks apply uniform compression ratios, failing to account for the extreme variance in natural language information density. While adopting a density-aware dynamic compression ratio seems intuitive, empirical investigations reveal that models struggle intrinsically with operations parameterized by input dependent, continuous structural hyperparameters. To resolve this pitfall, we introduce Semi-Dynamic Context Compression framework. Our approach features a Discrete Ratio Selector, which predicts a compression target based on intrinsic information density and quantizes it to a predefined set of discrete compression ratios. It is efficiently jointly trained with the compressor on synthetic data, with the summary lengths as a proxy to create labels for compression ratio prediction. Extensive evaluations confirm that our density-aware framework, utilizing mean pooling as the backbone, consistently outperforms static baselines, establishing a robust Pareto frontier for context compression techniques. Our code, data and model weights are available at https://github.com/yuyijiong/semi-dynamic-context-compress

Keywords

Cite

@article{arxiv.2603.25926,
  title  = {Density-aware Soft Context Compression with Semi-Dynamic Compression Ratio},
  author = {Yijiong Yu and Shuai Yuan and Jie Zheng and Huazheng Wang and Ji Pei},
  journal= {arXiv preprint arXiv:2603.25926},
  year   = {2026}
}
R2 v1 2026-07-01T11:39:58.105Z