English

OneLatent: Single-Token Compression for Visual Latent Reasoning

Artificial Intelligence 2026-02-17 v1

Abstract

Chain-of-thought (CoT) prompting improves reasoning but often increases inference cost by one to two orders of magnitude. To address these challenges, we present \textbf{OneLatent}, a framework that compresses intermediate reasoning into a single latent token via supervision from rendered CoT images and DeepSeek-OCR hidden states. By rendering textual steps into images, we obtain a deterministic supervision signal that can be inspected and audited without requiring the model to output verbose textual rationales. Across benchmarks, OneLatent reduces average output length by 11×11\times with only a 2.21%2.21\% average accuracy drop relative to textual CoT, while improving output token contribution (OTC) by 6.8×6.8\times. On long-chain logical reasoning, OneLatent reaches 99.80%99.80\% on ProntoQA and 97.80%97.80\% on ProsQA with one latent token, with compression up to 87.4×87.4\times, supporting compression-constrained generalization.

Keywords

Cite

@article{arxiv.2602.13738,
  title  = {OneLatent: Single-Token Compression for Visual Latent Reasoning},
  author = {Bo Lv and Yasheng Sun and Junjie Wang and Haoxiang Shi},
  journal= {arXiv preprint arXiv:2602.13738},
  year   = {2026}
}
R2 v1 2026-07-01T10:36:48.279Z