English

LaRe: Latent Refocusing for Multimodal Reasoning

Computer Vision and Pattern Recognition 2026-05-27 v4 Computation and Language

Abstract

Chain of Thought (CoT) reasoning enhances logical performance by decomposing complex tasks, yet its multimodal extension faces a trade-off. The prevailing Thinking with Images paradigm achieves visual refocusing by explicitly cropping image regions, yet incurs rapidly growing computational overhead. The emerging line of latent-space reasoning reduces token consumption, but lacks the capacity for dynamic refocusing. We argue that this trade-off stems from a tacitly accepted premise that effective visual refocusing must occur in the form of explicit tokens. Building on this, we propose Latent Refocusing (LaRe), a new multimodal reasoning paradigm in which visual refocusing takes place entirely within the latent space. We further design a semantic augmentation training strategy that ensures the semantic structure of the latent space through visual reconstruction objective. Experimental evaluations demonstrate that LaRe improves average accuracy by 7.6% compared to existing baselines while reducing the number of tokens required for inference by 59.7%. When scaled to a 8B-parameter Vision-Language Model backbone, LaRe achieves performance comparable to state-of-the-art methods, demonstrating the efficacy of our proposed latent refocusing paradigm for multimodal reasoning.

Keywords

Cite

@article{arxiv.2511.02360,
  title  = {LaRe: Latent Refocusing for Multimodal Reasoning},
  author = {Jizheng Ma and Xiaofei Zhou and Geyuan Zhang and Yanlong Song and Han Yan},
  journal= {arXiv preprint arXiv:2511.02360},
  year   = {2026}
}
R2 v1 2026-07-01T07:20:49.163Z