English

Addressing Overthinking in Large Vision-Language Models via Gated Perception-Reasoning Optimization

Computer Vision and Pattern Recognition 2026-04-16 v2 Computation and Language

Abstract

Large Vision-Language Models (LVLMs) have exhibited strong reasoning capabilities through chain-of-thought mechanisms that generate step-by-step rationales. However, such slow-thinking approaches often lead to overthinking, where models produce excessively verbose responses even for simple queries, resulting in test-time inefficiency and even degraded accuracy. Prior work has attempted to mitigate this issue via adaptive reasoning strategies, but these methods largely overlook a fundamental bottleneck: visual perception failures. We argue that stable reasoning critically depends on low-level visual grounding, and that reasoning errors often originate from imperfect perception rather than insufficient deliberation. To address this limitation, we propose Gated Perception-Reasoning Optimization (GPRO), a meta-reasoning controller that dynamically routes computation among three decision paths at each generation step: a lightweight fast path, a slow perception path for re-examining visual inputs, and a slow reasoning path for internal self-reflection. To learn this distinction, we derive large-scale failure attribution supervision from approximately 790k samples, using teacher models to distinguish perceptual hallucinations from reasoning errors. We then train the controller with multi-objective reinforcement learning to optimize the trade-off between task accuracy and computational cost under uncertainty. Experiments on five benchmarks demonstrate that GPRO substantially improves both accuracy and efficiency, outperforming recent slow-thinking methods while generating significantly shorter responses.

Keywords

Cite

@article{arxiv.2601.04442,
  title  = {Addressing Overthinking in Large Vision-Language Models via Gated Perception-Reasoning Optimization},
  author = {Xingjian Diao and Zheyuan Liu and Chunhui Zhang and Weiyi Wu and Keyi Kong and Lin Shi and Kaize Ding and Soroush Vosoughi and Jiang Gui},
  journal= {arXiv preprint arXiv:2601.04442},
  year   = {2026}
}

Comments

Accepted to Annual Meeting of the Association for Computational Linguistics (ACL 2026)

R2 v1 2026-07-01T08:55:17.106Z