English
Related papers

Related papers: Bad Seeing or Bad Thinking? Rewarding Perception f…

200 papers

Multimodal large language models (MLLMs) have demonstrated strong capabilities on vision-and-language tasks. However, recent findings reveal an imbalance in their reasoning capabilities across visual and textual modalities. Specifically,…

Artificial Intelligence · Computer Science 2026-01-09 Guanyu Yao , Qiucheng Wu , Yang Zhang , Zhaowen Wang , Handong Zhao , Shiyu Chang

Vision-Language Models (VLMs) excel at reasoning in linguistic space but struggle with perceptual understanding that requires dense visual perception, e.g., spatial reasoning and geometric awareness. This limitation stems from the fact that…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Yiming Qin , Bomin Wei , Jiaxin Ge , Konstantinos Kallidromitis , Stephanie Fu , Trevor Darrell , XuDong Wang

Multimodal large language models (MLLMs) have advanced the integration of visual and linguistic modalities, establishing themselves as the dominant paradigm for visual-language tasks. Current approaches like chain of thought (CoT) reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Haojie Zheng , Tianyang Xu , Hanchi Sun , Shu Pu , Ruoxi Chen , Lichao Sun

Autonomous driving requires reliable perception and safe decision-making in complex scenarios. Recent vision-language models (VLMs) demonstrate reasoning and generalization abilities, opening new possibilities for autonomous driving;…

Artificial Intelligence · Computer Science 2026-05-27 Zecong Tang , Zixu Wang , Yifei Wang , Weitong Lian , Tianjian Gao , Haoran Li , Tengju Ru , Lingyi Meng , Zhejun Cui , Yichen Zhu , Qi Kang , Kaixuan Wang , Yu Zhang

Video Large Language Models improve reasoning over complex videos by generating intermediate reasoning text. However, reliable reasoning depends on accurate video perception. In existing approaches, perception evidence is intertwined with…

Computer Vision and Pattern Recognition · Computer Science 2026-03-13 Bowei Pu , Chuanbin Liu , Yifan Ge , Peicheng Zhou , Yiwei Sun , Zhiying Lu , Zhangchi Hu , Hongtao Xie

Large Vision Language Models (LVLMs) have demonstrated remarkable abilities in understanding and reasoning about both visual and textual information. However, existing evaluation methods for LVLMs, primarily based on benchmarks like Visual…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Xinyu Wang , Bohan Zhuang , Qi Wu

Vision-language models (VLMs) have shown remarkable advancements in multimodal reasoning tasks. However, they still often generate inaccurate or irrelevant responses due to issues like hallucinated image understandings or unrefined…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Di Zhang , Junxian Li , Jingdi Lei , Xunzhi Wang , Yujie Liu , Zonglin Yang , Jiatong Li , Weida Wang , Suorong Yang , Jianbo Wu , Peng Ye , Wanli Ouyang , Dongzhan Zhou

Despite strong performance in visual understanding and language-based reasoning, Vision-Language Models (VLMs) struggle with tasks requiring integrated perception and symbolic computation. We study this limitation through visual equation…

Computation and Language · Computer Science 2025-09-12 Monjoy Narayan Choudhury , Junling Wang , Yifan Hou , Mrinmaya Sachan

The development of autonomous agents for complex, long-horizon tasks is a central goal in AI. However, dominant training paradigms face a critical limitation: reinforcement learning (RL) methods that optimize solely for final task success…

Machine Learning · Computer Science 2025-07-31 Zijing Zhang , Ziyang Chen , Mingxiao Li , Zhaopeng Tu , Xiaolong Li

Despite significant advancements, large multimodal models (LMMs) still struggle to bridge the gap between low-level visual perception -- focusing on shapes, sizes, and layouts -- and high-level language reasoning, such as semantics and…

Computation and Language · Computer Science 2025-06-13 Zhenhailong Wang , Joy Hsu , Xingyao Wang , Kuan-Hao Huang , Manling Li , Jiajun Wu , Heng Ji

Writing is a universal cultural technology that reuses vision for symbolic communication. Humans display striking resilience: we readily recognize words even when characters are fragmented, fused, or partially occluded. This paper…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Jie Zhang , Ting Xu , Gelei Deng , Runyi Hu , Han Qiu , Tianwei Zhang , Qing Guo , Ivor Tsang

Vision--language models (VLMs) are increasingly aligned via Group Relative Policy Optimization (GRPO)-style training. However, relying solely on terminal outcome rewards yields sparse credit assignment in multi-step reasoning, weakening the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 Feiding , Yongkang Zhang , Yuhao Liao , Zijian Zeng , Chunzheng Zhu , Yaozong Zheng , Yafei Liu , Yeling Peng , Youwei Wang , Sibo Wang , Huiming Yang , Linglin Liao , Shunzhi Yang

Recent large vision-language models (LVLMs) can generate vision-text multimodal chain-of-thought (MCoT) traces after reinforcement fine-tuning (RFT). However, we observe that the visual information incorporated in MCoT is often inaccurate,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Zujing Liu , Junwen Pan , Qi She , Yuan Gao , Guisong Xia

Large Vision-Language Models (LVLMs) have become powerful general-purpose assistants, yet their predictions often lack reliability and interpretability due to insufficient grounding in visual evidence. The emerging thinking-with-images…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Meng Cao , Haoze Zhao , Can Zhang , Xiaojun Chang , Ian Reid , Xiaodan Liang

Recent "Thinking with Video" approaches use Video Generation Models (VGMs) for visual reasoning by producing temporally coherent Chain-of-Frames as reasoning artifacts. Even strong VGMs, however, exhibit two recurring failure modes on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Joowon Kim , Seungho Shin , Joonhyung Park , Eunho Yang

Vision-Language Models (VLMs) have recently emerged as powerful tools, excelling in tasks that integrate visual and textual comprehension, such as image captioning, visual question answering, and image-text retrieval. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Ilias Stogiannidis , Steven McDonagh , Sotirios A. Tsaftaris

With the growing number and diversity of Vision-Language Models (VLMs), many works explore language-based ensemble, collaboration, and routing techniques across multiple VLMs to improve multi-model reasoning. In contrast, we address the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Selim Furkan Tekin , Yichang Xu , Gaowen Liu , Ramana Rao Kompella , Margaret L. Loper , Ling Liu

Despite significant progress, multimodal large language models continue to struggle with visual mathematical problem solving. Some recent works recognize that visual perception is a bottleneck in visual mathematical reasoning, but their…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Shuhang Chen , Yunqiu Xu , Junjie Xie , Aojun Lu , Tao Feng , Zeying Huang , Ning Zhang , Yi Sun , Yi Yang , Hangjie Yuan

Reinforcement learning with verifiable rewards (RLVR) has significantly advanced the reasoning ability of vision-language models (VLMs). However, the inherent text-dominated nature of VLMs often leads to insufficient visual faithfulness,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zengbin Wang , Feng Xiong , Liang Lin , Xuecai Hu , Yong Wang , Yanlin Wang , Man Zhang , Xiangxiang Chu

Large vision-and-language models (VLMs) trained to match images with text on large-scale datasets of image-text pairs have shown impressive generalization ability on several vision and language tasks. Several recent works, however, showed…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 Navid Rajabi , Jana Kosecka
‹ Prev 1 8 9 10 Next ›