English
Related papers

Related papers: When Thinking Drifts: Evidential Grounding for Rob…

200 papers

Chain-of-Thought (CoT) prompting helps models think step by step. But naive CoT breaks down in visually grounded social tasks, where models must perceive, understand, and judge all at once; bridging perception with norm-grounded reasoning.…

Computation and Language · Computer Science 2026-04-21 Eunkyu Park , Wesley Hanwen Deng , Gunhee Kim , Motahhare Eslami , Maarten Sap

Abductive reasoning seeks the likeliest possible explanation for partial observations. Although abduction is frequently employed in human daily reasoning, it is rarely explored in computer vision literature. In this paper, we propose a new…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Chen Liang , Wenguan Wang , Tianfei Zhou , Yi Yang

Recent progress in multimodal reasoning has been significantly advanced by textual Chain-of-Thought (CoT), a paradigm where models conduct reasoning within language. This text-centric approach, however, treats vision as a static, initial…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Zhaochen Su , Peng Xia , Hangyu Guo , Zhenhua Liu , Yan Ma , Xiaoye Qu , Jiaqi Liu , Yanshu Li , Kaide Zeng , Zhengyuan Yang , Linjie Li , Yu Cheng , Heng Ji , Junxian He , Yi R. Fung

Video reasoning segmentation (VRS) endeavors to delineate referred objects in videos guided by implicit instructions that encapsulate human intent and temporal logic. Previous approaches leverage large vision language models (LVLMs) to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-05 Sitong Gong , Lu Zhang , Yunzhi Zhuge , Xu Jia , Pingping Zhang , Huchuan Lu

Does Chain-of-Thought (CoT) reasoning genuinely improve Vision-Language-Action (VLA) models, or does it merely add overhead? Existing CoT-VLA systems report limited and inconsistent gains, yet no prior work has rigorously diagnosed when and…

Machine Learning · Computer Science 2026-04-21 Cheng Yin , Yankai Lin , Wang Xu , Sikyuen Tam , Xiangrui Zeng , Zhiyuan Liu , Zhouping Yin

While Chain-of-Thought (CoT) prompting has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), relying solely on linear text sequences remains a bottleneck for complex tasks. We observe that even…

Computation and Language · Computer Science 2026-02-12 Lingzhuang Sun , Yuxia Zhu , Ruitong Liu , Hao Liang , Zheng Sun , Caijun Jia , Honghao He , Yuchen Wu , Siyuan Li , Jingxuan Wei , Xiangxiang Zhang , Bihui Yu , Wentao Zhang

Chain-of-Thought (CoT) reasoning excels in language models but struggles in vision-language models due to premature visual-to-text conversion that discards continuous information such as geometry and spatial layout. While recent methods…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Weihang You , Qingchan Zhu , David Liu , Yi Pan , Geng Yuan , Hanqi Jiang

Multimodal large language models (MLLMs) have advanced the integration of visual and linguistic modalities, establishing themselves as the dominant paradigm for visual-language tasks. Current approaches like chain of thought (CoT) reasoning…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Haojie Zheng , Tianyang Xu , Hanchi Sun , Shu Pu , Ruoxi Chen , Lichao Sun

Aiming to identify precise evidence sources from visual documents, visual evidence attribution for visual document retrieval-augmented generation (VD-RAG) ensures reliable and verifiable predictions from vision-language models (VLMs) in…

Artificial Intelligence · Computer Science 2025-12-02 Shuochen Liu , Pengfei Luo , Chao Zhang , Yuhao Chen , Haotian Zhang , Qi Liu , Xin Kou , Tong Xu , Enhong Chen

We propose MIRA, a new benchmark designed to evaluate models in scenarios where generating intermediate visual images is essential for successful reasoning. Unlike traditional CoT methods that rely solely on text, tasks in MIRA require…

Computer Vision and Pattern Recognition · Computer Science 2025-11-05 Yiyang Zhou , Haoqin Tu , Zijun Wang , Zeyu Wang , Niklas Muennighoff , Fan Nie , Yejin Choi , James Zou , Chaorui Deng , Shen Yan , Haoqi Fan , Cihang Xie , Huaxiu Yao , Qinghao Ye

Explanations are often promoted as tools for transparency, but they can also foster confirmation bias; users may assume reasoning is correct whenever outputs appear acceptable. We study this double-edged role of Chain-of-Thought (CoT)…

Computation and Language · Computer Science 2025-11-20 Eunkyu Park , Wesley Hanwen Deng , Vasudha Varadarajan , Mingxi Yan , Gunhee Kim , Maarten Sap , Motahhare Eslami

Despite the promising progress of recent autoregressive models in text-to-image (T2I) generation, their ability to handle multi-attribute and ambiguous prompts remains limited. To address these limitations, existing works have applied…

Computer Vision and Pattern Recognition · Computer Science 2025-08-27 Yaqi Li , Peng Chen , Mingyang Han , Pi Bu , Haoxiang Shi , Runzhou Zhao , Yang Yao , Xuan Zhang , Jun Song , Bo Zheng

Existing Video Large Language Models (Video LLMs) struggle with complex video understanding, exhibiting limited reasoning capabilities and potential hallucinations. In particular, these methods tend to perform reasoning solely relying on…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Qizhong Tan , Zhuotao Tian , Guangming Lu , Jun Yu , Wenjie Pei

Real-world reasoning often requires combining information across modalities, connecting textual context with visual cues in a multi-hop process. Yet, most multimodal benchmarks fail to capture this ability: they typically rely on single…

Machine Learning · Computer Science 2026-04-03 Junyoung Sung , Seungwoo Lyu , Minjun Kim , Sumin An , Arsha Nagrani , Paul Hongsuck Seo

Multimodal large language models (LLMs) have made rapid progress in visual understanding, yet their extension from images to videos often reduces to a naive concatenation of frame tokens. In this work, we investigate what video finetuning…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Ruiqi Yang , Tian Yun , Zihan Wang , Ellie Pavlick

The ability to perform Chain-of-Thought (CoT) reasoning marks a major milestone for multimodal models (MMs), enabling them to solve complex visual reasoning problems. Yet a critical question remains: is such reasoning genuinely grounded in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Jusheng Zhang , Kaitong Cai , Xiaoyang Guo , Sidi Liu , Qinhan Lv , Ruiqi Chen , Jing Yang , Yijia Fan , Xiaofei Sun , Jian Wang , Ziliang Chen , Liang Lin , Keze Wang

Video reasoning has emerged as a critical capability for multimodal large language models (MLLMs), requiring models to move beyond static perception toward coherent understanding of temporal dynamics in complex scenes. Yet existing MLLMs…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Sicheng Tao , Jungang Li , Yibo Yan , Junyan Zhang , Yubo Gao , Hanqian Li , ShuHang Xun , Yuxuan Fan , Hong Chen , Jianxiang He , Xuming Hu

This study investigates the spatial reasoning capabilities of vision-language models (VLMs) through Chain-of-Thought (CoT) prompting and reinforcement learning. We begin by evaluating the impact of different prompting strategies and find…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Binbin Ji , Siddharth Agrawal , Qiance Tang , Yvonne Wu

Multimodal Large Language Models (MLLMs) have achieved notable gains in various tasks by incorporating Chain-of-Thought (CoT) reasoning in language spaces. Recent work extends this direction by leveraging external tools for visual editing,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-07 Bangzheng Li , Ximeng Sun , Jiang Liu , Ze Wang , Jialian Wu , Xiaodong Yu , Hao Chen , Emad Barsoum , Muhao Chen , Zicheng Liu

Long-form video understanding, characterized by long-range temporal dependencies and multiple events, remains a challenge. Existing methods often rely on static reasoning or external visual-language models (VLMs), which face issues like…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Yuan Xie , Tianshui Chen , Zheng Ge , Lionel Ni