English
Related papers

Related papers: RADAR: A Reasoning-Guided Attribution Framework fo…

200 papers

Recent works on large language models (LLMs) have successfully demonstrated the emergence of reasoning capabilities via reinforcement learning (RL). Although recent efforts leverage group relative policy optimization (GRPO) for MLLMs…

Computation and Language · Computer Science 2025-06-18 Shilin Xu , Yanwei Li , Rui Yang , Tao Zhang , Yueyi Sun , Wei Chow , Linfeng Li , Hang Song , Qi Xu , Yunhai Tong , Xiangtai Li , Hao Fei

Vision-language models (VLMs) have achieved remarkable success across diverse tasks. However, concerns about their trustworthiness persist, particularly regarding tendencies to lean more on textual cues than visual evidence and the risk of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Shizhan Gong , Minda Hu , Qiyuan Zhang , Chen Ma , Qi Dou

Multimodal Large Language Models (MLLMs) have demonstrated impressive abilities across various tasks, including visual question answering and chart comprehension, yet existing benchmarks for chart-related tasks fall short in capturing the…

Computation and Language · Computer Science 2025-02-11 Zifeng Zhu , Mengzhao Jia , Zhihan Zhang , Lang Li , Meng Jiang

Visual abductive reasoning (VAR) is a challenging task that requires AI systems to infer the most likely explanation for incomplete visual observations. While recent MLLMs develop strong general-purpose multimodal reasoning capabilities,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Boyu Chang , Qi Wang , Xi Guo , Zhixiong Nan , Yazhou Yao , Tianfei Zhou

Reinforcement learning (RL) has emerged as a promising approach for eliciting reasoning chains before generating final answers. However, multimodal large language models (MLLMs) generate reasoning that lacks integration of visual…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Omar Sharif , Eftekhar Hossain , Patrick Ng

This paper introduces a causal attribution model to enhance the interpretability of large language models (LLMs) and improve their causal reasoning abilities via precise fine-tuning. Despite LLMs' proficiency in diverse tasks, their…

Artificial Intelligence · Computer Science 2026-05-22 Hengrui Cai , Shengjie Liu , Rui Song

Current Large Multimodal Models (LMMs) struggle with high-resolution visual inputs during the reasoning process, as the number of image tokens increases quadratically with resolution, introducing substantial redundancy and irrelevant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Jiacheng Yang , Anqi Chen , Yunkai Dang , Qi Fan , Cong Wang , Wenbin Li , Feng Miao , Yang Gao

Direction reasoning is essential for intelligent systems to understand the real world. While existing work focuses primarily on spatial reasoning, compass direction reasoning remains underexplored. To address this, we propose the Compass…

Artificial Intelligence · Computer Science 2024-12-24 Hang Yin , Zhifeng Lin , Xin Liu , Bin Sun , Kan Li

We need to trust robots that use often opaque AI methods. They need to explain themselves to us, and we need to trust their explanation. In this regard, explainability plays a critical role in trustworthy autonomous decision-making to…

Robotics · Computer Science 2026-03-09 Jianhao Yuan , Shuyang Sun , Daniel Omeiza , Bo Zhao , Paul Newman , Lars Kunze , Matthew Gadd

Fact-checking research has extensively explored verification but less so the generation of natural-language explanations, crucial for user trust. While Large Language Models (LLMs) excel in text generation, their capability for producing…

Computation and Language · Computer Science 2024-02-13 Kyungha Kim , Sangyun Lee , Kung-Hsiang Huang , Hou Pong Chan , Manling Li , Heng Ji

Recent advances in Vision-Language Models (VLMs) have shown promising capabilities in interpreting visualized graph data, offering a new perspective for graph-structured reasoning beyond traditional Graph Neural Networks (GNNs). However,…

Artificial Intelligence · Computer Science 2026-04-27 Qihang Ai , Ruizhou Li , Menghui Wang , Haiyun Jiang

An impediment to using Large Language Models (LLMs) for reasoning output verification is that LLMs struggle to reliably identify errors in thinking traces, particularly in long outputs, domains requiring expert knowledge, and problems…

Computation and Language · Computer Science 2026-02-09 Kate Sanders , Nathaniel Weir , Sapana Chaudhary , Kaj Bostrom , Huzefa Rangwala

Flowcharts are indispensable tools in software design and business-process analysis, yet current vision-language models (VLMs) frequently misinterpret the directional arrows and graph topology that set these diagrams apart from natural…

Artificial Intelligence · Computer Science 2025-05-14 Takamitsu Omasa , Ryo Koshihara , Masumi Morishige

Rare diseases represent the long tail of medical imaging, where AI models often fail due to the scarcity of representative training data. In clinical workflows, radiologists frequently consult case reports and literature when confronted…

Computation and Language · Computer Science 2025-11-10 Ha Young Kim , Jun Li , Ana Beatriz Solana , Carolin M. Pirkl , Benedikt Wiestler , Julia A. Schnabel , Cosmin I. Bercea

With the rapid progress of Multimodal LLMs, evaluating their mathematical reasoning capabilities has become an increasingly important research direction. In particular, visual-textual mathematical reasoning serves as a key indicator of an…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Hao Liang , Linzhuang Sun , Minxuan Zhou , Zirong Chen , Meiyi Qiang , Mingan Lin , Tianpeng Li , Fan Yang , Zenan Zhou , Wentao Zhang

Recent reasoning-oriented LLMs have demonstrated strong performance on challenging tasks such as mathematics and science examinations. However, core cognitive faculties of human intelligence, such as abstract reasoning and generalization,…

Artificial Intelligence · Computer Science 2025-05-26 Chao Lei , Nir Lipovetzky , Krista A. Ehinger , Yanchuan Chang

Verifiers--functions assigning rewards to agent behavior--have been key to AI progress in math, code, and games. However, extending gains to domains without clear-cut success criteria remains a challenge: while humans can recognize desired…

Artificial Intelligence · Computer Science 2026-03-10 Moises Andrade , Joonhyuk Cha , Brandon Ho , Vriksha Srihari , Karmesh Yadav , Zsolt Kira

Despite impressive advancements in Visual-Language Models (VLMs) for multi-modal tasks, their reliance on RGB inputs limits precise spatial understanding. Existing methods for integrating spatial cues, such as point clouds or depth, either…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Yang Liu , Ming Ma , Xiaomin Yu , Pengxiang Ding , Han Zhao , Mingyang Sun , Siteng Huang , Donglin Wang

Multimodal Large Language Models (MLLMs) have demonstrated remarkable capabilities in visual mathematical reasoning across various existing benchmarks. However, these benchmarks are predominantly based on clean or processed multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Jun Feng , Zixin Wang , Zhentao Zhang , Yue Guo , Zhihan Zhou , Xiuyi Chen , Zhenyang Li , Dawei Yin

Recent advances in large language models (LLMs) and the intensifying popularity of ChatGPT-like applications have blurred the boundary of high-quality text generation between humans and machines. However, in addition to the anticipated…

Computation and Language · Computer Science 2023-10-25 Xiaomeng Hu , Pin-Yu Chen , Tsung-Yi Ho