English
Related papers

Related papers: CAPO: Reinforcing Consistent Reasoning in Medical …

200 papers

Multimodal large language models (MLLMs) often struggle to ground reasoning in perceptual evidence. We present a systematic study of perception strategies-explicit, implicit, visual, and textual-across four multimodal benchmarks and two…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yizhuo Ding , Mingkang Chen , Zhibang Feng , Tong Xiao , Wanying Qu , Wenqi Shao , Yanwei Fu

Large language models have achieved strong performance on medical reasoning benchmarks, yet their deployment in clinical settings demands rigorous verification to ensure factual accuracy. While reward models offer a scalable approach for…

Artificial Intelligence · Computer Science 2026-01-29 Hang Zhang , Ruheng Wang , Yuelyu Ji , Mingu Kwak , Xizhi Wu , Chenyu Li , Li Zhang , Wenqi Shi , Yifan Peng , Yanshan Wang

The application of Vision-Language Models (VLMs) in medicine is critically hampered by the scarcity of high-quality, expert-annotated data. Supervised Fine-Tuning (SFT) on existing datasets often leads to poor generalization on unseen…

Machine Learning · Computer Science 2025-12-09 Weihai Zhi , Jiayan Guo , Shangyang Li

While Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capabilities of Large Vision-Language Models (LVLMs), most existing methods in multimodal reasoning neglect the critical role of visual perception within…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Siyuan Huang , Xiaoye Qu , Yafu Li , Yun Luo , Zefeng He , Daizong Liu , Yu Cheng

Visual reasoning is crucial for understanding complex multimodal data and advancing Artificial General Intelligence. Existing methods enhance the reasoning capability of Multimodal Large Language Models (MLLMs) through Reinforcement…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Chaoyang Wang , Zeyu Zhang , Meng Meng , Xu Zhou , Haiyun Jiang

Recent advancements in Large Language Models (LLMs) and their multimodal extensions (MLLMs) have substantially enhanced machine reasoning across diverse tasks. However, these models predominantly rely on pure text as the medium for both…

Machine Learning · Computer Science 2026-02-23 Yi Xu , Chengzu Li , Han Zhou , Xingchen Wan , Caiqi Zhang , Anna Korhonen , Ivan Vulić

Multimodal Large Language Models (MLLMs) have achieved impressive progress in natural image reasoning, yet their potential in medical imaging remains underexplored, especially in clinical anatomical surgical images. Anatomy understanding…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Ziyang Song , Zelin Zang , Zuyao Chen , Xusheng Liang , Dong Yi , Jinlin Wu , Hongbin Liu , Jiebo Luo , Zhen. Lei

Video Question Answering (VideoQA) is a challenging task that requires understanding complex visual and temporal relationships within videos to answer questions accurately. In this work, we introduce \textbf{ReasVQA} (Reasoning-enhanced…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Jianxin Liang , Xiaojun Meng , Huishuai Zhang , Yueqian Wang , Jiansheng Wei , Dongyan Zhao

Recently, to comprehensively improve Vision Language Models (VLMs) for Visual Question Answering (VQA), several methods have been proposed to further reinforce the inference capabilities of VLMs to independently tackle VQA tasks rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Zeqing Wang , Wentao Wan , Qiqing Lao , Runmeng Chen , Minjie Lang , Xiao Wang , Keze Wang , Liang Lin

While mainstream vision-language models (VLMs) have advanced rapidly in understanding image level information, they still lack the ability to focus on specific areas designated by humans. Rather, they typically rely on large volumes of…

Computer Vision and Pattern Recognition · Computer Science 2025-02-13 Kangyu Zhu , Ziyuan Qin , Huahui Yi , Zekun Jiang , Qicheng Lao , Shaoting Zhang , Kang Li

Fully comprehending scientific papers by machines reflects a high level of Artificial General Intelligence, requiring the ability to reason across fragmented and heterogeneous sources of information, presenting a complex and practically…

Computation and Language · Computer Science 2025-06-30 Yang Tian , Zheng Lu , Mingqi Gao , Zheng Liu , Bo Zhao

Vision Language Models (VLMs) extend remarkable capabilities of text-only large language models and vision-only models, and are able to learn from and process multi-modal vision-text input. While modern VLMs perform well on a number of…

Computation and Language · Computer Science 2025-07-22 Hannah Sterz , Jonas Pfeiffer , Ivan Vulić

Artificial Intelligence (AI) has demonstrated significant potential in healthcare, particularly in disease diagnosis and treatment planning. Recent progress in Medical Large Vision-Language Models (Med-LVLMs) has opened up new possibilities…

Machine Learning · Computer Science 2025-03-04 Peng Xia , Kangyu Zhu , Haoran Li , Tianze Wang , Weijia Shi , Sheng Wang , Linjun Zhang , James Zou , Huaxiu Yao

Large Vision-Language Models (LVLMs) have shown remarkable progress in various multimodal tasks, yet they often struggle with complex visual reasoning that requires multi-step inference. To address this limitation, we propose MF-SQ-LLaVA, a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-20 Liu Jing , Amirul Rahman

Physical reasoning over visual inputs demands tight integration of visual perception, domain knowledge, and multi-step symbolic inference. Yet even state-of-the-art Vision Language Models (VLMs) fall far short of human performance on…

Artificial Intelligence · Computer Science 2026-04-16 Derek Lilienthal , Manisha Mukherjee , Sameera Horawalavithana

Although multimodal large language models (MLLMs) excel in high-level vision-language reasoning, they lack inherent awareness of visual saliency, making it difficult to identify key visual elements. To bridge this gap, we propose…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Long Li , Shuichen Ji , Ziyang Luo , Zhihui Li , Dingwen Zhang , Junwei Han , Nian Liu

This study investigates the spatial reasoning capabilities of vision-language models (VLMs) through Chain-of-Thought (CoT) prompting and reinforcement learning. We begin by evaluating the impact of different prompting strategies and find…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Binbin Ji , Siddharth Agrawal , Qiance Tang , Yvonne Wu

Background: The rapid integration of foundation models into clinical practice and public health necessitates a rigorous evaluation of their true clinical reasoning capabilities beyond narrow examination success. Current benchmarks,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Dingyu Wang , Zimu Yuan , Jiajun Liu , Shanggui Liu , Nan Zhou , Tianxing Xu , Di Huang , Dong Jiang

DeepSeek-R1 has demonstrated powerful reasoning capabilities in the text domain through stable reinforcement learning (RL). Recently, in the multimodal domain, works have begun to directly apply RL to generate R1-like free-form reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Chuming Shen , Wei Wei , Xiaoye Qu , Yu Cheng

Vision Language Models exhibit impressive performance for various tasks, yet they often lack the sophisticated situational reasoning required for complex decision-making. This paper shows that VLMs can achieve surprisingly strong…

Computation and Language · Computer Science 2025-10-07 Zhe Hu , Jing Li , Zhongzhu Pu , Hou Pong Chan , Yu Yin
‹ Prev 1 8 9 10 Next ›