English
Related papers

Related papers: Improving Medical VQA through Trajectory-Aware Pro…

200 papers

While Multimodal Large Language Models (MLLMs) have achieved impressive progress in vision-language understanding, they still struggle with complex multi-step reasoning, often producing logically inconsistent or partially correct solutions.…

Artificial Intelligence · Computer Science 2025-06-06 Lingxiao Du , Fanqing Meng , Zongkai Liu , Zhixiang Zhou , Ping Luo , Qiaosheng Zhang , Wenqi Shao

Although LLMs exhibit strong reasoning capabilities, existing training methods largely depend on outcome-based feedback, which can produce correct answers with flawed reasoning. Prior work introduces supervision on intermediate steps but…

Computation and Language · Computer Science 2026-01-30 Jundong Xu , Hao Fei , Huichi Zhou , Xin Quan , Qijun Huang , Shengqiong Wu , William Yang Wang , Mong-Li Lee , Wynne Hsu

Large Language Models (LLMs) are increasingly deployed in critical applications requiring reliable reasoning, yet their internal reasoning processes remain difficult to evaluate systematically. Existing methods focus on final-answer…

Machine Learning · Computer Science 2026-02-03 Shaima Ahmad Freja , Ferhat Ozgur Catak , Betul Yurdem , Chunming Rong

In multi-hop question answering (MHQA) tasks, Chain of Thought (CoT) improves the quality of generation by guiding large language models (LLMs) through multi-step reasoning, and Knowledge Graphs (KGs) reduce hallucinations via semantic…

Computation and Language · Computer Science 2025-12-02 Xinyi Wang , Yiping Song , Zhiliang Tian , Bo Liu , Tingjin Luo , Minlie Huang

In high-stakes medical applications, consistent answering across diverse question phrasings is essential for reliable diagnosis. However, we reveal that current Medical Vision-Language Models (Med-VLMs) exhibit concerning fragility in…

Computation and Language · Computer Science 2025-08-27 Songtao Jiang , Yuxi Chen , Sibo Song , Yan Zhang , Yeying Jin , Yang Feng , Jian Wu , Zuozhu Liu

This study presents DiagCoT, a multi-stage framework that applies supervised fine-tuning to general-purpose vision-language models (VLMs) to emulate radiologists' stepwise diagnostic reasoning using only free-text reports. DiagCoT combines…

Artificial Intelligence · Computer Science 2025-09-09 Yihong Luo , Wenwu He , Zhuo-Xu Cui , Dong Liang

Inference-time scaling for LLM reasoning has focused on three axes: chain depth, sample breadth, and learned step-scorers (PRMs). We introduce a fourth axis, granularity of external verbal supervision, via Verbal Process Supervision (VPS),…

Computation and Language · Computer Science 2026-04-24 Hao-Yuan Chen

Process reward models (PRMs) that provide dense, step-level feedback have shown promise for reinforcement learning, yet their adoption remains limited by the need for expensive step-level annotations or ground truth references. We propose…

Machine Learning · Computer Science 2025-12-04 Salman Rahman , Sruthi Gorantla , Arpit Gupta , Swastik Roy , Nanyun Peng , Yang Liu

Recent advances in multimodal techniques have led to significant progress in Medical Visual Question Answering (Med-VQA). However, most existing models focus on global image features rather than localizing disease-specific regions crucial…

Computational Engineering, Finance, and Science · Computer Science 2025-06-30 Yuan Wang , Jiaxiang Liu , Shujian Gao , Bin Feng , Zhihang Tang , Xiaotang Gai , Jian Wu , Zuozhu Liu

DeepSeek-R1 has demonstrated powerful reasoning capabilities in the text domain through stable reinforcement learning (RL). Recently, in the multimodal domain, works have begun to directly apply RL to generate R1-like free-form reasoning…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Chuming Shen , Wei Wei , Xiaoye Qu , Yu Cheng

Clinical reasoning in medicine is a hypothesis-driven process where physicians refine diagnoses from limited information through targeted history, physical examination, and diagnostic investigations. In contrast, current medical benchmarks…

Machine Learning · Computer Science 2025-10-14 Christopher Chiu , Silviu Pitis , Mihaela van der Schaar

While reinforcement learning with verifiable rewards (RLVR) has advanced LLM reasoning in structured domains like mathematics and programming, its application to general-domain reasoning tasks remains challenging due to the absence of…

Computation and Language · Computer Science 2026-01-29 Wenlin Zhong , Chengyuan Liu , Yiquan Wu , Bovin Tan , Changlong Sun , Yi Wang , Xiaozhong Liu , Kun Kuang

Recent advances in vision language models (VLMs) offer reasoning capabilities, yet how these unfold and integrate visual and textual information remains unclear. We analyze reasoning dynamics in 18 VLMs covering instruction-tuned and…

Computation and Language · Computer Science 2026-04-28 Danae Sánchez Villegas , Samuel Lewis-Lim , Nikolaos Aletras , Desmond Elliott

Integrating external tools into Large Foundation Models (LFMs) has emerged as a promising approach to enhance their problem-solving capabilities. While existing studies have demonstrated strong performance in tool-augmented Visual Question…

Artificial Intelligence · Computer Science 2026-03-05 Shaofeng Yin , Ting Lei , Yang Liu

Large Vision-Language Models (LVLMs) excel in multimodal reasoning and have shown impressive performance on various multimodal benchmarks. However, most of these benchmarks evaluate models primarily through multiple-choice or short-answer…

Computation and Language · Computer Science 2026-02-26 Haofeng Wang , Yu Zhang

Visual reasoning over structured data such as tables is a critical capability for modern vision-language models (VLMs), yet current benchmarks remain limited in scale, diversity, or reasoning depth, especially when it comes to rendered…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Boammani Aser Lompo , Marc Haraoui

Large Language Models (LLMs) have achieved significant advances in reasoning tasks. A key approach is tree-based search with verifiers, which expand candidate reasoning paths and use reward models to guide pruning and selection. Although…

Artificial Intelligence · Computer Science 2025-10-01 Yingqian Cui , Zhenwei Dai , Pengfei He , Bing He , Hui Liu , Xianfeng Tang , Jingying Zeng , Suhang Wang , Yue Xing , Jiliang Tang , Benoit Dumoulin

Large language models (LLMs) have shown promise in medical question answering but often struggle with hallucinations and shallow reasoning, particularly in tasks requiring nuanced clinical understanding. Retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2025-08-25 Ziyu Wang , Elahe Khatibi , Amir M. Rahmani

Objective: To improve the efficiency of medical question answering (MedQA) with large language models (LLMs) by avoiding unnecessary reasoning while maintaining accuracy. Methods: We propose Selective Chain-of-Thought (Selective CoT), an…

Computation and Language · Computer Science 2026-02-24 Zaifu Zhan , Min Zeng , Shuang Zhou , Yiran Song , Xiaoyi Chen , Yu Hou , Yifan Wu , Yang Ruan , Rui Zhang

Chain-of-thought (CoT) reasoning in vision language models (VLMs) is crucial for improving interpretability and trustworthiness. However, current training recipes lack robust CoT reasoning data, relying on datasets dominated by short…

Artificial Intelligence · Computer Science 2024-10-22 Ruohong Zhang , Bowen Zhang , Yanghao Li , Haotian Zhang , Zhiqing Sun , Zhe Gan , Yinfei Yang , Ruoming Pang , Yiming Yang