中文
相关论文

相关论文: Improving Medical VQA through Trajectory-Aware Pro…

200 篇论文

Improving the multi-step reasoning ability of Large Language Models (LLMs) is a critical yet challenging task. The dominant paradigm, outcome-supervised reinforcement learning (RLVR), rewards only correct final answers, often propagating…

人工智能 · 计算机科学 2025-10-14 Beining Wang , Weihang Su , Hongtao Tian , Tao Yang , Yujia Zhou , Ting Yao , Qingyao Ai , Yiqun Liu

Developing 3D vision-language models with robust clinical reasoning remains a challenge due to the inherent complexity of volumetric medical imaging, the tendency of models to overfit superficial report patterns, and the lack of…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Haoran Lai , Zihang Jiang , Kun Zhang , Qingsong Yao , Rongsheng Wang , Zhiyang He , Xiaodong Tao , Wei Wei , Shaohua Kevin Zhou

Medical visual question answering could support clinical decision making, yet current systems often fail under domain shift and produce answers that are weakly grounded in image evidence. This reliability gap arises when models attend to…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Jiahe Qian , Yuhao Shen , Zhangtianyi Chen , Juexiao Zhou , Peisong Wang

The intersection of medical Visual Question Answering (Med-VQA) is a challenging research topic with advantages including patient engagement and clinical expert involvement for second opinions. However, existing Med-VQA methods based on…

机器学习 · 计算机科学 2024-06-24 Lin Fan , Xun Gong , Cenyang Zheng , Yafei Ou

Recent advancements in reinforcement learning with verifiable rewards (RLVR) have significantly improved the complex reasoning ability of vision-language models (VLMs). However, its outcome-level supervision is too coarse to diagnose and…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Yingqian Min , Kun Zhou , Yifan Li , Yuhuan Wu , Han Peng , Yifan Du , Wayne Xin Zhao , Min Yang , Ji-Rong Wen

Doctors and patients alike increasingly use Large Language Models (LLMs) to diagnose clinical cases. However, unlike domains such as math or coding, where correctness can be objectively defined by the final answer, medical diagnosis…

The application of Vision-Language Models (VLMs) in medicine is critically hampered by the scarcity of high-quality, expert-annotated data. Supervised Fine-Tuning (SFT) on existing datasets often leads to poor generalization on unseen…

机器学习 · 计算机科学 2025-12-09 Weihai Zhi , Jiayan Guo , Shangyang Li

We propose a novel framework for comprehending the reasoning capabilities of large language models (LLMs) through the perspective of meta-learning. By conceptualizing reasoning trajectories as pseudo-gradient descent updates to the LLM's…

计算与语言 · 计算机科学 2025-05-27 Junnan Liu , Hongwei Liu , Linchen Xiao , Shudong Liu , Taolin Zhang , Zihan Ma , Songyang Zhang , Kai Chen

Medical question-answering (QA) is a critical task for evaluating how effectively large language models (LLMs) encode clinical knowledge and assessing their potential applications in medicine. Despite showing promise on multiple-choice…

计算与语言 · 计算机科学 2025-03-06 Guangfu Guo , Kai Zhang , Bryan Hoo , Yujun Cai , Xiaoqian Lu , Nanyun Peng , Yiwei Wang

Medical tasks such as diagnosis and treatment planning require precise and complex reasoning, particularly in life-critical domains. Unlike mathematical reasoning, medical reasoning demands meticulous, verifiable thought processes to ensure…

Reasoning-augmented vision language models (VLMs) generate explicit chains of thought that promise greater capability and transparency but also introduce new failure modes: models may reach correct answers via visually unfaithful…

计算机视觉与模式识别 · 计算机科学 2025-12-22 Rheeya Uppaal , Phu Mon Htut , Min Bai , Nikolaos Pappas , Zheng Qi , Sandesh Swamy

Omnidirectional images (ODIs), with their 360{\deg} field of view, provide unparalleled spatial awareness for immersive applications like augmented reality and embodied AI. However, the capability of existing multi-modal large language…

计算机视觉与模式识别 · 计算机科学 2025-05-21 Xinshen Zhang , Zhen Ye , Xu Zheng

Despite the impressive performance of vision-language models (VLMs) on downstream tasks, their ability to understand and reason about causal relationships in visual inputs remains unclear. Robust causal reasoning is fundamental to solving…

计算与语言 · 计算机科学 2026-02-05 Zhaotian Weng , Haoxuan Li , Xin Eric Wang , Kuan-Hao Huang , Jieyu Zhao

Large vision-language models (LVMs) hold a great promise for automating medical report generation, potentially reducing the burden of manual reporting. State-of-the-art (SOTA) research fine-tunes general LVMs with medical data to align…

计算与语言 · 计算机科学 2025-04-07 Hao Wang , Shuchang Ye , Jinghao Lin , Usman Naseem , Jinman Kim

Recent work shows that text-only reinforcement learning with verifiable rewards (RLVR) can match or outperform image-text RLVR on multimodal medical VQA benchmarks, suggesting current evaluation protocols may fail to measure causal visual…

计算机视觉与模式识别 · 计算机科学 2026-03-05 Anas Zafar , Leema Krishna Murali , Ashish Vashist

Recent advances in large language models (LLMs) have enabled general-purpose systems to perform increasingly complex domain-specific reasoning without extensive fine-tuning. In the medical domain, decision-making often requires integrating…

计算与语言 · 计算机科学 2025-08-14 Shansong Wang , Mingzhe Hu , Qiang Li , Mojtaba Safari , Xiaofeng Yang

Bridging clinical diagnostic reasoning with AI remains a central challenge in medical imaging. We introduce MedCLM, an automated pipeline that converts detection datasets into large-scale medical visual question answering (VQA) data with…

计算机视觉与模式识别 · 计算机科学 2025-10-07 Soo Yong Kim , Suin Cho , Vincent-Daniel Yun , Gyeongyeon Hwang

Large language models (LLMs) increasingly solve difficult problems by producing "reasoning traces" before emitting a final response. However, it remains unclear how accuracy and decision commitment evolve along a reasoning trajectory, and…

机器学习 · 计算机科学 2026-02-02 Marthe Ballon , Brecht Verbeken , Vincent Ginis , Andres Algaba

A reliable driving assistant should provide consistent responses based on temporally grounded reasoning derived from observed information. In this work, we investigate whether Vision-Language Models (VLMs), when applied as driving…

计算机视觉与模式识别 · 计算机科学 2026-03-11 Chun-Peng Chang , Chen-Yu Wang , Holger Caesar , Alain Pagani

Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capabilities of Large Language Models (LLMs) by leveraging direct outcome verification instead of learned reward models. Building on this paradigm, Group…