中文
相关论文

相关论文: Improving Medical VQA through Trajectory-Aware Pro…

200 篇论文

Medical Question-Answering (QA) encompasses a broad spectrum of tasks, including multiple choice questions (MCQ), open-ended text generation, and complex computational reasoning. Despite this variety, a unified framework for delivering…

计算与语言 · 计算机科学 2025-06-23 Xiaotian Zhang , Yuan Wang , Zhaopeng Feng , Ruizhe Chen , Zhijie Zhou , Yan Zhang , Hongxia Xu , Jian Wu , Zuozhu Liu

Large language models (LLMs) achieve strong reasoning performance through chain-of-thought (CoT) reasoning, yet often generate unnecessarily long reasoning paths that incur high inference cost. Recent self-consistency-based approaches…

计算与语言 · 计算机科学 2026-03-19 Juming Xiong , Kevin Guo , Congning Ni , Chao Yan , Katherine Brown , Avinash Baidya , Xiang Gao , Bradley Malin , Zhijun Yin

Medical vision--language models (VLMs) have shown strong potential for medical visual question answering (VQA), yet their reasoning remains largely text-centric: images are encoded once as static context, and subsequent inference is…

计算机视觉与模式识别 · 计算机科学 2026-04-14 Suyang Xi , Songtao Hu , Yuxiang Lai , Wangyun Dan , Yaqi Liu , Shansong Wang , Xiaofeng Yang

Accurate medical diagnosis often involves progressive visual focusing and iterative reasoning, characteristics commonly observed in clinical workflows. While recent vision-language models demonstrate promising chain-of-thought (CoT)…

计算机视觉与模式识别 · 计算机科学 2026-03-13 Chunzheng Zhu , Yangfang Lin , Shen Chen , Yijun Wang , Jianxin Lin

Video Question Answering (VideoQA) is a challenging task that requires understanding complex visual and temporal relationships within videos to answer questions accurately. In this work, we introduce \textbf{ReasVQA} (Reasoning-enhanced…

计算机视觉与模式识别 · 计算机科学 2025-01-24 Jianxin Liang , Xiaojun Meng , Huishuai Zhang , Yueqian Wang , Jiansheng Wei , Dongyan Zhao

Explainability is critical for the clinical adoption of medical visual question answering (VQA) systems, as physicians require transparent reasoning to trust AI-generated diagnoses. We present MedXplain-VQA, a comprehensive framework…

计算机视觉与模式识别 · 计算机科学 2025-10-28 Hai-Dang Nguyen , Minh-Anh Dang , Minh-Tan Le , Minh-Tuan Le

Vision-language models have demonstrated impressive capabilities in general medical visual question answering, yet due to limited interpretability, it remains unclear whether their predictions reflect evidence-grounded clinical reasoning or…

计算机视觉与模式识别 · 计算机科学 2026-05-26 Wen Ma , Fucheng Niu , Zhiting Fan , Zikai Xiao , Jiaxiang Liu , Zuozhu Liu

Vision-language models (VLMs) have recently demonstrated strong efficacy as visual assistants that can parse natural queries about the visual content and generate human-like outputs. In this work, we explore the ability of these models to…

计算与语言 · 计算机科学 2024-03-21 Yangyi Chen , Karan Sikka , Michael Cogswell , Heng Ji , Ajay Divakaran

Step-by-step verifiers -- also known as process reward models (PRMs) -- are a key ingredient for test-time scaling. PRMs require step-level supervision, making them expensive to train. This work aims to build data-efficient PRMs as…

Visual Question Answering (VQA) is a challenging task of predicting the answer to a question about the content of an image. Prior works directly evaluate the answering models by simply calculating the accuracy of predicted answers. However,…

计算机视觉与模式识别 · 计算机科学 2025-06-11 Kun Li , George Vosselman , Michael Ying Yang

Visual Question Answering (VQA) is increasingly used in diverse applications ranging from general visual reasoning to safety-critical domains such as medical imaging and autonomous systems, where models must provide not only accurate…

计算机视觉与模式识别 · 计算机科学 2025-09-23 Xingjian Diao , Weiyi Wu , Keyi Kong , Peijun Qing , Xinwen Xu , Ming Cheng , Soroush Vosoughi , Jiang Gui

As large vision language models (VLMs) advance, their capabilities in multilingual visual question answering (mVQA) have significantly improved. Chain-of-thought (CoT) reasoning has been proven to enhance interpretability and complex…

计算机视觉与模式识别 · 计算机科学 2026-04-15 Jing Huang , Zhiya Tan , Shutao Gong , Fanwei Zeng , Joey Tianyi Zhou , Changtao Miao , Huazhe Tan , Weibin Yao , Jianshu Li

Complex multi-step reasoning tasks, such as solving mathematical problems or generating code, remain a significant hurdle for even the most advanced large language models (LLMs). Verifying LLM outputs with an Outcome Reward Model (ORM) is a…

The immense diversity in the culture and culinary of Indian cuisines calls attention to the major shortcoming of the existing Visual Question Answering(VQA) systems which are inclined towards the foods from Western region. Recent attempt…

计算机视觉与模式识别 · 计算机科学 2025-11-04 Riddhi Jain , Manasi Patwardhan , Parijat Deshpande , Venkataramana Runkana

With the rapid growth of large language models (LLMs) and vision-language models (VLMs) in medicine, simply integrating clinical text and medical imaging does not guarantee reliable reasoning. Existing multimodal models often produce…

人工智能 · 计算机科学 2025-12-29 Zelin Zang , Wenyi Gu , Siqi Ma , Dan Yang , Yue Shen , Zhu Zhang , Guohui Fan , Wing-Kuen Ling , Fuji Yang

Process Reward Models (PRMs) have emerged as a promising approach to enhance the reasoning capabilities of large language models (LLMs) by guiding their step-by-step reasoning toward a final answer. However, existing PRMs either treat each…

机器学习 · 计算机科学 2026-03-02 Zheng Zhang , Ziwei Shan , Kaitao Song , Yexin Li , Kan Ren

Large multimodal reasoning models have achieved rapid progress, but their advancement is constrained by two major limitations: the absence of open, large-scale, high-quality long chain-of-thought (CoT) data, and the instability of…

计算机视觉与模式识别 · 计算机科学 2025-09-26 Sicong Leng , Jing Wang , Jiaxi Li , Hao Zhang , Zhiqiang Hu , Boqiang Zhang , Yuming Jiang , Hang Zhang , Xin Li , Lidong Bing , Deli Zhao , Wei Lu , Yu Rong , Aixin Sun , Shijian Lu

Vision--language models (VLMs) are increasingly aligned via Group Relative Policy Optimization (GRPO)-style training. However, relying solely on terminal outcome rewards yields sparse credit assignment in multi-step reasoning, weakening the…

计算机视觉与模式识别 · 计算机科学 2026-03-31 Feiding , Yongkang Zhang , Yuhao Liao , Zijian Zeng , Chunzheng Zhu , Yaozong Zheng , Yafei Liu , Yeling Peng , Youwei Wang , Sibo Wang , Huiming Yang , Linglin Liao , Shunzhi Yang

Recent advances in vision-language models (VLMs) emphasize long chain-of-thought reasoning; yet, we find that their performance on visual tasks is primarily limited by a lack of visual perception as opposed to reasoning itself. In this…

计算与语言 · 计算机科学 2026-05-20 Juncheng Wu , Hardy Chen , Haoqin Tu , Xianfeng Tang , Freda Shi , Hui Liu , Hanqing Lu , Cihang Xie , Yuyin Zhou

Medical visual question answering (Med-VQA) is a machine learning task that aims to create a system that can answer natural language questions based on given medical images. Although there has been rapid progress on the general VQA task,…

计算机视觉与模式识别 · 计算机科学 2023-09-21 Louisa Canepa , Sonit Singh , Arcot Sowmya