中文
相关论文

相关论文: Improving Medical VQA through Trajectory-Aware Pro…

200 篇论文

Process Reward Models (PRMs) have shown promise in enhancing the mathematical reasoning capabilities of Large Language Models (LLMs) through Test-Time Scaling (TTS). However, their integration into multimodal reasoning remains largely…

计算与语言 · 计算机科学 2025-10-07 Ruilin Luo , Zhuofan Zheng , Yifan Wang , Xinzhe Ni , Zicheng Lin , Songtao Jiang , Yiyao Yu , Chufan Shi , Lei Wang , Ruihang Chu , Jin Zeng , Yujiu Yang

Large Language Models (LLMs) with extended reasoning capabilities often generate verbose and redundant reasoning traces, incurring unnecessary computational cost. While existing reinforcement learning approaches address this by optimizing…

人工智能 · 计算机科学 2026-03-19 Chengwei Wei , Jung-jae Kim , Longyin Zhang , Shengkai Chen , Nancy F. Chen

Large language models (LLMs) show promise for diagnostic reasoning but often lack reliable, knowledge grounded inference. Knowledge graphs (KGs), such as the Unified Medical Language System (UMLS), offer structured biomedical knowledge that…

计算与语言 · 计算机科学 2025-09-24 Saksham Khatwani , He Cheng , Majid Afshar , Dmitriy Dligach , Yanjun Gao

The advancement of Chain-of-Thought (CoT) reasoning has significantly enhanced the capabilities of large language models (LLMs) and large vision-language models (LVLMs). However, a rigorous evaluation framework for video CoT reasoning…

计算机视觉与模式识别 · 计算机科学 2025-04-11 Yukun Qi , Yiming Zhao , Yu Zeng , Xikun Bao , Wenxuan Huang , Lin Chen , Zehui Chen , Jie Zhao , Zhongang Qi , Feng Zhao

Multimodal large reasoning models (MLRMs) are increasingly deployed for vision-language tasks that produce explicit intermediate rationales. However, reasoning traces can contain unsafe content even when the final answer is non-harmful,…

计算机视觉与模式识别 · 计算机科学 2025-11-27 Yuxiao Xiang , Junchi Chen , Zhenchao Jin , Changtao Miao , Haojie Yuan , Qi Chu , Tao Gong , Nenghai Yu

Vision-language process reward models (VL-PRMs) are increasingly used to score intermediate reasoning steps and rerank candidates under test-time scaling. However, they often function as black-box judges: a low step score may reflect a…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Junxin Wang , Dai Guan , Weijie Qiu , Zhihang Li , Yongbo Gai , Zhengyi Yang , Mengyu Zhou , Erchao Zhao , Xiaoxi Jiang , Guanjun Jiang

Methods for Visual Question Anwering (VQA) are notorious for leveraging dataset biases rather than performing reasoning, hindering generalization. It has been recently shown that better reasoning patterns emerge in attention layers of a…

计算机视觉与模式识别 · 计算机科学 2021-06-11 Corentin Kervadec , Christian Wolf , Grigory Antipov , Moez Baccouche , Madiha Nadri

A promising approach for improving reasoning in large language models is to use process reward models (PRMs). PRMs provide feedback at each step of a multi-step reasoning trace, potentially improving credit assignment over outcome reward…

This study investigates the spatial reasoning capabilities of vision-language models (VLMs) through Chain-of-Thought (CoT) prompting and reinforcement learning. We begin by evaluating the impact of different prompting strategies and find…

计算机视觉与模式识别 · 计算机科学 2025-07-21 Binbin Ji , Siddharth Agrawal , Qiance Tang , Yvonne Wu

Vision-Language Models (VLMs) often suffer from visual hallucinations: generating things that are not consistent with visual inputs and language shortcuts, where they skip the visual part and just rely on text priors. These issues arise…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Zongxia Li , Wenhao Yu , Chengsong Huang , Zhenwen Liang , Rui Liu , Fuxiao Liu , Jingxi Che , Dian Yu , Jordan Boyd-Graber , Haitao Mi , Dong Yu

Visual reasoning models (VRMs) have recently shown strong cross-modal reasoning capabilities by integrating visual perception with language reasoning. However, they often suffer from overthinking, producing unnecessarily long reasoning…

计算机视觉与模式识别 · 计算机科学 2026-04-17 Yixu Huang , Tinghui Zhu , Muhao Chen

Current visual evaluation approaches are typically constrained to a single task. To address this, we propose OmniQuality-R, a unified reward modeling framework that transforms multi-task quality reasoning into continuous and interpretable…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Yiting Lu , Fengbin Guan , Yixin Gao , Yan Zhong , Xinge Peng , Jiakang Yuan , Yihao Liu , Bo Zhang , Xin Li , Zhibo Chen , Weisi Lin

While Small Language Models (SLMs) have demonstrated promising performance on an increasingly wide array of commonsense reasoning benchmarks, current evaluation practices rely almost exclusively on the accuracy of their final answers,…

计算与语言 · 计算机科学 2026-04-21 Francesco Maria Molfese , Luca Moroni , Ciro Porcaro , Simone Conia , Roberto Navigli

Generating high-quality Scalable Vector Graphics (SVGs) is challenging for Large Language Models (LLMs), as it requires advanced reasoning for structural validity, semantic accuracy, and visual coherence -- areas where current LLMs often…

计算机视觉与模式识别 · 计算机科学 2026-04-10 Ximing Xing , Ziteng Xue , Yandong Guan , Jing Zhang , Dong Xu , Qian Yu

Predicting cancer treatment outcomes requires models that are both accurate and interpretable, particularly in the presence of heterogeneous clinical data. While large language models (LLMs) have shown strong performance in biomedical NLP,…

计算与语言 · 计算机科学 2025-10-21 Raghu Vamshi Hemadri , Geetha Krishna Guruju , Kristi Topollai , Anna Ewa Choromanska

Interpretability is significant in computational pathology, leading to the development of multimodal information integration from histopathological image and corresponding text data.However, existing multimodal methods have limited…

计算机视觉与模式识别 · 计算机科学 2026-01-22 Kangcheng Zhou , Jun Jiang , Qing Zhang , Shuang Zheng , Qingli Li , Shugong Xu

We introduce MediX-R1, an open-ended Reinforcement Learning (RL) framework for medical multimodal large language models (MLLMs) that enables clinically grounded, free-form answers beyond multiple-choice formats. MediX-R1 fine-tunes a…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Sahal Shaji Mullappilly , Mohammed Irfan Kurpath , Omair Mohamed , Mohamed Zidan , Fahad Khan , Salman Khan , Rao Anwer , Hisham Cholakkal

Recent advancements in deep learning have led to the development of powerful language models (LMs) that excel in various tasks. Despite these achievements, there is still room for improvement, particularly in enhancing reasoning abilities…

计算与语言 · 计算机科学 2023-12-27 Abhinav Arun , Dipendra Singh Mal , Mehul Soni , Tomohiro Sawada

High-quality and carefully curated data is a cornerstone of training medical large language models, as it directly impacts both generalization and robustness to unseen clinical tasks. We investigate strategies for training and data curation…

人工智能 · 计算机科学 2025-12-01 Timothy Ossowski , Sheng Zhang , Qianchu Liu , Guanghui Qin , Reuben Tan , Tristan Naumann , Junjie Hu , Hoifung Poon

Enhancing the multimodal reasoning capabilities of Multimodal Large Language Models (MLLMs) is a challenging task that has attracted increasing attention in the community. Recently, several studies have applied Reinforcement Learning with…

机器学习 · 计算机科学 2026-03-04 Tong Xiao , Xin Xu , Zhenya Huang , Hongyu Gao , Quan Liu , Qi Liu , Enhong Chen