中文
相关论文

相关论文: Improving Medical Reasoning with Curriculum-Aware …

200 篇论文

Recently, reinforcement learning (RL) has been shown to greatly enhance the reasoning capabilities of large language models (LLMs), and RL-based approaches have been progressively applied to visual multimodal tasks. However, the audio…

声音 · 计算机科学 2025-05-15 Gang Li , Jizhong Liu , Heinrich Dinkel , Yadong Niu , Junbo Zhang , Jian Luan

The diagnosis of pathological images is often limited by expert availability and regional disparities, highlighting the importance of automated diagnosis using Vision-Language Models (VLMs). Traditional multimodal models typically emphasize…

计算机视觉与模式识别 · 计算机科学 2025-04-21 Jianyu Wu , Hao Yang , Xinhua Zeng , Guibing He , Zhiyu Chen , Zihui Li , Xiaochuan Zhang , Yangyang Ma , Run Fang , Yang Liu

Medical vision-language models show strong potential for joint reasoning over medical images and clinical text, but their performance often degrades under domain shift caused by variations in imaging devices, acquisition protocols, and…

机器学习 · 计算机科学 2026-02-23 Melika Filvantorkaman , Mohsen Piri

Recent advances in multimodal Reward Models (RMs) have shown significant promise in delivering reward signals to align vision models with human preferences. However, current RMs are generally restricted to providing direct responses or…

计算机视觉与模式识别 · 计算机科学 2025-10-30 Yibin Wang , Zhimin Li , Yuhang Zang , Chunyu Wang , Qinglin Lu , Cheng Jin , Jiaqi Wang

Enhancing reasoning in Large Multimodal Models (LMMs) faces unique challenges from the complex interplay between visual perception and logical reasoning, particularly in compact 3B-parameter architectures where architectural constraints…

计算与语言 · 计算机科学 2025-03-12 Yingzhe Peng , Gongrui Zhang , Miaosen Zhang , Zhiyuan You , Jie Liu , Qipeng Zhu , Kai Yang , Xingzhong Xu , Xin Geng , Xu Yang

Vision--Language Models (VLMs) show significant promise for Medical Visual Question Answering (VQA), yet their deployment in clinical settings is hindered by severe vulnerability to adversarial attacks. Standard adversarial training, while…

人工智能 · 计算机科学 2025-12-23 A. A. Gde Yogi Pramana , Jason Ray , Anthony Jaya , Michael Wijaya

Large Language Models (LLMs) have exhibited remarkable capabilities in clinical scenarios. Despite their potential, existing works face challenges when applying LLMs to medical settings. Strategies relying on training with medical datasets…

计算与语言 · 计算机科学 2025-10-10 Keer Lu , Zheng Liang , Da Pan , Shusen Zhang , Guosheng Dong , Zhonghai Wu , Huang Leng , Bin Cui , Wentao Zhang

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a powerful paradigm for enhancing the reasoning capabilities of LLMs. Existing research has predominantly concentrated on isolated reasoning domains such as mathematical…

人工智能 · 计算机科学 2025-07-24 Yu Li , Zhuoshi Pan , Honglin Lin , Mengyuan Sun , Conghui He , Lijun Wu

Embodied planning requires agents to make coherent multi-step decisions based on dynamic visual observations and natural language goals. While recent vision-language models (VLMs) excel at static perception tasks, they struggle with the…

人工智能 · 计算机科学 2025-07-15 Di Wu , Jiaxin Fan , Junzhe Zang , Guanbo Wang , Wei Yin , Wenhao Li , Bo Jin

Recently DeepSeek R1 has shown that reinforcement learning (RL) can substantially improve the reasoning capabilities of Large Language Models (LLMs) through a simple yet effective design. The core of R1 lies in its rule-based reward…

计算机视觉与模式识别 · 计算机科学 2025-04-15 Haozhan Shen , Peng Liu , Jingcheng Li , Chunxin Fang , Yibo Ma , Jiajia Liao , Qiaoli Shen , Zilun Zhang , Kangjia Zhao , Qianqian Zhang , Ruochen Xu , Tiancheng Zhao

Large language models (LLMs) have shown promise in medical question answering but often struggle with hallucinations and shallow reasoning, particularly in tasks requiring nuanced clinical understanding. Retrieval-augmented generation (RAG)…

计算与语言 · 计算机科学 2025-08-25 Ziyu Wang , Elahe Khatibi , Amir M. Rahmani

Large language models (LLMs) have achieved strong performance on medical exam-style tasks, motivating growing interest in their deployment in real-world clinical settings. However, clinical decision-making is inherently safety-critical,…

计算与语言 · 计算机科学 2026-04-13 Xiaohan Ren , Chenxiao Fan , Wenyin Ma , Hongliang He , Chongming Gao , Xiaoyan Zhao , Fuli Feng

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

人工智能 · 计算机科学 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

Effective clinical decision-making depends on iterative, multimodal reasoning across diverse sources of evidence. The recent emergence of multimodal reasoning models has significantly transformed the landscape of solving complex tasks.…

计算与语言 · 计算机科学 2025-11-04 Zhongzhen Huang , Linjie Mu , Yakun Zhu , Xiangyu Zhao , Shaoting Zhang , Xiaofan Zhang

Multimodal large language models (MLLMs) have advanced perception across text, vision, and audio, yet they often struggle with structured cross-modal reasoning, particularly when integrating audio and visual signals. We introduce…

计算机视觉与模式识别 · 计算机科学 2025-06-20 Zhenghao Xing , Xiaowei Hu , Chi-Wing Fu , Wenhai Wang , Jifeng Dai , Pheng-Ann Heng

While large language models hold promise for complex medical applications, their development is hindered by the scarcity of high-quality reasoning data. To address this issue, existing approaches typically distill chain-of-thought reasoning…

机器学习 · 计算机科学 2026-04-14 Haolin Li , Shuyang Jiang , Ruipeng Zhang , Jiangchao Yao , Ya Zhang , Yanfeng Wang

Reinforcement learning (RL) is often credited with improving language model reasoning and generalization at the expense of degrading memorized knowledge. We challenge this narrative by observing that RL-enhanced models consistently…

计算与语言 · 计算机科学 2025-11-11 Renfei Zhang , Manasa Kaniselvan , Niloofar Mireshghallah

Reinforcement Learning has significantly advanced the reasoning capabilities of Multimodal Large Language Models (MLLMs), yet the resulting policies remain brittle against real-world visual degradations such as blur, compression artifacts,…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Rui Liu , Dian Yu , Haolin Liu , Yucheng Shi , Tong Zheng , Runpeng Dai , Haitao Mi , Pratap Tokekar , Leoweiliang

Reinforcement Learning Finetuning (RFT) has significantly advanced the reasoning capabilities of large language models (LLMs) by enabling long chains of thought, self-correction, and effective tool use. While recent works attempt to extend…

While chain-of-thought (CoT) reasoning has substantially improved multimodal large language models (MLLMs) on complex reasoning tasks, existing approaches largely rely on long textual reasoning trajectories and provide limited mechanisms…

人工智能 · 计算机科学 2026-02-10 Siqu Ou , Tianrui Wan , Zhiyuan Zhao , Junyu Gao , Xuelong Li