English
Related papers

Related papers: Regulating Anatomy-Aware Rewards via Trajectory-In…

200 papers

Group Relative Policy Optimization (GRPO) has emerged as the de facto Reinforcement Learning (RL) objective driving recent advancements in Multimodal Large Language Models. However, extending this success to open-source multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Wenbo Hu , Xin Chen , Yan Gao-Tian , Yihe Deng , Nanyun Peng , Kai-Wei Chang

Vision-Language Models (VLMs) often suffer from visual hallucinations: generating things that are not consistent with visual inputs and language shortcuts, where they skip the visual part and just rely on text priors. These issues arise…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zongxia Li , Wenhao Yu , Chengsong Huang , Zhenwen Liang , Rui Liu , Fuxiao Liu , Jingxi Che , Dian Yu , Jordan Boyd-Graber , Haitao Mi , Dong Yu

Analyzing the human factors behind aviation accidents is crucial for preventing future incidents, yet traditional methods using the Human Factors Analysis and Classification System (HFACS) are limited by scalability and consistency. To…

Computation and Language · Computer Science 2025-09-01 Arash Ahmadi , Sarah Sharif , Yaser Banad

Large language models have demonstrated strong reasoning capabilities in complex tasks through tool integration, which is typically framed as a Markov Decision Process and optimized with trajectory-level RL algorithms such as GRPO. However,…

Medical Vision-Language Models (Med-VLMs) have achieved success across various tasks, yet most existing methods overlook the modality misalignment issue that can lead to untrustworthy responses in clinical settings. In this paper, we…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Songtao Jiang , Yan Zhang , Yeying Jin , Zhihang Tang , Yangyang Wu , Yang Feng , Jian Wu , Zuozhu Liu

Reinforcement Learning with Verifiable Rewards (RLVR) has markedly enhanced the reasoning abilities of large language models (LLMs). Its success, however, largely depends on strong base models with rich world knowledge, yielding only modest…

Artificial Intelligence · Computer Science 2025-08-19 Yongxin Guo , Wenbo Deng , Zhenglin Cheng , Xiaoying Tang

The task adaptation and alignment of Large Multimodal Models (LMMs) have been significantly advanced by instruction tuning and further strengthened by recent preference optimization. Yet, most LMMs still suffer from severe modality…

Machine Learning · Computer Science 2025-10-10 Chenxi Liu , Tianyi Xiong , Yanshuo Chen , Ruibo Chen , Yihan Wu , Junfeng Guo , Tianyi Zhou , Heng Huang

In precision medicine, quantitative multi-omic features, topological context, and textual biological knowledge play vital roles in identifying disease-critical signaling pathways and targets. Existing pipelines capture only part of…

Artificial Intelligence · Computer Science 2025-12-17 Heming Zhang , Di Huang , Wenyu Li , Michael Province , Yixin Chen , Philip Payne , Fuhai Li

Reinforcement learning with verifiable rewards (RLVR) has significantly advanced the reasoning ability of vision-language models (VLMs). However, the inherent text-dominated nature of VLMs often leads to insufficient visual faithfulness,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-25 Zengbin Wang , Feng Xiong , Liang Lin , Xuecai Hu , Yong Wang , Yanlin Wang , Man Zhang , Xiangxiang Chu

Despite the rapid success of Large Vision-Language Models (LVLMs), a persistent challenge is their tendency to generate hallucinated content, undermining reliability in real-world use. Existing training-free methods address hallucinations…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Neeraj Anand , Samyak Jha , Udbhav Bamba , Rahul Rahaman

Most automated peer review systems rely on textual manuscript content alone, leaving visual elements such as figures and external scholarly signals underutilized. We introduce REM-CTX, a reinforcement-learning system that incorporates…

Computation and Language · Computer Science 2026-04-02 Pawin Taechoyotin , Daniel E. Acuna

Automatic medical report generation can greatly reduce the workload of doctors, but it is often unreliable for real-world deployment. Current methods can write formally fluent sentences but may be factually flawed, introducing serious…

Computational Engineering, Finance, and Science · Computer Science 2025-12-03 Yuan Wang , Shujian Gao , Jiaxiang Liu , Songtao Jiang , Haoxiang Xia , Xiaotian Zhang , Zhaolu Kang , Yemin Wang , Zuozhu Liu

Reinforcement learning (RL) often struggles with reward misalignment, where agents optimize given rewards but fail to exhibit the desired behaviors. This arises when the reward function incentivizes proxy behaviors misaligned with the true…

Machine Learning · Computer Science 2025-09-19 Mohammad Saif Nazir , Chayan Banerjee

Multimodal Large Language Models (MLLMs) excel in vision-language reasoning but often struggle with structured perception tasks requiring precise localization and robustness. We propose a reinforcement learning framework that augments Group…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Xu Jia

Vision-language models (VLMs) have shown remarkable abilities by integrating large language models with visual inputs. However, they often fail to utilize visual evidence adequately, either depending on linguistic priors in vision-centric…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xiaojun Guo , Runyu Zhou , Yifei Wang , Qi Zhang , Chenheng Zhang , Stefanie Jegelka , Xiaohan Wang , Jiajun Chai , Guojun Yin , Wei Lin , Yisen Wang

General-purpose large Vision-Language Models (VLMs) demonstrate strong capabilities in generating detailed descriptions for natural images. However, their performance in the medical domain remains suboptimal, even for relatively…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Yifan Li , Fenghe Tang , Yingtai Li , Shaohua Kevin Zhou

Multimodal large language models (MLLMs) have achieved remarkable success in general perception, yet complex multi-step visual reasoning remains a persistent challenge. Although recent agentic approaches incorporate tool use, they often…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Zhiwei Ning , Xuanang Gao , Jiaxi Cao , Gengming Zhang , Shengnan Ma , Wenwen Tong , Hanming Deng , Jie Yang , Wei Liu

Ensuring factual consistency and reliable reasoning remains a critical challenge for medical vision-language models. We introduce MEDFACT-R1, a two-stage framework that integrates external knowledge grounding with reinforcement learning to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Gengliang Li , Rongyu Chen , Bin Li , Linlin Yang , Guodong Ding

Large language models (LLMs) hold transformative potential for medical decision support yet their application in psychiatry remains constrained by hallucinations and superficial reasoning. This limitation is particularly acute in…

In practice, reinforcement learning (RL) agents are often trained with a possibly imperfect proxy reward function, which may lead to a human-agent alignment issue (i.e., the learned policy either converges to non-optimal performance with…

Machine Learning · Computer Science 2024-10-10 Zhaohui Jiang , Xuening Feng , Paul Weng , Yifei Zhu , Yan Song , Tianze Zhou , Yujing Hu , Tangjie Lv , Changjie Fan
‹ Prev 1 4 5 6 7 8 10 Next ›