English
Related papers

Related papers: OraPO: Oracle-educated Reinforcement Learning for …

200 papers

Reinforcement learning (RL) has become a powerful tool for post-training visual generative models, with Group Relative Policy Optimization (GRPO) increasingly used to align generators with human preferences. However, existing GRPO pipelines…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Ziqi Ni , Yuanzhi Liang , Rui Li , Yi Zhou , Haibin Huang , Chi Zhang , Xuelong Li

Reinforcement Learning (RL) serves as a potent paradigm for enhancing reasoning capabilities in Large Language Models (LLMs), yet standard outcome-based approaches often suffer from reward sparsity and inefficient credit assignment. In this…

Artificial Intelligence · Computer Science 2026-02-03 Xiangwei Wang , Wei Wang , Ken Chen , Nanduni Nimalsiri , Saman Halgamuge

Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capabilities of Large Language Models (LLMs) by leveraging direct outcome verification instead of learned reward models. Building on this paradigm, Group…

Machine Learning · Computer Science 2026-04-23 Jingyi Wang , Lei Zhu , Tengjin Weng , Song-Li Wu , Haochen Tan , Jierun Chen , Chaofan Tao , Haoli Bai , Lu Hou , Lifeng Shang , Xiao-Ping Zhang

Standard reinforcement learning from human feedback (RLHF) trains a reward model on pairwise preference data and then uses it for policy optimization. However, while reward models are optimized to capture relative preferences, existing…

Machine Learning · Computer Science 2026-02-05 Kyuseong Choi , Dwaipayan Saha , Woojeong Kim , Anish Agarwal , Raaz Dwivedi

Reinforcement learning, particularly Group Relative Policy Optimization (GRPO), has emerged as an effective framework for post-training visual generative models with human preference signals. However, its effectiveness is fundamentally…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Rui Li , Ke Hao , Yuanzhi Liang , Haibin Huang , Chi Zhang , Yun Gu , XueLong Li

Retrieval-Augmented Generation (RAG) expands the knowledge of Large Language Models (LLMs), yet current static retrieval methods struggle with complex, multi-hop problems. While recent dynamic retrieval strategies offer improvements, they…

Computation and Language · Computer Science 2026-04-23 Haijian Liang , Zenghao Niu , Junjie Wu , Changwang Zhang , Wangchunshu Zhou , Jun Wang

We argue that decomposing reward into weighted, verifiable criteria and using an LLM judge to score them provides a partial-credit optimization signal: instead of a binary outcome or a single holistic score, each response is graded along…

Artificial Intelligence · Computer Science 2026-05-11 Manish Bhattarai , Ismael Boureima , Nishath Rajiv Ranasinghe , Scott Pakin , Dan O'Malley

Recent advances in large reasoning models have leveraged reinforcement learning with verifiable rewards (RLVR) to improve reasoning capabilities. However, scaling these methods typically requires extensive rollout computation and large…

Machine Learning · Computer Science 2025-09-03 Xinyu Tang , Zhenduo Zhang , Yurou Liu , Wayne Xin Zhao , Zujie Wen , Zhiqiang Zhang , Jun Zhou

Automated radiology report generation (RRG) holds potential to reduce the workload of radiologists, and recent advances in multimodal large language models (MLLMs) have enabled multimodal chest X-ray (CXR) report generation. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Jonggwon Park , Byungmu Yoon , Soobum Kim , Kyoyun Choi

Radiology report generation is critical for efficiency but current models lack the structured reasoning of experts, hindering clinical trust and explainability by failing to link visual findings to precise anatomical locations. This paper…

Artificial Intelligence · Computer Science 2026-03-03 Peiyuan Jing , Kinhei Lee , Zhenxuan Zhang , Huichi Zhou , Zhengqing Yuan , Zhifan Gao , Lei Zhu , Giorgos Papanastasiou , Yingying Fang , Guang Yang

Visual-Language-Action (VLA) models have demonstrated strong cross-scenario generalization capabilities in various robotic tasks through large-scale pre-training and task-specific fine-tuning. However, their training paradigm mainly relies…

Robotics · Computer Science 2025-09-30 Zengjue Chen , Runliang Niu , He Kong , Qi Wang , Qianli Xing , Zipei Fan

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for enhancing Large Language Models (LLMs) on complex reasoning tasks. However, existing methods suffer from an exploration dilemma: the sharply peaked initial…

Artificial Intelligence · Computer Science 2025-09-30 Yuhua Jiang , Jiawei Huang , Yufeng Yuan , Xin Mao , Yu Yue , Qianchuan Zhao , Lin Yan

Conventional Retrieval-Augmented Generation (RAG) systems often struggle with complex multi-hop queries over long documents due to their single-pass retrieval. We introduce MM-Doc-R1, a novel framework that employs an agentic, vision-aware…

Computation and Language · Computer Science 2026-04-16 Jiahang Lin , Kai Hu , Binghai Wang , Yuhao Zhou , Zhiheng Xi , Honglin Guo , Shichun Liu , Junzhe Wang , Shihan Dou , Enyu Zhou , Hang Yan , Zhenhua Han , Tao Gui , Qi Zhang , Xuanjing Huang

Large language model (LLM)-based agents are increasingly trained with reinforcement learning (RL) to enhance their ability to interact with external environments through tool use, particularly in search-based settings that require…

Computation and Language · Computer Science 2026-03-25 Guoqing Wang , Sunhao Dai , Guangze Ye , Zeyu Gan , Wei Yao , Yong Deng , Xiaofeng Wu , Zhenzhe Ying

Existing table understanding methods face challenges due to complex table structures and intricate logical reasoning. While supervised finetuning (SFT) dominates existing research, reinforcement learning (RL), such as Group Relative Policy…

Computation and Language · Computer Science 2026-03-27 Xiaoqiang Kang , Shengen Wu , Zimu Wang , Yilin Liu , Xiaobo Jin , Kaizhu Huang , Wei Wang , Yutao Yue , Xiaowei Huang , Qiufeng Wang

Natural Language Processing and Generation systems have recently shown the potential to complement and streamline the costly and time-consuming job of professional fact-checkers. In this work, we lift several constraints of current…

Computation and Language · Computer Science 2025-10-30 Daniel Russo , Stefano Menini , Jacopo Staiano , Marco Guerini

Knowledge graph question answering seeks to translate natural language questions into executable queries over knowledge graphs, but existing approaches often rely on large models or full supervision in the form of gold query annotations.…

Computation and Language · Computer Science 2026-05-20 Jann Pfeifer , Debayan Banerjee , Ricardo Usbeck

Radiology Report Generation (RRG) is a critical step toward automating healthcare workflows, facilitating accurate patient assessments, and reducing the workload of medical professionals. Despite recent progress in Large Medical…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Sarosij Bose , Ravi K. Rajendran , Biplob Debnath , Konstantinos Karydis , Amit K. Roy-Chowdhury , Srimat Chakradhar

Unsupervised speech emotion recognition (SER) focuses on addressing the problem of data sparsity and annotation bias of emotional speech. Reinforcement learning (RL) is a promising method which enhances the performance through rule-based or…

Audio and Speech Processing · Electrical Eng. & Systems 2026-02-09 Yingying Gao , Shilei Zhang , Runyan Yang , Zihao Cui , Junlan Feng

Large Language Models (LLMs) have achieved remarkable success in natural language processing tasks, with Reinforcement Learning (RL) playing a key role in adapting them to specific applications. In mathematical problem solving, however, the…

Computation and Language · Computer Science 2026-02-02 Rihui Xin , Han Liu , Zecheng Wang , Yupeng Zhang , Dianbo Sui , Xiaolin Hu , Bingning Wang