中文
相关论文

相关论文: OraPO: Oracle-educated Reinforcement Learning for …

200 篇论文

Reinforcement learning (RL) has become a powerful tool for post-training visual generative models, with Group Relative Policy Optimization (GRPO) increasingly used to align generators with human preferences. However, existing GRPO pipelines…

计算机视觉与模式识别 · 计算机科学 2026-05-18 Ziqi Ni , Yuanzhi Liang , Rui Li , Yi Zhou , Haibin Huang , Chi Zhang , Xuelong Li

Reinforcement Learning (RL) serves as a potent paradigm for enhancing reasoning capabilities in Large Language Models (LLMs), yet standard outcome-based approaches often suffer from reward sparsity and inefficient credit assignment. In this…

人工智能 · 计算机科学 2026-02-03 Xiangwei Wang , Wei Wang , Ken Chen , Nanduni Nimalsiri , Saman Halgamuge

Reinforcement Learning with Verifiable Rewards (RLVR) has advanced the reasoning capabilities of Large Language Models (LLMs) by leveraging direct outcome verification instead of learned reward models. Building on this paradigm, Group…

Standard reinforcement learning from human feedback (RLHF) trains a reward model on pairwise preference data and then uses it for policy optimization. However, while reward models are optimized to capture relative preferences, existing…

机器学习 · 计算机科学 2026-02-05 Kyuseong Choi , Dwaipayan Saha , Woojeong Kim , Anish Agarwal , Raaz Dwivedi

Reinforcement learning, particularly Group Relative Policy Optimization (GRPO), has emerged as an effective framework for post-training visual generative models with human preference signals. However, its effectiveness is fundamentally…

计算机视觉与模式识别 · 计算机科学 2026-04-28 Rui Li , Ke Hao , Yuanzhi Liang , Haibin Huang , Chi Zhang , Yun Gu , XueLong Li

Retrieval-Augmented Generation (RAG) expands the knowledge of Large Language Models (LLMs), yet current static retrieval methods struggle with complex, multi-hop problems. While recent dynamic retrieval strategies offer improvements, they…

计算与语言 · 计算机科学 2026-04-23 Haijian Liang , Zenghao Niu , Junjie Wu , Changwang Zhang , Wangchunshu Zhou , Jun Wang

We argue that decomposing reward into weighted, verifiable criteria and using an LLM judge to score them provides a partial-credit optimization signal: instead of a binary outcome or a single holistic score, each response is graded along…

人工智能 · 计算机科学 2026-05-11 Manish Bhattarai , Ismael Boureima , Nishath Rajiv Ranasinghe , Scott Pakin , Dan O'Malley

Recent advances in large reasoning models have leveraged reinforcement learning with verifiable rewards (RLVR) to improve reasoning capabilities. However, scaling these methods typically requires extensive rollout computation and large…

机器学习 · 计算机科学 2025-09-03 Xinyu Tang , Zhenduo Zhang , Yurou Liu , Wayne Xin Zhao , Zujie Wen , Zhiqiang Zhang , Jun Zhou

Automated radiology report generation (RRG) holds potential to reduce the workload of radiologists, and recent advances in multimodal large language models (MLLMs) have enabled multimodal chest X-ray (CXR) report generation. However,…

计算机视觉与模式识别 · 计算机科学 2026-04-21 Jonggwon Park , Byungmu Yoon , Soobum Kim , Kyoyun Choi

Radiology report generation is critical for efficiency but current models lack the structured reasoning of experts, hindering clinical trust and explainability by failing to link visual findings to precise anatomical locations. This paper…

Visual-Language-Action (VLA) models have demonstrated strong cross-scenario generalization capabilities in various robotic tasks through large-scale pre-training and task-specific fine-tuning. However, their training paradigm mainly relies…

机器人学 · 计算机科学 2025-09-30 Zengjue Chen , Runliang Niu , He Kong , Qi Wang , Qianli Xing , Zipei Fan

Reinforcement Learning with Verifiable Rewards (RLVR) has proven effective for enhancing Large Language Models (LLMs) on complex reasoning tasks. However, existing methods suffer from an exploration dilemma: the sharply peaked initial…

人工智能 · 计算机科学 2025-09-30 Yuhua Jiang , Jiawei Huang , Yufeng Yuan , Xin Mao , Yu Yue , Qianchuan Zhao , Lin Yan

Conventional Retrieval-Augmented Generation (RAG) systems often struggle with complex multi-hop queries over long documents due to their single-pass retrieval. We introduce MM-Doc-R1, a novel framework that employs an agentic, vision-aware…

Large language model (LLM)-based agents are increasingly trained with reinforcement learning (RL) to enhance their ability to interact with external environments through tool use, particularly in search-based settings that require…

计算与语言 · 计算机科学 2026-03-25 Guoqing Wang , Sunhao Dai , Guangze Ye , Zeyu Gan , Wei Yao , Yong Deng , Xiaofeng Wu , Zhenzhe Ying

Existing table understanding methods face challenges due to complex table structures and intricate logical reasoning. While supervised finetuning (SFT) dominates existing research, reinforcement learning (RL), such as Group Relative Policy…

计算与语言 · 计算机科学 2026-03-27 Xiaoqiang Kang , Shengen Wu , Zimu Wang , Yilin Liu , Xiaobo Jin , Kaizhu Huang , Wei Wang , Yutao Yue , Xiaowei Huang , Qiufeng Wang

Natural Language Processing and Generation systems have recently shown the potential to complement and streamline the costly and time-consuming job of professional fact-checkers. In this work, we lift several constraints of current…

计算与语言 · 计算机科学 2025-10-30 Daniel Russo , Stefano Menini , Jacopo Staiano , Marco Guerini

Knowledge graph question answering seeks to translate natural language questions into executable queries over knowledge graphs, but existing approaches often rely on large models or full supervision in the form of gold query annotations.…

计算与语言 · 计算机科学 2026-05-20 Jann Pfeifer , Debayan Banerjee , Ricardo Usbeck

Radiology Report Generation (RRG) is a critical step toward automating healthcare workflows, facilitating accurate patient assessments, and reducing the workload of medical professionals. Despite recent progress in Large Medical…

计算机视觉与模式识别 · 计算机科学 2026-03-16 Sarosij Bose , Ravi K. Rajendran , Biplob Debnath , Konstantinos Karydis , Amit K. Roy-Chowdhury , Srimat Chakradhar

Unsupervised speech emotion recognition (SER) focuses on addressing the problem of data sparsity and annotation bias of emotional speech. Reinforcement learning (RL) is a promising method which enhances the performance through rule-based or…

音频与语音处理 · 电气工程与系统科学 2026-02-09 Yingying Gao , Shilei Zhang , Runyan Yang , Zihao Cui , Junlan Feng

Large Language Models (LLMs) have achieved remarkable success in natural language processing tasks, with Reinforcement Learning (RL) playing a key role in adapting them to specific applications. In mathematical problem solving, however, the…

计算与语言 · 计算机科学 2026-02-02 Rihui Xin , Han Liu , Zecheng Wang , Yupeng Zhang , Dianbo Sui , Xiaolin Hu , Bingning Wang