English
Related papers

Related papers: VRPO: Rethinking Value Modeling for Robust RL Trai…

200 papers

Reinforcement Learning from Human Feedback (RLHF) has achieved considerable success in aligning large language models (LLMs) by modeling human preferences with a learnable reward model and employing a reinforcement learning algorithm to…

Machine Learning · Computer Science 2025-05-20 Jianfeng Cai , Jinhua Zhu , Ruopei Sun , Yue Wang , Li Li , Wengang Zhou , Houqiang Li

Sample efficiency is critical for online Reinforcement Learning from Human Feedback (RLHF). While existing works investigate sample-efficient online exploration strategies, the potential of utilizing misspecified yet relevant reward models…

Machine Learning · Computer Science 2025-05-20 Jiawei Huang , Bingcong Li , Christoph Dann , Niao He

Reinforcement learning (RL) has emerged as a powerful framework for improving the reasoning capabilities of large language models (LLMs). However, most existing RL approaches rely on sparse outcome rewards, which fail to credit correct…

Machine Learning · Computer Science 2026-01-28 Haolin Liu , Dian Yu , Sidi Lu , Yujun Zhou , Rui Liu , Zhenwen Liang , Haitao Mi , Chen-Yu Wei , Dong Yu

Reward inference (learning a reward model from human preferences) is a critical intermediate step in the Reinforcement Learning from Human Feedback (RLHF) pipeline for fine-tuning Large Language Models (LLMs). In practice, RLHF faces…

Machine Learning · Computer Science 2025-03-04 Qining Zhang , Lei Ying

Reinforcement learning from human feedback (RLHF) has become the leading approach for fine-tuning large language models (LLM). However, RLHF has limitations in multi-task learning (MTL) due to challenges of reward hacking and extreme…

Reinforcement Learning from Human Feedback (RLHF) is currently the most widely used method to align large language models (LLMs) with human preferences. Existing RLHF methods can be roughly categorized as either reward-based or reward-free.…

Computation and Language · Computer Science 2024-10-11 Shusheng Xu , Wei Fu , Jiaxuan Gao , Wenjie Ye , Weilin Liu , Zhiyu Mei , Guangju Wang , Chao Yu , Yi Wu

Reinforcement Learning from Human Feedback (RLHF) has shown promise in aligning large language models (LLMs). Yet its reliance on a singular reward model often overlooks the diversity of human preferences. Recent approaches address this…

Computation and Language · Computer Science 2025-07-23 Tianze Wang , Dongnan Gui , Yifan Hu , Shuhang Lin , Linjun Zhang

Large-scale alignment pipelines typically pair a policy model with a separately trained reward model whose parameters remain frozen during reinforcement learning (RL). This separation creates a complex, resource-intensive pipeline and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-24 Songshuo Lu , Hua Wang , Zhi Chen , Yaohua Tang

Using reinforcement learning with human feedback (RLHF) has shown significant promise in fine-tuning diffusion models. Previous methods start by training a reward model that aligns with human preferences, then leverage RL techniques to…

Machine Learning · Computer Science 2024-03-26 Kai Yang , Jian Tao , Jiafei Lyu , Chunjiang Ge , Jiaxin Chen , Qimai Li , Weihan Shen , Xiaolong Zhu , Xiu Li

Deep reinforcement learning (RL) methods generally engage in exploratory behavior through noise injection in the action space. An alternative is to add noise directly to the agent's parameters, which can lead to more consistent exploration…

Recent advancements in reinforcement learning, particularly through Group Relative Policy Optimization (GRPO), have significantly improved multimodal large language models for complex reasoning tasks. However, two critical limitations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Jisheng Dang , Jingze Wu , Teng Wang , Xuanhui Lin , Nannan Zhu , Hongbo Chen , Wei-Shi Zheng , Meng Wang , Tat-Seng Chua

Reinforcement learning from human feedback (RLHF) is a widely used method for aligning large language models with human preferences. However, RLHF often suffers from reward model overoptimisation, in which models overfit to the reward…

Machine Learning · Computer Science 2025-09-30 Lorenz Wolf , Robert Kirk , Mirco Musolesi

Reinforcement Learning from Human Feedback (RLHF) has shown remarkable success in aligning Large Language Models (LLMs) with human preferences. Traditional RLHF methods rely on a fixed dataset, which often suffers from limited coverage. To…

Machine Learning · Computer Science 2025-10-28 Long-Fei Li , Yu-Yang Qian , Peng Zhao , Zhi-Hua Zhou

Reinforcement learning with verifiable rewards (RLVR) is a simple but powerful paradigm for training LLMs: sample a completion, verify it, and update. In practice, however, the verifier is almost never clean--unit tests probe only limited…

Machine Learning · Computer Science 2026-01-09 Ali Rad , Khashayar Filom , Darioush Keivan , Peyman Mohajerin Esfahani , Ehsan Kamalinejad

Reinforcement Learning with Verifiable Rewards (RLVR) significantly enhances the reasoning capability of Large Language Models (LLMs). Current RLVR approaches typically conduct training across all generated tokens, but neglect to explore…

Computation and Language · Computer Science 2025-12-18 Yiliu Sun , Zicheng Zhao , Yang Wei , Yanfang Zhang , Chen Gong

Post-training has become a crucial step for unlocking the capabilities of large language models, with reinforcement learning (RL) emerging as a critical paradigm. Recent RL-based post-training has increasingly split into two paradigms:…

Machine Learning · Computer Science 2026-05-18 Shangjian Yin , Yu Fu , Yue Dong , Zhouxing Shi

While Reinforcement Learning from Human Feedback (RLHF) has become a pivotal paradigm for text-to-image generation, its application to image editing remains largely unexplored. A key bottleneck is the lack of a robust general reward model…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Hanzhong Guo , Jie Wu , Jie Liu , Yu Gao , Zilyu Ye , Linxiao Yuan , Xionghui Wang , Yizhou Yu , Weilin Huang

Proximal Policy Optimization (PPO)-based reinforcement learning from human feedback (RLHF) is a widely adopted paradigm for aligning large language models (LLMs) with human preferences. However, its training pipeline suffers from…

Machine Learning · Computer Science 2026-03-06 Kaizhuo Yan , Yingjie Yu , Yifan Yu , Haizhong Zheng , Fan Lai

Reinforcement learning has emerged as a powerful paradigm for post-training large language models (LLMs) to improve reasoning. Approaches like Reinforcement Learning from Human Feedback (RLHF) and Reinforcement Learning with Verifiable…

Machine Learning · Computer Science 2025-06-26 Yanzhi Zhang , Zhaoxi Zhang , Haoxiang Guan , Yilin Cheng , Yitong Duan , Chen Wang , Yue Wang , Shuxin Zheng , Jiyan He

The diversity of contexts in which large language models (LLMs) are deployed requires the ability to modify or customize default model behaviors to incorporate nuanced requirements and preferences. A convenient interface to specify such…

Machine Learning · Computer Science 2024-02-19 Moritz Stephan , Alexander Khazatsky , Eric Mitchell , Annie S Chen , Sheryl Hsu , Archit Sharma , Chelsea Finn