English
Related papers

Related papers: Scaling Reward Modeling without Human Supervision

200 papers

Evaluating instruction-guided image edits requires rewards that reflect subtle human preferences, yet current reward models typically depend on large-scale preference annotation and additional model training. This creates a data-efficiency…

Reward modeling is crucial for aligning large language models with human preferences, yet current approaches lack a principled mathematical framework for leveraging ordinal preference data. When human annotators provide graded preferences…

Machine Learning · Computer Science 2026-03-04 Amirhossein Afsharrad , Ruida Zhou , Luca Viano , Sanjay Lall , Mohammad Ghavamzadeh

Reinforcement learning from human feedback (RLHF) has proven effective in aligning large language models with human preferences, inspiring the development of reward-centric diffusion reinforcement learning (RDRL) to achieve similar…

Machine Learning · Computer Science 2026-03-24 Kwanyoung Kim , Byeongsu Sim

Specifying reward signals that allow agents to learn complex behaviors is a long-standing challenge in reinforcement learning. A promising approach is to extract preferences for behaviors from unlabeled videos, which are widely available on…

Learning a reward function from human preferences is challenging as it typically requires having a high-fidelity simulator or using expensive and potentially unsafe actual physical rollouts in the environment. However, in many tasks the…

Machine Learning · Computer Science 2023-01-05 Daniel Shin , Anca D. Dragan , Daniel S. Brown

Reinforcement learning with human-annotated data has boosted chain-of-thought reasoning in large reasoning models, but these gains come at high costs in labeled data while faltering on harder tasks. A natural next step is experience-driven…

Computation and Language · Computer Science 2025-10-03 Zhaoning Yu , Will Su , Leitian Tao , Haozhu Wang , Aashu Singh , Hanchao Yu , Jianyu Wang , Hongyang Gao , Weizhe Yuan , Jason Weston , Ping Yu , Jing Xu

Reward models (RMs) are crucial for the training of large language models (LLMs), yet they typically rely on large-scale human-annotated preference pairs. With the widespread deployment of LLMs, in-the-wild interactions have emerged as a…

Computation and Language · Computer Science 2026-02-10 Hao Peng , Yunjia Qi , Xiaozhi Wang , Zijun Yao , Lei Hou , Juanzi Li

Rubric-based rewards offer a promising way to extend reinforcement learning (RL) for large language models beyond tasks with automatically verifiable answers. However, scaling rubric-based RL remains challenging: existing approaches often…

Computation and Language · Computer Science 2026-05-26 Xiaoyuan Li , Keqin Bao , Moxin Li , Yubo Ma , Yichang Zhang , Wenjie Wang , Fuli Feng , Dayiheng Liu

In offline reinforcement learning (RL) agents are trained using a logged dataset. It appears to be the most natural route to attack real-life applications because in domains such as healthcare and robotics interactions with the environment…

Machine Learning · Computer Science 2020-12-15 Ksenia Konyushkova , Konrad Zolna , Yusuf Aytar , Alexander Novikov , Scott Reed , Serkan Cabi , Nando de Freitas

This paper is an extended version of [Burashnikova et al., 2021, arXiv: 2012.06910], where we proposed a theoretically supported sequential strategy for training a large-scale Recommender System (RS) over implicit feedback, mainly in the…

Information Retrieval · Computer Science 2022-03-01 Aleksandra Burashnikova , Yury Maximov , Marianne Clausel , Charlotte Laclau , Franck Iutzeler , Massih-Reza Amini

Learning from human feedback is an effective way to improve robotic learning in exploration-heavy tasks. Compared to the wide application of binary human feedback, scalar human feedback has been used less because it is believed to be noisy…

Robotics · Computer Science 2025-12-15 Hang Yu , Reuben M. Aronson , Katherine H. Allen , Elaine Schaertl Short

Reinforcement learning algorithms rely on carefully engineering environment rewards that are extrinsic to the agent. However, annotating each environment with hand-designed, dense rewards is not scalable, motivating the need for developing…

Machine Learning · Computer Science 2018-08-14 Yuri Burda , Harri Edwards , Deepak Pathak , Amos Storkey , Trevor Darrell , Alexei A. Efros

Training large language models with reinforcement learning (RL) against verifiable rewards significantly enhances their reasoning abilities, yet remains computationally expensive due to inefficient uniform prompt sampling. We introduce…

Machine Learning · Computer Science 2026-03-06 Ruiqi Zhang , Daman Arora , Song Mei , Andrea Zanette

Recent alignment techniques, such as reinforcement learning from human feedback, have been widely adopted to align large language models with human preferences by learning and leveraging reward models. In practice, these models often…

Machine Learning · Computer Science 2025-10-29 Ignavier Ng , Patrick Blöbaum , Siddharth Bhandari , Kun Zhang , Shiva Kasiviswanathan

Diffusion large language models (dLLMs) have shown great potential in large-scale language modeling, and there is an increasing interest in further improving the capacity to solve complex problems by guiding the reasoning process step by…

Computation and Language · Computer Science 2025-10-01 Tianlang Chen , Minkai Xu , Jure Leskovec , Stefano Ermon

Reward Models (RMs) are critical for improving generation models via Reinforcement Learning (RL), yet the RM scaling paradigm in visual generation remains largely unexplored. It primarily due to fundamental limitations in existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-11 Jie Wu , Yu Gao , Zilyu Ye , Ming Li , Liang Li , Hanzhong Guo , Jie Liu , Zeyue Xue , Xiaoxia Hou , Wei Liu , Yan Zeng , Weilin Huang

Conveying complex objectives to reinforcement learning (RL) agents often requires meticulous reward engineering. Preference-based RL methods are able to learn a more flexible reward model based on human preferences by actively incorporating…

Machine Learning · Computer Science 2022-05-26 Xinran Liang , Katherine Shu , Kimin Lee , Pieter Abbeel

Offline reinforcement learning (RL) provides a powerful framework for training robotic agents using pre-collected, suboptimal datasets, eliminating the need for costly, time-consuming, and potentially hazardous online interactions. This is…

Machine Learning · Computer Science 2025-08-01 Tung M. Luu , Donghoon Lee , Younghwan Lee , Chang D. Yoo

Reward-free data is abundant and contains rich prior knowledge of human behaviors, but it is not well exploited by offline reinforcement learning (RL) algorithms. In this paper, we propose UBER, an unsupervised approach to extract useful…

Machine Learning · Computer Science 2023-10-31 Hao Hu , Yiqin Yang , Jianing Ye , Ziqing Mai , Chongjie Zhang

Aligning language models (LMs) based on human-annotated preference data is a crucial step in obtaining practical and performant LM-based systems. However, multilingual human preference data are difficult to obtain at scale, making it…

Computation and Language · Computer Science 2024-10-15 Zhaofeng Wu , Ananth Balashankar , Yoon Kim , Jacob Eisenstein , Ahmad Beirami