English
Related papers

Related papers: Learning Ordinal Probabilistic Reward from Prefere…

200 papers

Mathematical reasoning in large language models has improved substantially with reinforcement learning using verifiable rewards, where final answers can be checked automatically and converted into reliable training signals. Most such…

Machine Learning · Computer Science 2026-04-06 Mohammad Rezaei , Jens Lehmann , Sahar Vahdati

Reward models (RMs) play a pivotal role in aligning large language models (LLMs) with human preferences. However, traditional RM training, which relies on response pairs tied to specific prompts, struggles to disentangle prompt-driven…

Reinforcement learning from human feedback (RLHF) has become a key method for aligning large language models (LLMs) with human preferences through the use of reward models. However, traditional reward models typically generate point…

Machine Learning · Computer Science 2024-09-17 Nicolai Dorka

Preference-based Reinforcement Learning (PbRL) provides a way to learn high-performance policies in environments where the reward signal is hard to specify, avoiding heuristic and time-consuming reward design. However, PbRL can suffer from…

Machine Learning · Computer Science 2025-07-02 Chenyang Cao , Miguel Rogel-García , Mohamed Nabail , Xueqian Wang , Nicholas Rhinehart

Reward models (RMs) are essential for aligning large language models (LLM) with human expectations. However, existing RMs struggle to capture the stochastic and uncertain nature of human preferences and fail to assess the reliability of…

Machine Learning · Computer Science 2025-02-13 Xingzhou Lou , Dong Yan , Wei Shen , Yuzi Yan , Jian Xie , Junge Zhang

The alignment of Large Language Models (LLMs) utilizes Reinforcement Learning from AI Feedback (RLAIF) for non-verifiable domains such as long-form question answering and open-ended instruction following. These domains often rely on LLM…

Machine Learning · Computer Science 2026-05-18 Nirmal Patel , Fei Wang , Inderjit S. Dhillon

Reinforcement learning with human feedback for aligning large language models (LLMs) trains a reward model typically using ranking loss with comparison pairs.However, the training procedure suffers from an inherent problem: the uncontrolled…

Computation and Language · Computer Science 2024-09-19 Hang Zhou , Chenglong Wang , Yimin Hu , Tong Xiao , Chunliang Zhang , Jingbo Zhu

Reward modeling is essential for aligning Large Language Models(LLMs) with human preferences, yet conventional reward models suffer from poor interpretability and heavy reliance on costly expert annotations. While recent rubric-based…

Artificial Intelligence · Computer Science 2026-03-10 Dengcan Liu , Fengkai Yang , Xiaohan Wang , Shurui Yan , Jiajun Chai , Jiahao Li , Yikun Ban , Zhendong Mao , Wei Lin , Guojun Yin

Process Reward Models (PRMs) have emerged as a powerful tool for providing step-level feedback when evaluating the reasoning of Large Language Models (LLMs), which frequently produce chains of thought (CoTs) containing errors even when the…

Computation and Language · Computer Science 2026-04-21 Raffaele Pisano , Roberto Navigli

Large language models (LLMs) have shown promise in performing complex multi-step reasoning, yet they continue to struggle with mathematical reasoning, often making systematic errors. A promising solution is reinforcement learning (RL)…

Machine Learning · Computer Science 2025-09-22 Hanning Zhang , Pengcheng Wang , Shizhe Diao , Yong Lin , Rui Pan , Hanze Dong , Dylan Zhang , Pavlo Molchanov , Tong Zhang

Reward-based fine-tuning steers a pretrained diffusion or flow-based generative model toward higher-reward samples while remaining close to the pretrained model. Although existing methods are derived from different perspectives, we show…

Machine Learning · Computer Science 2026-05-08 Jeongjae Lee , Jinho Chang , Jeongsol Kim , Jong Chul Ye

The reward model (RM) plays a crucial role in aligning Large Language Models (LLMs) with human preferences through Reinforcement Learning, where the Bradley-Terry (BT) objective has been recognized as simple yet powerful, specifically for…

Machine Learning · Computer Science 2025-10-14 Zhuo Li , Yuege Feng , Dandan Guo , Jinpeng Hu , Anningzhe Gao , Xiang Wan

Large Language Models (LLMs) are increasingly relied upon for solving complex reasoning tasks in domains such as mathematics, logic, and multi-step question answering. A growing line of work seeks to improve reasoning quality by scaling…

Machine Learning · Computer Science 2025-08-05 Seyyed Saeid Cheshmi , Azal Ahmad Khan , Xinran Wang , Zirui Liu , Ali Anwar

Reward models are critical for reinforcement learning from human feedback, as they determine the alignment quality and reliability of generative models. For complex tasks such as image editing, reward models are required to capture global…

Process Reward Modeling (PRM) is critical for complex reasoning and decision-making tasks where the accuracy of intermediate steps significantly influences the overall outcome. Existing PRM approaches, primarily framed as classification…

Computation and Language · Computer Science 2025-02-12 Wendi Li , Yixuan Li

Large Language Models (LLMs) increasingly rely on external tools such as search engines to solve complex agentic tasks that require reasoning and external knowledge retrieval. Recently, reinforcement learning with verifiable rewards (RLVR)…

Artificial Intelligence · Computer Science 2025-10-01 Peiran Xu , Zhuohao Li , Xiaoying Xing , Guannan Zhang , Debiao Li , Kunyu Shi

Process Reward Models (PRMs), which assign fine-grained scores to intermediate reasoning steps within a solution trajectory, have emerged as a promising approach to enhance the reasoning quality of Large Language Models (LLMs). However,…

Computation and Language · Computer Science 2026-01-07 Lingyin Zhang , Jun Gao , Xiaoxue Ren , Ziqiang Cao

While large language models (LLMs) have significantly advanced mathematical reasoning, Process Reward Models (PRMs) have been developed to evaluate the logical validity of reasoning steps. However, PRMs still struggle with…

Artificial Intelligence · Computer Science 2025-02-21 Jiachen Zhu , Congmin Zheng , Jianghao Lin , Kounianhua Du , Ying Wen , Yong Yu , Jun Wang , Weinan Zhang

Process Reward Models (PRMs) emerge as a promising approach for process supervision in mathematical reasoning of Large Language Models (LLMs), which aim to identify and mitigate intermediate errors in the reasoning processes. However, the…

Computation and Language · Computer Science 2025-06-06 Zhenru Zhang , Chujie Zheng , Yangzhen Wu , Beichen Zhang , Runji Lin , Bowen Yu , Dayiheng Liu , Jingren Zhou , Junyang Lin

Different from its counterpart outcome reward models (ORMs), which evaluate the entire responses, a process reward model (PRM) scores a reasoning trajectory step by step, providing denser and more fine grained rewards. However, training a…

Machine Learning · Computer Science 2024-12-04 Lifan Yuan , Wendi Li , Huayu Chen , Ganqu Cui , Ning Ding , Kaiyan Zhang , Bowen Zhou , Zhiyuan Liu , Hao Peng