中文
相关论文

相关论文: The End of Reward Engineering: How LLMs Are Redefi…

200 篇论文

Reward design plays a pivotal role in aligning large language models (LLMs) with human values, serving as the bridge between feedback signals and model optimization. This survey provides a structured organization of reward modeling and…

计算与语言 · 计算机科学 2025-09-03 Miaomiao Ji , Yanqiu Wu , Zhibin Wu , Shoujin Wang , Jian Yang , Mark Dras , Usman Naseem

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

机器学习 · 计算机科学 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Designing effective reward functions is crucial to training reinforcement learning (RL) algorithms. However, this design is non-trivial, even for domain experts, due to the subjective nature of certain tasks that are hard to quantify…

神经与进化计算 · 计算机科学 2025-05-26 Rishi Hazra , Alkis Sygkounas , Andreas Persson , Amy Loutfi , Pedro Zuidberg Dos Martires

Mathematical reasoning is a central challenge for large language models (LLMs), requiring not only correct answers but also faithful reasoning processes. Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising…

机器学习 · 计算机科学 2025-12-02 Md Tanvirul Alam , Nidhi Rastogi

Reward engineering has long been a challenge in Reinforcement Learning (RL) research, as it often requires extensive human effort and iterative processes of trial-and-error to design effective reward functions. In this paper, we propose…

机器人学 · 计算机科学 2024-06-18 Yufei Wang , Zhanyi Sun , Jesse Zhang , Zhou Xian , Erdem Biyik , David Held , Zackory Erickson

Reinforcement Learning (RL) in games has gained significant momentum in recent years, enabling the creation of different agent behaviors that can transform a player's gaming experience. However, deploying RL agents in production…

人工智能 · 计算机科学 2025-07-01 António Afonso , Iolanda Leite , Alessandro Sestini , Florian Fuchs , Konrad Tollmar , Linus Gisslén

Reinforcement Learning from Verifiable Rewards (RLVR) has been widely adopted as the de facto method for enhancing the reasoning capabilities of large language models and has demonstrated notable success in verifiable domains like math and…

计算与语言 · 计算机科学 2025-06-24 Jeff Da , Clinton Wang , Xiang Deng , Yuntao Ma , Nikhil Barhate , Sean Hendryx

Although Deep Reinforcement Learning (DRL) has achieved notable success in numerous robotic applications, designing a high-performing reward function remains a challenging task that often requires substantial manual input. Recently, Large…

机器人学 · 计算机科学 2023-10-03 Jiayang Song , Zhehua Zhou , Jiawei Liu , Chunrong Fang , Zhan Shu , Lei Ma

Large Language Models (LLMs) have made substantial strides in structured tasks through Reinforcement Learning (RL), demonstrating proficiency in mathematical reasoning and code generation. However, applying RL in broader domains like…

计算与语言 · 计算机科学 2025-02-10 Hao Sun , Yunyi Shen , Jean-Francois Ton , Mihaela van der Schaar

Reinforcement learning (RL) has shown impressive results in sequential decision-making tasks. Meanwhile, Large Language Models (LLMs) and Vision-Language Models (VLMs) have emerged, exhibiting impressive capabilities in multimodal…

Large language model alignment via reinforcement learning depends critically on reward function quality. However, static, domain-specific reward models are often costly to train and exhibit poor generalization in out-of-distribution…

计算与语言 · 计算机科学 2026-03-03 Andrew Zhuoer Feng , Cunxiang Wang , Bosi Wen , Yidong Wang , Yu Luo , Hongning Wang , Minlie Huang

Reinforcement Learning with Verifiable Rewards (RLVR) plays a key role in stimulating the explicit reasoning capability of Large Language Models (LLMs). We can achieve expert-level performance in some specific domains via RLVR, such as…

人工智能 · 计算机科学 2026-03-12 Haoqing Wang , Xiang Long , Ziheng Li , Yilong Xu , Tingguang Li , Yehui Tang

One of the key challenges in current Reinforcement Learning (RL)-based Automated Driving (AD) agents is achieving flexible, precise, and human-like behavior cost-effectively. This paper introduces an innovative approach that uses large…

人工智能 · 计算机科学 2024-12-30 Ziqi Zhou , Jingyue Zhang , Jingyuan Zhang , Yangfan He , Boyue Wang , Tianyu Shi , Alaa Khamis

Reinforcement learning is increasingly used for code-centric tasks. These tasks include code generation, summarization, understanding, repair, testing, and optimization. This trend is growing faster with large language models and autonomous…

软件工程 · 计算机科学 2026-01-28 Md Rayhanul Masud , Azmine Toushik Wasi , Salman Rahman , Md Rizwan Parvez

Large Vision-Language Models (LVLMs) have recently advanced robotic manipulation by leveraging vision for scene perception and language for instruction following. However, existing methods rely heavily on costly human-annotated training…

Large Language Models (LLMs) have achieved remarkable success across diverse natural language tasks, yet the reward models employed for aligning LLMs often encounter challenges of reward hacking, where the approaches predominantly rely on…

计算与语言 · 计算机科学 2026-03-06 Biao Liu , Ning Xu , Junming Yang , Hao Xu , Xin Geng

Reinforcement Learning (RL) has traditionally focused on training specialized agents to optimize predefined reward functions within narrowly defined environments. However, the advent of powerful Large Language Models (LLMs) and increasingly…

人工智能 · 计算机科学 2026-05-18 Fangming Cui , Ruixiao Zhu , Cheng Fang , Sunan Li , Jiahong Li

The recent advancement of Large Language Models (LLMs) has established their potential as autonomous interactive agents. However, they often struggle in strategic games of incomplete information, such as bilateral price negotiation. In this…

人工智能 · 计算机科学 2026-04-14 Shuze Daniel Liu , Claire Chen , Jiabao Sean Xiao , Lei Lei , Yuheng Zhang , Yisong Yue , David Simchi-Levi

When we design and deploy an Reinforcement Learning (RL) agent, reward functions motivates agents to achieve an objective. An incorrect or incomplete specification of the objective can result in behavior that does not align with human…

人工智能 · 计算机科学 2024-06-03 Zhaoyue Wang

The aim of Reinforcement Learning (RL) in real-world applications is to create systems capable of making autonomous decisions by learning from their environment through trial and error. This paper emphasizes the importance of reward…

机器学习 · 计算机科学 2024-12-31 Sinan Ibrahim , Mostafa Mostafa , Ali Jnadi , Hadi Salloum , Pavel Osinenko
‹ 上一页 1 2 3 10 下一页 ›