中文
相关论文

相关论文: Towards Better RL Training Data Utilization via Se…

200 篇论文

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

Reinforcement Learning (RL) has been successful in various domains like robotics, game playing, and simulation. While RL agents have shown impressive capabilities in their specific tasks, they insufficiently adapt to new tasks. In…

机器学习 · 计算机科学 2023-10-30 Thomas Schmied , Markus Hofmarcher , Fabian Paischer , Razvan Pascanu , Sepp Hochreiter

Offline reinforcement learning (RL), also known as batch RL, offers the prospect of policy optimization from large pre-recorded datasets without online environment interaction. It addresses challenges with regard to the cost of data…

Despite their remarkable performance, Large Language Models (LLMs) face a critical challenge: providing feedback for tasks where human evaluation is difficult or where LLMs potentially outperform humans. In such scenarios, leveraging the…

计算与语言 · 计算机科学 2025-08-05 Zhengyang Tang , Ziniu Li , Zhenyang Xiao , Tian Ding , Ruoyu Sun , Benyou Wang , Dayiheng Liu , Fei Huang , Tianyu Liu , Bowen Yu , Junyang Lin

Reinforcement learning (RL) is a general framework for adaptive control, which has proven to be efficient in many domains, e.g., board games, video games or autonomous vehicles. In such problems, an agent faces a sequential decision-making…

机器学习 · 计算机科学 2020-06-16 Olivier Buffet , Olivier Pietquin , Paul Weng

Recently, reinforcement learning~(RL) has become an important approach for improving the capabilities of large language models~(LLMs). In particular, reinforcement learning from verifiable rewards~(RLVR) has emerged as a promising paradigm…

机器学习 · 计算机科学 2026-03-26 Fei Bai , Zhipeng Chen , Chuan Hao , Ming Yang , Ran Tao , Bryan Dai , Wayne Xin Zhao , Jian Yang , Hongteng Xu

Reinforcement learning (RL) presents a promising framework to learn policies through environment interaction, but often requires an infeasible amount of interaction data to solve complex tasks from sparse rewards. One direction includes…

机器学习 · 计算机科学 2024-05-07 Stone Tao , Arth Shukla , Tse-kai Chan , Hao Su

Reinforcement Learning (RL) can mitigate the causal confusion and distribution shift inherent to imitation learning (IL). However, applying RL to end-to-end autonomous driving (E2E-AD) remains an open problem for its training difficulty,…

机器人学 · 计算机科学 2025-10-28 Zhenjie Yang , Xiaosong Jia , Qifeng Li , Xue Yang , Maoqing Yao , Junchi Yan

Reinforcement learning (RL) is central to improving reasoning in large language models (LLMs) but typically requires ground-truth rewards. Test-Time Reinforcement Learning (TTRL) removes this need by using majority-vote rewards, but relies…

机器学习 · 计算机科学 2025-10-06 Aleksei Arzhantsev , Otmane Sakhi , Flavian Vasile

Reinforcement learning (RL) has emerged as a powerful method for improving the reasoning abilities of large language models (LLMs). Outcome-based RL, which rewards policies solely for the correctness of the final answer, yields substantial…

机器学习 · 计算机科学 2025-09-09 Yuda Song , Julia Kempe , Remi Munos

Instruction-driven image editing with unified multimodal generative models has advanced rapidly, yet their underlying visual reasoning remains limited, leading to suboptimal performance on reasoning-centric edits. Reinforcement learning…

计算机视觉与模式识别 · 计算机科学 2026-02-27 Hengjia Li , Liming Jiang , Qing Yan , Yizhi Song , Hao Kang , Zichuan Liu , Xin Lu , Boxi Wu , Deng Cai

Language Models (LMs) exhibit two distinct mechanisms for knowledge acquisition: in-weights learning (i.e., encoding information within the model weights) and in-context learning (ICL). Although these two modes offer complementary…

机器学习 · 计算机科学 2026-04-03 Arslan Chaudhry , Sridhar Thiagarajan , Andrew Lampinen

Reinforcement learning (RL) has achieved remarkable success in LLM reasoning, but whether it can also improve direct recall of parametric knowledge remains an open question. We study this question in a controlled zero-shot, one-hop,…

计算与语言 · 计算机科学 2026-05-11 Wanli Yang , Hongyu Zang , Junwei Zhang , Wenjie Shi , Du Su , Jingang Wang , Xueqi Cheng , Fei Sun

Reinforcement learning (RL) has emerged as a viable recipe for training LLM agents to reason over external memory banks in multi-session dialogue. Existing work trains exclusively on a single benchmark, leaving open how the composition of…

计算与语言 · 计算机科学 2026-05-25 Xinjie He , Zhiyuan Lin , Su Liu , Jialun Wu , Qiyang Xie , Weikai Zhou , Shuai Xiao

Reinforcement Learning with Verifiable Rewards (RLVR) has become a standard paradigm for reasoning in Large Language Models. However, optimizing solely for final-answer correctness often drives models into aimless, verbose exploration,…

计算与语言 · 计算机科学 2026-01-14 Jiangshan Duo , Hanyu Li , Hailin Zhang , Yudong Wang , Sujian Li , Liang Zhao

Open-domain dialog generation is a challenging problem; maximum likelihood training can lead to repetitive outputs, models have difficulty tracking long-term conversational goals, and training on standard movie or online datasets may lead…

机器学习 · 计算机科学 2020-01-03 Abdelrhman Saleh , Natasha Jaques , Asma Ghandeharioun , Judy Hanwen Shen , Rosalind Picard

The reasoning capabilities of Large Language Models (LLMs) play a critical role in many downstream tasks, yet depend strongly on the quality of training data. Despite various proposed data construction methods, their practical utility in…

计算与语言 · 计算机科学 2025-10-09 Yike Zhao , Simin Guo , Ziqing Yang , Shifan Han , Dahua Lin , Fei Tan

While large language models (LLMs) demonstrate strong reasoning capabilities utilizing reinforcement learning (RL) with verifiable reward, whether large vision-language models (VLMs) can directly inherit such capabilities through similar…

人工智能 · 计算机科学 2025-05-27 Tianle Li , Jihai Zhang , Yongming Rao , Yu Cheng

The problem of Reinforcement Learning (RL) in an unknown nonlinear dynamical system is equivalent to the search for an optimal feedback law utilizing the simulations/ rollouts of the dynamical system. Most RL techniques search over a…

机器学习 · 计算机科学 2022-03-25 Ran Wang , Karthikeya S. Parunandi , Aayushman Sharma , Raman Goyal , Suman Chakravorty

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including…

机器学习 · 计算机科学 2024-10-22 Nadav Merlis