English
Related papers

Related papers: Proximal Curriculum for Reinforcement Learning Age…

200 papers

We introduce Prompt Curriculum Learning (PCL), a lightweight reinforcement learning (RL) algorithm that selects intermediate-difficulty prompts using a learned value model to post-train language models. Since post-training LLMs via RL…

Machine Learning · Computer Science 2025-10-02 Zhaolin Gao , Joongwon Kim , Wen Sun , Thorsten Joachims , Sid Wang , Richard Yuanzhe Pang , Liang Tan

Humans are good at learning on the job: We learn how to solve the tasks we face as we go along. Can a model do the same? We propose an agent that assembles a task-specific curriculum, called test-time curriculum (TTC-RL), and applies…

Machine Learning · Computer Science 2025-10-07 Jonas Hübotter , Leander Diaz-Bone , Ido Hakimi , Andreas Krause , Moritz Hardt

Recent advances in Reinforcement Learning (RL) combined with Deep Learning (DL) have demonstrated impressive performance in complex tasks, including autonomous driving. The use of RL agents in autonomous driving leads to a smooth human-like…

Artificial Intelligence · Computer Science 2021-07-30 Briti Gangopadhyay , Harshit Soora , Pallab Dasgupta

We consider the problem of teaching via demonstrations in sequential decision-making settings. In particular, we study how to design a personalized curriculum over demonstrations to speed up the learner's convergence. We provide a unified…

Machine Learning · Computer Science 2021-12-17 Gaurav Yengera , Rati Devidze , Parameswaran Kamalaruban , Adish Singla

Training large language models with reinforcement learning (RL) against verifiable rewards significantly enhances their reasoning abilities, yet remains computationally expensive due to inefficient uniform prompt sampling. We introduce…

Machine Learning · Computer Science 2026-03-06 Ruiqi Zhang , Daman Arora , Song Mei , Andrea Zanette

Deep Research (DR) agents extend Large Language Models (LLMs) beyond parametric knowledge by autonomously retrieving and synthesizing evidence from large web corpora into long-form reports, enabling a long-horizon agentic paradigm. However,…

Artificial Intelligence · Computer Science 2026-02-04 Haohao Luo , Zexi Li , Yuexiang Xie , Wenhao Zhang , Yaliang Li , Ying Shen

Recent advancements in reinforcement learning have made significant impacts across various domains, yet they often struggle in complex multi-agent environments due to issues like algorithm instability, low sampling efficiency, and the…

Multiagent Systems · Computer Science 2024-08-22 Cheng Xu , Changtian Zhang , Yuchen Shi , Ran Wang , Shihong Duan , Yadong Wan , Xiaotong Zhang

Imagining potential outcomes of actions before execution helps agents make more informed decisions, a prospective thinking ability fundamental to human cognition. However, mainstream model-free Reinforcement Learning (RL) methods lack the…

Machine Learning · Computer Science 2024-08-01 Liangliang Liu , Yi Guan , BoRan Wang , Rujia Shen , Yi Lin , Chaoran Kong , Lian Yan , Jingchi Jiang

In this paper, we propose a deep reinforcement learning (RL)-based precoding framework that can be used to learn an optimal precoding policy for complex multiple-input multiple-output (MIMO) precoding problems. We model the precoding…

Information Theory · Computer Science 2024-10-30 Heunchul Lee , Maksym Girnyk , Jaeseong Jeong

Curriculum learning (CL) is a training strategy that trains a machine learning model from easier data to harder data, which imitates the meaningful learning order in human curricula. As an easy-to-use plug-in, the CL strategy has…

Machine Learning · Computer Science 2021-03-26 Xin Wang , Yudong Chen , Wenwu Zhu

A central challenge in reinforcement learning is that policies trained in controlled environments often fail under distribution shifts at deployment into real-world environments. Distributionally Robust Reinforcement Learning (DRRL)…

Machine Learning · Computer Science 2026-03-10 Anirudh Satheesh , Keenan Powell , Vaneet Aggarwal

As autonomous agents become adept at understanding and interacting with graphical user interface (GUI) environments, a new era of automated task execution is emerging. Recent studies have demonstrated that Reinforcement Learning (RL) can…

Artificial Intelligence · Computer Science 2026-03-16 Songqin Nong , Xiaoxuan Tang , Jingxuan Xu , Sheng Zhou , Jianfeng Chen , Tao Jiang , Wenhao Xu

We study the problem of programmatic reinforcement learning, in which policies are represented as short programs in a symbolic language. Programmatic policies can be more interpretable, generalizable, and amenable to formal verification…

Machine Learning · Computer Science 2021-01-21 Abhinav Verma , Hoang M. Le , Yisong Yue , Swarat Chaudhuri

Proactive Recommender Systems (PRSs) aim to guide user preference shift toward target items by generating paths of intermediate recommendations. Reinforcement learning (RL) provides a principled framework for optimizing such sequential…

Machine Learning · Computer Science 2026-05-29 Hongru Hou , Tiehua Mei , Denghui Geng , Jinhui Huang , Ao Xu , Hengrui Chen , Jiaqing Liang , Deqing Yang

We present a proximal policy optimization (PPO) agent trained through curriculum learning (CL) principles and meticulous reward engineering to optimize a real-world high-throughput waste sorting facility. Our work addresses the challenge of…

Machine Learning · Computer Science 2024-07-24 Abhijeet Pendyala , Asma Atamna , Tobias Glasmachers

Many relevant tasks require an agent to reach a certain state, or to manipulate objects into a desired configuration. For example, we might want a robot to align and assemble a gear onto an axle or insert and turn a key in a lock. These…

Artificial Intelligence · Computer Science 2018-07-24 Carlos Florensa , David Held , Markus Wulfmeier , Michael Zhang , Pieter Abbeel

Autonomous vehicles inevitably encounter a vast array of scenarios in real-world environments. Addressing long-tail scenarios, particularly those involving intensive interactions with numerous traffic participants, remains one of the most…

Robotics · Computer Science 2024-12-16 Guanzhou Li , Jianping Wu , Yujing He

Reinforcement learning (RL) problems can be challenging without well-shaped rewards. Prior work on provably efficient RL methods generally proposes to address this issue with dedicated exploration strategies. However, another way to tackle…

Machine Learning · Computer Science 2023-06-21 Qiyang Li , Yuexiang Zhai , Yi Ma , Sergey Levine

Robust policies enable reinforcement learning agents to effectively adapt to and operate in unpredictable, dynamic, and ever-changing real-world environments. Factored representations, which break down complex state and action spaces into…

Machine Learning · Computer Science 2024-09-20 Panayiotis Panayiotou , Özgür Şimşek

Reinforcement learning (RL) has emerged as a powerful tool for tackling control problems, but its practical application is often hindered by the complexity arising from intricate reward functions with multiple terms. The reward hypothesis…

Machine Learning · Computer Science 2025-02-11 Kilian Freitag , Kristian Ceder , Rita Laezza , Knut Åkesson , Morteza Haghir Chehreghani