English
Related papers

Related papers: Enhanced Meta Reinforcement Learning using Demonst…

200 papers

We study reinforcement learning (RL) problems in which agents observe the reward or transition realizations at their current state before deciding which action to take. Such observations are available in many applications, including…

Machine Learning · Computer Science 2024-10-22 Nadav Merlis

Meta-learning is a line of research that develops the ability to leverage past experiences to efficiently solve new learning problems. Meta-Reinforcement Learning (meta-RL) methods demonstrate a capability to learn behaviors that…

Machine Learning · Computer Science 2022-08-25 Brieuc Pinon , Jean-Charles Delvenne , Raphaël Jungers

Reinforcement learning (RL) has shown great promise in optimizing long-term user interest in recommender systems. However, existing RL-based recommendation methods need a large number of interactions for each user to learn a robust…

Machine Learning · Computer Science 2020-12-07 Yanan Wang , Yong Ge , Li Li , Rui Chen , Tong Xu

In recent years, Reinforcement Learning (RL) has been applied to real-world problems with increasing success. Such applications often require to put constraints on the agent's behavior. Existing algorithms for constrained RL (CRL) rely on…

Machine Learning · Computer Science 2023-03-07 Ted Moskovitz , Brendan O'Donoghue , Vivek Veeriah , Sebastian Flennerhag , Satinder Singh , Tom Zahavy

Consider mutli-goal tasks that involve static environments and dynamic goals. Examples of such tasks, such as goal-directed navigation and pick-and-place in robotics, abound. Two types of Reinforcement Learning (RL) algorithms are used for…

Machine Learning · Computer Science 2019-01-08 Vikas Dhiman , Shurjo Banerjee , Jeffrey M. Siskind , Jason J. Corso

Language models trained on diverse datasets unlock generalization by in-context learning. Reinforcement Learning (RL) policies can achieve a similar effect by meta-learning within the memory of a sequence model. However, meta-RL research…

Machine Learning · Computer Science 2024-11-19 Jake Grigsby , Justin Sasek , Samyak Parajuli , Daniel Adebi , Amy Zhang , Yuke Zhu

Safe exploration is critical for using reinforcement learning (RL) in risk-sensitive environments. Recent work learns risk measures which measure the probability of violating constraints, which can then be used to enable safety. However,…

Machine Learning · Computer Science 2021-12-08 Michael Luo , Ashwin Balakrishna , Brijen Thananjeyan , Suraj Nair , Julian Ibarz , Jie Tan , Chelsea Finn , Ion Stoica , Ken Goldberg

There is considerable interest in designing meta-reinforcement learning (meta-RL) algorithms, which enable autonomous agents to adapt new tasks from small amount of experience. In meta-RL, the specification (such as reward function) of…

Artificial Intelligence · Computer Science 2021-05-17 Kei Akuzawa , Yusuke Iwasawa , Yutaka Matsuo

Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality…

Machine Learning · Computer Science 2022-06-20 Zuxin Liu , Zhepeng Cen , Vladislav Isenbaev , Wei Liu , Zhiwei Steven Wu , Bo Li , Ding Zhao

Predictive autoscaling (autoscaling with workload forecasting) is an important mechanism that supports autonomous adjustment of computing resources in accordance with fluctuating workload demands in the Cloud. In recent works, Reinforcement…

Reinforcement learning (RL) has demonstrated impressive performance in decision-making tasks like embodied control, autonomous driving and financial trading. In many decision-making tasks, the agents often encounter the problem of executing…

Machine Learning · Computer Science 2024-07-23 Jing-Cheng Pang , Tian Xu , Shengyi Jiang , Yu-Ren Liu , Yang Yu

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as an effective approach for enhancing the reasoning capabilities of Large Language Models (LLMs). Despite its efficacy, RLVR faces a meta-learning bottleneck: it lacks…

Machine Learning · Computer Science 2026-02-12 Shiting Huang , Zecheng Li , Yu Zeng , Qingnan Ren , Zhen Fang , Qisheng Su , Kou Shi , Lin Chen , Zehui Chen , Feng Zhao

Reinforcement learning (RL) is a sub-domain of machine learning, mainly concerned with solving sequential decision-making problems by a learning agent that interacts with the decision environment to improve its behavior through the reward…

Machine Learning · Computer Science 2025-09-23 Hossein Hassani , Ehsan Hallaji , Roozbeh Razavi-Far , Mehrdad Saif , Liang Lin

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as homogeneous, thereby…

Machine Learning · Computer Science 2024-12-16 Mark Beliaev , Ramtin Pedarsani

Extrapolating beyond-demonstrator (BD) performance through the imitation learning (IL) algorithm aims to learn from and subsequently outperform the demonstrator. To that end, a representative approach is to leverage inverse reinforcement…

Machine Learning · Computer Science 2022-02-28 Mingqi Yuan , Mao-on Pun

Reinforcement Learning (RL) agents have demonstrated their potential across various robotic tasks. However, they still heavily rely on human-engineered reward functions, requiring extensive trial-and-error and access to target behavior…

Robotics · Computer Science 2025-03-03 Changyeon Kim , Minho Heo , Doohyun Lee , Jinwoo Shin , Honglak Lee , Joseph J. Lim , Kimin Lee

Reinforcement learning (RL) provides a naturalistic framing for learning through trial and error, which is appealing both because of its simplicity and effectiveness and because of its resemblance to how humans and animals acquire skills…

Machine Learning · Computer Science 2022-08-09 Archit Sharma , Kelvin Xu , Nikhil Sardana , Abhishek Gupta , Karol Hausman , Sergey Levine , Chelsea Finn

Consider the following instance of the Offline Meta Reinforcement Learning (OMRL) problem: given the complete training logs of $N$ conventional RL agents, trained on $N$ different tasks, design a meta-agent that can quickly maximize reward…

Machine Learning · Computer Science 2021-02-15 Ron Dorfman , Idan Shenfeld , Aviv Tamar

Safe Reinforcement Learning (RL) plays an important role in applying RL algorithms to safety-critical real-world applications, addressing the trade-off between maximizing rewards and adhering to safety constraints. This work introduces a…

Robotics · Computer Science 2024-07-16 Fan Yang , Wenxuan Zhou , Zuxin Liu , Ding Zhao , David Held

Humans are masters at quickly learning many complex tasks, relying on an approximate understanding of the dynamics of their environments. In much the same way, we would like our learning agents to quickly adapt to new tasks. In this paper,…