English
Related papers

Related papers: Learning Montezuma's Revenge from a Single Demonst…

200 papers

For sophisticated reinforcement learning (RL) systems to interact usefully with real-world environments, we need to communicate complex goals to these systems. In this work, we explore goals defined in terms of (non-expert) human…

Machine Learning · Statistics 2023-02-20 Paul Christiano , Jan Leike , Tom B. Brown , Miljan Martic , Shane Legg , Dario Amodei

Reinforcement learning has achieved remarkable success in perfect information games such as Go and Atari, enabling agents to compete at the highest levels against human players. However, research in reinforcement learning for imperfect…

Machine Learning · Computer Science 2024-10-24 Jiamian Li

One of the main challenges in reinforcement learning (RL) is generalisation. In typical deep RL methods this is achieved by approximating the optimal value function with a low-dimensional representation using a deep network. While this…

Machine Learning · Computer Science 2017-11-29 Harm van Seijen , Mehdi Fatemi , Joshua Romoff , Romain Laroche , Tavian Barnes , Jeffrey Tsang

Reward shaping allows reinforcement learning (RL) agents to accelerate learning by receiving additional reward signals. However, these signals can be difficult to design manually, especially for complex RL tasks. We propose a simple and…

Artificial Intelligence · Computer Science 2018-06-11 Niels Justesen , Sebastian Risi

Recent improvements in deep reinforcement learning have allowed to solve problems in many 2D domains such as Atari games. However, in complex 3D environments, numerous learning episodes are required which may be too time consuming or even…

Machine Learning · Computer Science 2017-12-13 Nicolas Bougie , Ryutaro Ichise

We examine the problem of learning and planning on high-dimensional domains with long horizons and sparse rewards. Recent approaches have shown great successes in many Atari 2600 domains. However, domains with long horizons and sparse…

Machine Learning · Computer Science 2018-08-28 Melrose Roderick , Christopher Grimm , Stefanie Tellex

Reinforcement learning (RL) in sparse-reward environments remains a significant challenge due to the lack of informative feedback. We propose a simple yet effective method that uses a small number of successful demonstrations to initialize…

Machine Learning · Computer Science 2025-10-29 Seyed Mahdi Basiri Azad , Joschka Boedecker

Inverse reinforcement learning (IRL) infers a reward function from demonstrations, allowing for policy improvement and generalization. However, despite much recent interest in IRL, little work has been done to understand the minimum set of…

Machine Learning · Computer Science 2019-08-19 Daniel S. Brown , Scott Niekum

Text-based games are a natural challenge domain for deep reinforcement learning algorithms. Their state and action spaces are combinatorially large, their reward function is sparse, and they are partially observable: the agent is informed…

Artificial Intelligence · Computer Science 2019-12-02 Vishal Jain , William Fedus , Hugo Larochelle , Doina Precup , Marc G. Bellemare

Reinforcement learning (RL) algorithms assume that users specify tasks by manually writing down a reward function. However, this process can be laborious and demands considerable technical expertise. Can we devise RL algorithms that instead…

Machine Learning · Computer Science 2022-01-03 Benjamin Eysenbach , Sergey Levine , Ruslan Salakhutdinov

Data efficiency is a key challenge for deep reinforcement learning. We address this problem by using unlabeled data to pretrain an encoder which is then finetuned on a small amount of task-specific data. To encourage learning…

Although reinforcement learning has seen tremendous success recently, this kind of trial-and-error learning can be impractical or inefficient in complex environments. The use of demonstrations, on the other hand, enables agents to benefit…

Machine Learning · Computer Science 2023-03-29 Tongzhou Mu , Hao Su

We introduce two tactics to attack agents trained by deep reinforcement learning algorithms using adversarial examples, namely the strategically-timed attack and the enchanting attack. In the strategically-timed attack, the adversary aims…

Machine Learning · Computer Science 2019-11-14 Yen-Chen Lin , Zhang-Wei Hong , Yuan-Hong Liao , Meng-Li Shih , Ming-Yu Liu , Min Sun

Learning rational behaviors in open-world games like Minecraft remains to be challenging for Reinforcement Learning (RL) research due to the compound challenge of partial observability, high-dimensional visual perception and delayed reward.…

Machine Learning · Computer Science 2021-12-10 Zichuan Lin , Junyou Li , Jianing Shi , Deheng Ye , Qiang Fu , Wei Yang

This work concerns itself with the task of reconstructing all edges of an arbitrary 3D wire-frame model projected to an image plane. We explore a bottom-up part-wise procedure undertaken by an RL agent to segment and reconstruct these 2D…

Machine Learning · Computer Science 2025-03-24 Julian Ziegler , Patrick Frenzel , Mirco Fuchs

Bootstrapping is a core mechanism in Reinforcement Learning (RL). Most algorithms, based on temporal differences, replace the true value of a transiting state by their current estimate of this value. Yet, another estimate could be leveraged…

Machine Learning · Computer Science 2020-11-05 Nino Vieillard , Olivier Pietquin , Matthieu Geist

Reinforcement learning has enabled agents to solve challenging tasks in unknown environments. However, manually crafting reward functions can be time consuming, expensive, and error prone to human error. Competing objectives have been…

Machine Learning · Computer Science 2021-02-11 Brendon Matusch , Jimmy Ba , Danijar Hafner

Real-world reinforcement learning (RL) environments, whether in robotics or industrial settings, often involve non-visual observations and require not only efficient but also reliable and thus interpretable and flexible RL approaches. To…

Machine Learning · Computer Science 2024-02-19 Moritz Lange , Noah Krystiniak , Raphael C. Engelhardt , Wolfgang Konen , Laurenz Wiskott

Reinforcement learning has achieved great success in many applications. However, sample efficiency remains a key challenge, with prominent methods requiring millions (or even billions) of environment steps to train. Recently, there has been…

Machine Learning · Computer Science 2021-12-14 Weirui Ye , Shaohuai Liu , Thanard Kurutach , Pieter Abbeel , Yang Gao

Multi-agent reinforcement learning has shown promise in learning cooperative behaviors in team-based environments. However, such methods often demand extensive training time. For instance, the state-of-the-art method TiZero takes 40 days to…

Machine Learning · Computer Science 2025-03-18 Amir Baghi , Jens Sjölund , Joakim Bergdahl , Linus Gisslén , Alessandro Sestini