English
Related papers

Related papers: Learning to Execute: Efficient Learning of Univers…

200 papers

In recent years deep reinforcement learning (RL) systems have attained superhuman performance in a number of challenging task domains. However, a major limitation of such applications is their demand for massive amounts of training data. A…

In recent years, challenging control problems became solvable with deep reinforcement learning (RL). To be able to use RL for large-scale real-world applications, a certain degree of reliability in their performance is necessary. Reported…

Machine Learning · Computer Science 2020-11-11 Nirnai Rao , Elie Aljalbout , Axel Sauer , Sami Haddadin

Recent advances in behavior cloning (BC) have enabled impressive visuomotor control policies. However, these approaches are limited by the quality of human demonstrations, the manual effort required for data collection, and the diminishing…

Robotics · Computer Science 2025-09-29 Lars Ankile , Zhenyu Jiang , Rocky Duan , Guanya Shi , Pieter Abbeel , Anusha Nagabandi

Execution algorithms are vital to modern trading, they enable market participants to execute large orders while minimising market impact and transaction costs. As these algorithms grow more sophisticated, optimising them becomes…

Computational Finance · Quantitative Finance 2025-10-28 Ollie Olby , Andreea Bacalum , Rory Baggott , Namid Stillman

Incorporating expert demonstrations has empirically helped to improve the sample efficiency of reinforcement learning (RL). This paper quantifies theoretically to what extent this extra information reduces RL's sample complexity. In…

Demonstration-guided reinforcement learning (RL) is a promising approach for learning complex behaviors by leveraging both reward feedback and a set of target task demonstrations. Prior approaches for demonstration-guided RL treat every new…

Machine Learning · Computer Science 2021-07-22 Karl Pertsch , Youngwoon Lee , Yue Wu , Joseph J. Lim

The inverse reinforcement learning approach to imitation learning is a double-edged sword. On the one hand, it can enable learning from a smaller number of expert demonstrations with more robustness to error compounding than behavioral…

Machine Learning · Computer Science 2024-06-06 Juntao Ren , Gokul Swamy , Zhiwei Steven Wu , J. Andrew Bagnell , Sanjiban Choudhury

In machine learning, meta-learning methods aim for fast adaptability to unknown tasks using prior knowledge. Model-based meta-reinforcement learning combines reinforcement learning via world models with Meta Reinforcement Learning (MRL) for…

Robotics · Computer Science 2022-10-10 Karam Daaboul , Joel Ikels , Marius Zöllner

While reinforcement learning (RL) has achieved notable success in various domains, training effective policies for complex tasks remains challenging. Agents often converge to local optima and fail to maximize long-term rewards. Existing…

Artificial Intelligence · Computer Science 2025-05-28 Heng Tan , Hua Yan , Yu Yang

Learned models of the environment provide reinforcement learning (RL) agents with flexible ways of making predictions about the environment. In particular, models enable planning, i.e. using more computation to improve value functions or…

Machine Learning · Computer Science 2021-10-26 Gregory Farquhar , Kate Baumli , Zita Marinho , Angelos Filos , Matteo Hessel , Hado van Hasselt , David Silver

Designing effective model-based reinforcement learning algorithms is difficult because the ease of data generation must be weighed against the bias of model-generated data. In this paper, we study the role of model usage in policy…

Machine Learning · Computer Science 2021-11-30 Michael Janner , Justin Fu , Marvin Zhang , Sergey Levine

Reinforcement learning has received high research interest for developing planning approaches in automated driving. Most prior works consider the end-to-end planning task that yields direct control commands and rarely deploy their algorithm…

Robotics · Computer Science 2023-07-31 Marvin Klimke , Benjamin Völz , Michael Buchholz

In inaccessible environments with uncertain task demands, robots often rely on general-purpose tools that lack predefined usage strategies. These tools are not tailored for particular operations, making their longevity highly sensitive to…

Robotics · Computer Science 2025-07-28 Po-Yen Wu , Cheng-Yu Kuo , Yuki Kadokawa , Takamitsu Matsubara

Long-horizon contact-rich bimanual manipulation presents a significant challenge, requiring complex coordination involving a mixture of parallel execution and sequential collaboration between arms. In this paper, we introduce a hierarchical…

Robotics · Computer Science 2026-02-06 Weikang Wan , Fabio Ramos , Xuning Yang , Caelan Garrett

Deep Reinforcement Learning (or just "RL") is gaining popularity for industrial and research applications. However, it still suffers from some key limits slowing down its widespread adoption. Its performance is sensitive to initial…

Machine Learning · Computer Science 2022-08-31 Pierrick Pochelu , Serge G. Petiton , Bruno Conche

Reinforcement learning (RL) is a promising approach for robotic manipulation, but it can suffer from low sample efficiency and requires extensive exploration of large state-action spaces. Recent methods leverage the commonsense knowledge…

Robotics · Computer Science 2026-04-15 Jelle Luijkx , Runyu Ma , Zlatan Ajanović , Jens Kober

Intelligent agents must be able to think fast and slow to perform elaborate manipulation tasks. Reinforcement Learning (RL) has led to many promising results on a range of challenging decision-making tasks. However, in real-world robotics,…

Robotics · Computer Science 2021-10-22 Maximilian Ulmer , Elie Aljalbout , Sascha Schwarz , Sami Haddadin

Deep reinforcement learning (DRL) breaks through the bottlenecks of traditional reinforcement learning (RL) with the help of the perception capability of deep learning and has been widely applied in real-world problems.While model-free RL,…

Machine Learning · Computer Science 2022-11-28 Tingting Zhao , Ying Wang , Wei Sun , Yarui Chen , Gang Niub , Masashi Sugiyama

Many sequential decision-making problems that are currently automated, such as those in manufacturing or recommender systems, operate in an environment where there is either little uncertainty, or zero risk of catastrophe. As companies and…

Machine Learning · Computer Science 2023-04-04 Marc Rigter

Although reinforcement learning has seen tremendous success recently, this kind of trial-and-error learning can be impractical or inefficient in complex environments. The use of demonstrations, on the other hand, enables agents to benefit…

Machine Learning · Computer Science 2023-03-29 Tongzhou Mu , Hao Su