English
Related papers

Related papers: Action Priors for Large Action Spaces in Robotics

200 papers

Efficient action prediction is of central importance for the fluent workflow between humans and equally so for human-robot interaction. To achieve prediction, actions can be encoded by a series of events, where every event corresponds to a…

Imitation can allow us to quickly gain an understanding of a new task. Through a demonstration, we can gain direct knowledge about which actions need to be performed and which goals they have. In this paper, we introduce a new approach to…

Robotics · Computer Science 2024-06-04 Josua Spisak , Matthias Kerzel , Stefan Wermter

Robots are more capable of achieving manipulation tasks for everyday activities than before. But the safety of manipulation skills that robots employ is still an open problem. Considering all possible failures during skill learning…

Robotics · Computer Science 2023-05-05 Abdullah Cihan Ak , Eren Erdal Aksoy , Sanem Sariel

Despite tremendous progress in dexterous manipulation, current visuomotor policies remain fundamentally limited by two challenges: they struggle to generalize under perceptual or behavioral distribution shifts, and their performance is…

Robotics · Computer Science 2025-08-04 Junbang Liang , Pavel Tokmakov , Ruoshi Liu , Sruthi Sudhakar , Paarth Shah , Rares Ambrus , Carl Vondrick

Learning useful representations with little or no supervision is a key challenge in artificial intelligence. We provide an in-depth review of recent advances in representation learning with a focus on autoencoder-based models. To organize…

Machine Learning · Computer Science 2018-12-13 Michael Tschannen , Olivier Bachem , Mario Lucic

Inferring object motion representations from observations enhances the performance of robotic manipulation tasks. This paper introduces a new paradigm for robot imitation learning that generates action sequences by reasoning about object…

Robotics · Computer Science 2025-04-15 Yue Su , Xinyu Zhan , Hongjie Fang , Yong-Lu Li , Cewu Lu , Lixin Yang

Training robot manipulation policies is a challenging and open problem in robotics and artificial intelligence. In this paper we propose a novel and compact state representation based on the rewards predicted from an image-based task…

Robotics · Computer Science 2021-12-13 Cédérick Mouliets , Isabelle Ferrané , Heriberto Cuayáhuitl

Humans are masters at quickly learning many complex tasks, relying on an approximate understanding of the dynamics of their environments. In much the same way, we would like our learning agents to quickly adapt to new tasks. In this paper,…

Auxiliary tasks improve the representations learned by deep reinforcement learning agents. Analytically, their effect is reasonably well understood; in practice, however, their primary use remains in support of a main learning objective,…

In complex tasks, such as those with large combinatorial action spaces, random exploration may be too inefficient to achieve meaningful learning progress. In this work, we use a curriculum of progressively growing action spaces to…

Machine Learning · Computer Science 2019-07-01 Gregory Farquhar , Laura Gustafson , Zeming Lin , Shimon Whiteson , Nicolas Usunier , Gabriel Synnaeve

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

A defining characteristic of intelligent systems is the ability to make action decisions based on the anticipated outcomes. Video prediction systems have been demonstrated as a solution for predicting how the future will unfold visually,…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Manuel Serra Nunes , Atabak Dehban , Plinio Moreno , José Santos-Victor

Exploration in novel settings can be challenging without prior experience in similar domains. However, humans are able to build on prior experience quickly and efficiently. Children exhibit this behavior when playing with toys. For example,…

While generalist robot policies hold significant promise for learning diverse manipulation skills through imitation, their performance is often hindered by the long-tail distribution of training demonstrations. Policies learned on such…

Robotics · Computer Science 2026-02-09 Junhong Zhu , Ji Zhang , Jingkuan Song , Lianli Gao , Heng Tao Shen

This work adds on to the on-going efforts to provide more autonomy to space robots. Here the concept of programming by demonstration or imitation learning is used for trajectory planning of manipulators mounted on small spacecraft. For…

Robotics · Computer Science 2020-08-11 RB Ashith Shyam , Zhou Hao , Umberto Montanaro , Gerhard Neumann

Contact-rich manipulation tasks are commonly found in modern manufacturing settings. However, manually designing a robot controller is considered hard for traditional control methods as the controller requires an effective combination of…

Robotics · Computer Science 2020-10-27 Yunlei Shi , Zhaopeng Chen , Hongxu Liu , Sebastian Riedel , Chunhui Gao , Qian Feng , Jun Deng , Jianwei Zhang

Explainable artificial intelligence is a research field that tries to provide more transparency for autonomous intelligent systems. Explainability has been used, particularly in reinforcement learning and robotic scenarios, to better…

Artificial Intelligence · Computer Science 2022-07-08 Francisco Cruz , Charlotte Young , Richard Dazeley , Peter Vamplew

We consider the problem of learning by demonstration from agents acting in unknown stochastic Markov environments or games. Our aim is to estimate agent preferences in order to construct improved policies for the same task that the agents…

Machine Learning · Computer Science 2014-08-12 Aristide Tossou , Christos Dimitrakakis

We consider the problem of learning by demonstration from agents acting in unknown stochastic Markov environments or games. Our aim is to estimate agent preferences in order to construct improved policies for the same task that the agents…

Machine Learning · Statistics 2013-07-16 Aristide C. Y. Tossou , Christos Dimitrakakis

Autonomous learning of object manipulation skills can enable robots to acquire rich behavioral repertoires that scale to the variety of objects found in the real world. However, current motion skill learning methods typically restrict the…

Robotics · Computer Science 2015-02-27 Sergey Levine , Nolan Wagener , Pieter Abbeel