English
Related papers

Related papers: State Representation Learning from Demonstration

200 papers

Operating directly from raw high dimensional sensory inputs like images is still a challenge for robotic control. Recently, Reinforcement Learning methods have been proposed to solve specific tasks end-to-end, from pixels to torques.…

Machine Learning · Computer Science 2019-01-07 Carlos Florensa , Jonas Degrave , Nicolas Heess , Jost Tobias Springenberg , Martin Riedmiller

One of the fundamental challenges in reinforcement learning (RL) is the one of data efficiency: modern algorithms require a very large number of training samples, especially compared to humans, for solving environments with high-dimensional…

Machine Learning · Computer Science 2021-05-10 Hlynur Davíð Hlynsson , Laurenz Wiskott

While reinforcement learning (RL) methods that learn an internal model of the environment have the potential to be more sample efficient than their model-free counterparts, learning to model raw observations from high dimensional sensors…

Machine Learning · Computer Science 2023-06-27 Raj Ghugare , Homanga Bharadhwaj , Benjamin Eysenbach , Sergey Levine , Ruslan Salakhutdinov

Collecting and automatically obtaining reward signals from real robotic visual data for the purposes of training reinforcement learning algorithms can be quite challenging and time-consuming. Methods for utilizing unlabeled data can have a…

Recently, deep reinforcement learning (RL) methods have been applied successfully to multi-agent scenarios. Typically, these methods rely on a concatenation of agent states to represent the information content required for decentralized…

Multiagent Systems · Computer Science 2019-06-07 Maximilian Hüttenrauch , Adrian Šošić , Gerhard Neumann

Reinforcement learning (RL) in the real world necessitates the development of procedures that enable agents to explore without causing harm to themselves or others. The most successful solutions to the problem of safe RL leverage offline…

Machine Learning · Computer Science 2025-01-09 Alexander Quessy , Thomas Richardson , Sebastian East

Imitation learning (IL) is a popular paradigm for training policies in robotic systems when specifying the reward function is difficult. However, despite the success of IL algorithms, they impose the somewhat unrealistic requirement that…

Machine Learning · Computer Science 2022-02-16 Luca Viano , Yu-Ting Huang , Parameswaran Kamalaruban , Craig Innes , Subramanian Ramamoorthy , Adrian Weller

Learning from Demonstration (LfD) systems are commonly used to teach robots new tasks by generating a set of skills from user-provided demonstrations. These skills can then be sequenced by planning algorithms to execute complex tasks.…

Robotics · Computer Science 2024-12-12 Maximilian Diehl , Tathagata Chakraborti , Karinne Ramirez-Amaro

Reinforcement Learning (RL) can be considered as a sequence modeling task: given a sequence of past state-action-reward experiences, an agent predicts a sequence of next actions. In this work, we propose State-Action-Reward Transformer…

Machine Learning · Computer Science 2023-01-05 Jinghuan Shang , Kumara Kahatapitiya , Xiang Li , Michael S. Ryoo

In this work we explore a new approach for robots to teach themselves about the world simply by observing it. In particular we investigate the effectiveness of learning task-agnostic representations for continuous control tasks. We extend…

Computer Vision and Pattern Recognition · Computer Science 2019-02-05 Debidatta Dwibedi , Jonathan Tompson , Corey Lynch , Pierre Sermanet

Modular robots can be reconfigured to create a variety of designs from a small set of components. But constructing a robot's hardware on its own is not enough -- each robot needs a controller. One could create controllers for some designs…

Robotics · Computer Science 2022-11-01 Julian Whitman , Howie Choset

Articulated object manipulation is a challenging task, requiring constrained motion and adaptive control to handle the unknown dynamics of the manipulated objects. While reinforcement learning (RL) has been widely employed to tackle various…

Robotics · Computer Science 2024-12-12 Yujin Kim , Sol Choi , Bum-Jae You , Keunwoo Jang , Yisoo Lee

This work explores how to learn robust and generalizable state representation from image-based observations with deep reinforcement learning methods. Addressing the computational complexity, stringent assumptions and representation collapse…

Machine Learning · Computer Science 2022-03-01 Hongyu Zang , Xin Li , Mingzhong Wang

Inverse reinforcement learning (IRL) aims to explain observed strategic behavior by fitting reinforcement learning models to behavioral data. However, traditional IRL methods are only applicable when the observations are in the form of…

Machine Learning · Computer Science 2018-06-26 Antti Kangasrääsiö , Samuel Kaski

Here we propose using the successor representation (SR) to accelerate learning in a constructive knowledge system based on general value functions (GVFs). In real-world settings like robotics for unstructured and dynamic environments, it is…

Machine Learning · Computer Science 2018-03-28 Craig Sherstan , Marlos C. Machado , Patrick M. Pilarski

In visual Reinforcement Learning (RL), upstream representation learning largely determines the effect of downstream policy learning. Employing auxiliary tasks allows the agent to enhance visual representation in a targeted manner, thereby…

Machine Learning · Computer Science 2024-05-21 Xin Liu , Yaran Chen , Dongbin Zhao

In robotics, Learning from Demonstration (LfD) aims to transfer skills to robots by using multiple demonstrations of the same task. These demonstrations are recorded and processed to extract a consistent skill representation. This process…

Robotics · Computer Science 2025-12-01 Giovanni Braglia , Davide Tebaldi , André Eugenio Lazzaretti , Luigi Biagiotti

Imitation learning (IL) has proven effective for enabling robots to acquire visuomotor skills through expert demonstrations. However, traditional IL methods are limited by their reliance on high-quality, often scarce, expert data, and…

Robotics · Computer Science 2025-09-05 Shuze Wang , Yunpeng Mei , Hongjie Cao , Yetian Yuan , Gang Wang , Jian Sun , Jie Chen

Many robot manipulation skills can be represented with deterministic characteristics and there exist efficient techniques for learning parameterized motor plans for those skills. However, one of the active research challenge still remains…

Robotics · Computer Science 2021-07-01 Sayyed Jaffar Ali Raza , Apan Dastider , Mingjie Lin

Reinforcement learning has long struggled with poor sample efficiency. One promising approach to mitigate this problem is leveraging group-invariant Markov Decision Processes ($G$-invariant MDPs). Existing works in this direction have…

Machine Learning · Computer Science 2026-05-25 Shuai Zhen , Yifan Zhang , Yuling Wang , Yanhua Yu