English
Related papers

Related papers: Low Dimensional State Representation Learning with…

200 papers

Recently, many reinforcement learning techniques were shown to have provable guarantees in the simple case of linear dynamics, especially in problems like linear quadratic regulators. However, in practice, many reinforcement learning…

Machine Learning · Computer Science 2020-06-30 Abraham Frandsen , Rong Ge

While reinforcement learning (RL) has the potential to enable robots to autonomously acquire a wide range of skills, in practice, RL usually requires manual, per-task engineering of reward functions, especially in real world settings where…

Robotics · Computer Science 2019-02-15 Tianhe Yu , Gleb Shevchuk , Dorsa Sadigh , Chelsea Finn

Representation learning becomes especially important for complex systems with multimodal data sources such as cameras or sensors. Recent advances in reinforcement learning and optimal control make it possible to design control algorithms on…

Training robot manipulation policies is a challenging and open problem in robotics and artificial intelligence. In this paper we propose a novel and compact state representation based on the rewards predicted from an image-based task…

Robotics · Computer Science 2021-12-13 Cédérick Mouliets , Isabelle Ferrané , Heriberto Cuayáhuitl

Learning state representations enables robotic planning directly from raw observations such as images. Most methods learn state representations by utilizing losses based on the reconstruction of the raw observations from a lower-dimensional…

In complex real-world tasks such as robotic manipulation and autonomous driving, collecting expert demonstrations is often more straightforward than specifying precise learning objectives and task descriptions. Learning from expert data can…

Robotics · Computer Science 2025-05-05 Daulet Baimukashev , Gokhan Alcan , Kevin Sebastian Luck , Ville Kyrki

Learning from Observations (LfO) is a practical reinforcement learning scenario from which many applications can benefit through the reuse of incomplete resources. Compared to conventional imitation learning (IL), LfO is more challenging…

Machine Learning · Computer Science 2021-03-01 Zhuangdi Zhu , Kaixiang Lin , Bo Dai , Jiayu Zhou

Reinforcement learning provides a powerful and flexible framework for automated acquisition of robotic motion skills. However, applying reinforcement learning requires a sufficiently detailed representation of the state, including the…

Machine Learning · Computer Science 2016-03-02 Chelsea Finn , Xin Yu Tan , Yan Duan , Trevor Darrell , Sergey Levine , Pieter Abbeel

While reinforcement learning (RL) methods that learn an internal model of the environment have the potential to be more sample efficient than their model-free counterparts, learning to model raw observations from high dimensional sensors…

Machine Learning · Computer Science 2023-06-27 Raj Ghugare , Homanga Bharadhwaj , Benjamin Eysenbach , Sergey Levine , Ruslan Salakhutdinov

Future Mars missions will require advanced guidance, navigation, and control algorithms for the powered descent phase to target specific surface locations and achieve pinpoint accuracy (landing error ellipse $<$ 5 m radius). The latter…

Systems and Control · Computer Science 2018-10-23 Brian Gaudet , Richard Linares , Roberto Furfaro

We consider the problem of building a state representation model in a continual fashion. As the environment changes, the aim is to efficiently compress the sensory state's information without losing past knowledge. The learned features are…

Machine Learning · Computer Science 2018-12-12 Hugo Caselles-Dupré , Michael Garcia-Ortiz , David Filliat

We demonstrate model-based, visual robot manipulation of linear deformable objects. Our approach is based on a state-space representation of the physical system that the robot aims to control. This choice has multiple advantages, including…

Robotics · Computer Science 2020-10-07 Mengyuan Yan , Yilin Zhu , Ning Jin , Jeannette Bohg

In this paper, we explore deep reinforcement learning algorithms for vision-based robotic grasping. Model-free deep reinforcement learning (RL) has been successfully applied to a range of challenging environments, but the proliferation of…

Robotics · Computer Science 2018-03-30 Deirdre Quillen , Eric Jang , Ofir Nachum , Chelsea Finn , Julian Ibarz , Sergey Levine

Reinforcement learning offers the promise of automating the acquisition of complex behavioral skills. However, compared to commonly used and well-understood supervised learning methods, reinforcement learning algorithms can be brittle,…

Machine Learning · Computer Science 2020-01-01 Aviral Kumar , Xue Bin Peng , Sergey Levine

Reinforcement learning suffers from limitations in real practices primarily due to the number of required interactions with virtual environments. It results in a challenging problem because we are implausible to obtain a local optimal…

Machine Learning · Computer Science 2024-10-28 Qizhen Wu , Kexin Liu , Lei Chen

There has been an increasing interest in 3D indoor navigation, where a robot in an environment moves to a target according to an instruction. To deploy a robot for navigation in the physical world, lots of training data is required to learn…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Fengda Zhu , Linchao Zhu , Yi Yang

Motivated by the challenge of achieving rapid learning in physical environments, this paper presents the development and training of a robotic system designed to navigate and solve a labyrinth game using model-based reinforcement learning…

Robotics · Computer Science 2023-12-18 Thomas Bi , Raffaello D'Andrea

Humans are masters at quickly learning many complex tasks, relying on an approximate understanding of the dynamics of their environments. In much the same way, we would like our learning agents to quickly adapt to new tasks. In this paper,…

This paper investigates how to incorporate expert observations (without explicit information on expert actions) into a deep reinforcement learning setting to improve sample efficiency. First, we formulate an augmented policy loss combining…

Machine Learning · Computer Science 2025-02-28 Erhan Can Ozcan , Vittorio Giammarino , James Queeney , Ioannis Ch. Paschalidis

Model-based reinforcement learning methods typically learn models for high-dimensional state spaces by aiming to reconstruct and predict the original observations. However, drawing inspiration from model-free reinforcement learning, we…

Machine Learning · Computer Science 2019-12-10 Aaron Havens , Yi Ouyang , Prabhat Nagarajan , Yasuhiro Fujita