English
Related papers

Related papers: Learning Robot Skills with Temporal Variational In…

200 papers

Rewards play an essential role in reinforcement learning. In contrast to rule-based game environments with well-defined reward functions, complex real-world robotic applications, such as contact-rich manipulation, lack explicit and…

Machine Learning · Computer Science 2022-05-30 Yuning Wu , Jieliang Luo , Hui Li

Key challenges for the deployment of reinforcement learning (RL) agents in the real world are the discovery, representation and reuse of skills in the absence of a reward function. To this end, we propose a novel approach to learn a…

Computer Vision and Pattern Recognition · Computer Science 2020-02-07 Oier Mees , Markus Merklinger , Gabriel Kalweit , Wolfram Burgard

Temporal abstraction in reinforcement learning (RL), offers the promise of improving generalization and knowledge transfer in complex environments, by propagating information more efficiently over time. Although option learning was…

Machine Learning · Computer Science 2021-12-07 Martin Klissarov , Doina Precup

In this work we introduce a new framework for performing temporal predictions in the presence of uncertainty. It is based on a simple idea of disentangling components of the future state which are predictable from those which are inherently…

Artificial Intelligence · Computer Science 2017-12-04 Mikael Henaff , Junbo Zhao , Yann LeCun

Traditionally, reinforcement learning methods predict the next action based on the current state. However, in many situations, directly applying actions to control systems or robots is dangerous and may lead to unexpected behaviors because…

Robotics · Computer Science 2020-11-03 Nan Lin , Yuxuan Li , Yujun Zhu , Ruolin Wang , Xiayu Zhang , Jianmin Ji , Keke Tang , Xiaoping Chen , Xinming Zhang

Classical policy search algorithms for robotics typically require performing extensive explorations, which are time-consuming and expensive to implement with real physical platforms. To facilitate the efficient learning of robot…

Robotics · Computer Science 2023-04-25 Shengzeng Huo , Anqing Duan , Lijun Han , Luyin Hu , Hesheng Wang , David Navarro-Alarcon

Tool use is essential for enabling robots to perform complex real-world tasks, but learning such skills requires extensive datasets. While teleoperation is widely used, it is slow, delay-sensitive, and poorly suited for dynamic tasks. In…

Robotics · Computer Science 2025-09-16 Haonan Chen , Cheng Zhu , Shuijing Liu , Yunzhu Li , Katherine Driggs-Campbell

Reinforcement learning has been applied to many interesting problems such as the famous TD-gammon and the inverted helicopter flight. However, little effort has been put into developing methods to learn policies for complex persistent tasks…

Artificial Intelligence · Computer Science 2016-06-22 Xiao Li , Calin Belta

Humans can leverage physical interaction to teach robot arms. This physical interaction takes multiple forms depending on the task, the user, and what the robot has learned so far. State-of-the-art approaches focus on learning from a single…

Robotics · Computer Science 2024-01-11 Shaunak A. Mehta , Dylan P. Losey

Identifying statistical regularities in solutions to some tasks in multi-task reinforcement learning can accelerate the learning of new tasks. Skill learning offers one way of identifying these regularities by decomposing pre-collected…

Machine Learning · Computer Science 2022-12-12 Yiding Jiang , Evan Zheran Liu , Benjamin Eysenbach , Zico Kolter , Chelsea Finn

Learning from Demonstration (LfD) enables robots to acquire versatile skills by learning motion policies from human demonstrations. It endows users with an intuitive interface to transfer new skills to robots without the need for…

Robotics · Computer Science 2023-10-27 Jianyong Sun , Jens Kober , Michael Gienger , Jihong Zhu

We design a new approach that allows robot learning of new activities from unlabeled human example videos. Given videos of humans executing the same activity from a human's viewpoint (i.e., first-person videos), our objective is to make the…

Robotics · Computer Science 2017-07-25 Jangwon Lee , Michael S. Ryoo

Machine learning, artificial intelligence and especially deep learning based approaches are often used to simplify or eliminate the burden of programming industrial robots. Using these approaches robots inherently learn a skill instead of…

Robotics · Computer Science 2021-04-22 Sanaz Behbahani , Siddharth Chhatpar , Said Zahrai , Vishakh Duggal , Mohak Sukhwani

Learning from demonstrations is an easy and intuitive way to show examples of successful behavior to a robot. However, the fact that humans optimize or take advantage of their body and not of the robot, usually called the embodiment problem…

Robotics · Computer Science 2019-03-19 Okan Koc , Jan Peters

Learning from visual data opens the potential to accrue a large range of manipulation behaviors by leveraging human demonstrations without specifying each of them mathematically, but rather through natural task specification. In this paper,…

Robotics · Computer Science 2021-11-16 Haoyu Xiong , Quanzhou Li , Yun-Chun Chen , Homanga Bharadhwaj , Samarth Sinha , Animesh Garg

Imitation learning is an effective approach for autonomous systems to acquire control policies when an explicit reward function is unavailable, using supervision provided as demonstrations from an expert, typically a human operator.…

Machine Learning · Computer Science 2018-06-20 YuXuan Liu , Abhishek Gupta , Pieter Abbeel , Sergey Levine

One promising approach towards effective robot decision making in complex, long-horizon tasks is to sequence together parameterized skills. We consider a setting where a robot is initially equipped with (1) a library of parameterized…

Autonomous robots frequently need to detect "interesting" scenes to decide on further exploration, or to decide which data to share for cooperation. These scenarios often require fast deployment with little or no training data. Prior work…

Robotics · Computer Science 2021-12-21 Chen Wang , Yuheng Qiu , Wenshan Wang , Yafei Hu , Seungchan Kim , Sebastian Scherer

To be capable of lifelong learning in a real-life environment, robots have to tackle multiple challenges. Being able to relate physical properties they may observe in their environment to possible interactions they may have is one of them.…

Artificial Intelligence · Computer Science 2020-09-24 Alexandre Manoury , Sao Mai Nguyen , Cédric Buche

Humans are adept at learning new tasks by watching a few instructional videos. On the other hand, robots that learn new actions either require a lot of effort through trial and error, or use expert demonstrations that are challenging to…

Robotics · Computer Science 2020-11-16 Vladimír Petrík , Makarand Tapaswi , Ivan Laptev , Josef Sivic