English
Related papers

Related papers: Learning Dolly-In Filming From Demonstration Using…

200 papers

Animals are able to imitate each others' behavior, despite their difference in biomechanics. In contrast, imitating the other similar robots is a much more challenging task in robotics. This problem is called cross domain imitation…

Robotics · Computer Science 2021-09-14 Zhao-Heng Yin , Lingfeng Sun , Hengbo Ma , Masayoshi Tomizuka , Wu-Jun Li

In this paper, we explore deep reinforcement learning algorithms for vision-based robotic grasping. Model-free deep reinforcement learning (RL) has been successfully applied to a range of challenging environments, but the proliferation of…

Robotics · Computer Science 2018-03-30 Deirdre Quillen , Eric Jang , Ofir Nachum , Chelsea Finn , Julian Ibarz , Sergey Levine

In this paper, we deal with the reality gap from a novel perspective, targeting transferring Deep Reinforcement Learning (DRL) policies learned in simulated environments to the real-world domain for visual control tasks. Instead of adopting…

Robotics · Computer Science 2019-01-17 Jingwei Zhang , Lei Tai , Peng Yun , Yufeng Xiong , Ming Liu , Joschka Boedecker , Wolfram Burgard

Deep Reinforcement Learning has been successfully applied to learn robotic control. However, the corresponding algorithms struggle when applied to problems where the agent is only rewarded after achieving a complex task. In this context,…

Robotics · Computer Science 2023-04-18 Alexandre Chenu , Olivier Serris , Olivier Sigaud , Nicolas Perrin-Gilbert

Learning from Demonstration (LfD) systems are commonly used to teach robots new tasks by generating a set of skills from user-provided demonstrations. These skills can then be sequenced by planning algorithms to execute complex tasks.…

Robotics · Computer Science 2024-12-12 Maximilian Diehl , Tathagata Chakraborti , Karinne Ramirez-Amaro

Imitation learning aims to learn a policy from observing expert demonstrations without access to reward signals from environments. Generative adversarial imitation learning (GAIL) formulates imitation learning as adversarial learning,…

Machine Learning · Computer Science 2024-11-27 Chun-Mao Lai , Hsiang-Chun Wang , Ping-Chun Hsieh , Yu-Chiang Frank Wang , Min-Hung Chen , Shao-Hua Sun

Combining model-based and model-free deep reinforcement learning has shown great promise for improving sample efficiency on complex control tasks while still retaining high performance. Incorporating imagination is a recent effort in this…

Machine Learning · Computer Science 2019-10-11 Muhammad Burhan Hafez , Cornelius Weber , Matthias Kerzel , Stefan Wermter

Imitation learning (IL) is a popular paradigm for training policies in robotic systems when specifying the reward function is difficult. However, despite the success of IL algorithms, they impose the somewhat unrealistic requirement that…

Machine Learning · Computer Science 2022-02-16 Luca Viano , Yu-Ting Huang , Parameswaran Kamalaruban , Craig Innes , Subramanian Ramamoorthy , Adrian Weller

Adversarial imitation learning (AIL) has become a popular alternative to supervised imitation learning that reduces the distribution shift suffered by the latter. However, AIL requires effective exploration during an online reinforcement…

Machine Learning · Computer Science 2023-10-16 Trevor Ablett , Bryan Chan , Jonathan Kelly

Many advanced Learning from Demonstration (LfD) methods consider the decomposition of complex, real-world tasks into simpler sub-tasks. By reusing the corresponding sub-policies within and between tasks, they provide training data for each…

Machine Learning · Computer Science 2018-08-13 Kyriacos Shiarlis , Markus Wulfmeier , Sasha Salter , Shimon Whiteson , Ingmar Posner

World models simulate dynamic environments, enabling agents to interact with diverse input modalities. Although recent advances have improved the visual quality and temporal consistency of video world models, their ability of accurately…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Yang Ye , Tianyu He , Shuo Yang , Jiang Bian

While combining imitation learning (IL) and reinforcement learning (RL) is a promising way to address poor sample efficiency in autonomous behavior acquisition, methods that do so typically assume that the requisite behavior demonstrations…

Machine Learning · Computer Science 2025-08-19 Caroline Wang , Garrett Warnell , Peter Stone

In robotics, Learning from Demonstration (LfD) aims to transfer skills to robots by using multiple demonstrations of the same task. These demonstrations are recorded and processed to extract a consistent skill representation. This process…

Robotics · Computer Science 2025-12-01 Giovanni Braglia , Davide Tebaldi , André Eugenio Lazzaretti , Luigi Biagiotti

Methods for learning from demonstration (LfD) have shown success in acquiring behavior policies by imitating a user. However, even for a single task, LfD may require numerous demonstrations. For versatile agents that must learn many tasks…

Machine Learning · Computer Science 2022-07-04 Jorge A. Mendez , Shashank Shivkumar , Eric Eaton

Automating end-to-end Exploratory Data Analysis (AutoEDA) is a challenging open problem, often tackled through Reinforcement Learning (RL) by learning to predict a sequence of analysis operations (FILTER, GROUP, etc). Defining rewards for…

Machine Learning · Computer Science 2024-10-16 Abhijit Manatkar , Devarsh Patel , Hima Patel , Naresh Manwani

Large Language Models (LLMs) have demonstrated an impressive capability known as In-context Learning (ICL), which enables them to acquire knowledge from textual demonstrations without the need for parameter updates. However, many studies…

Computation and Language · Computer Science 2024-06-04 Yi Su , Yunpeng Tai , Yixin Ji , Juntao Li , Bowen Yan , Min Zhang

This paper addresses the problem of learning a task from demonstration. We adopt the framework of inverse reinforcement learning, where tasks are represented in the form of a reward function. Our contribution is a novel active learning…

Machine Learning · Computer Science 2013-01-24 Francisco Melo , Manuel Lopes

Learning from demonstration (LfD) is considered as an efficient way to transfer skills from humans to robots. Traditionally, LfD has been used to transfer Cartesian and joint positions and forces from human demonstrations. The traditional…

Robotics · Computer Science 2024-07-31 Fares J. Abu-Dakka , Matteo Saveriano , Ville Kyrki

Reproducing the diverse and agile locomotion skills of animals has been a longstanding challenge in robotics. While manually-designed controllers have been able to emulate many complex behaviors, building such controllers involves a…

Robotics · Computer Science 2020-07-22 Xue Bin Peng , Erwin Coumans , Tingnan Zhang , Tsang-Wei Lee , Jie Tan , Sergey Levine

Learning from demonstrations (LfD) enables humans to easily teach collaborative robots (cobots) new motions that can be generalized to new task configurations without retraining. However, state-of-the-art LfD methods require manually tuning…

Robotics · Computer Science 2023-09-27 Lorenzo Panchetti , Jianhao Zheng , Mohamed Bouri , Malcolm Mielle