中文
相关论文

相关论文: Improving Learning from Demonstrations by Learning…

200 篇论文

In this work we describe a novel deep reinforcement learning architecture that allows multiple actions to be selected at every time-step in an efficient manner. Multi-action policies allow complex behaviours to be learnt that would…

Despite its promise, imitation learning often fails in long-horizon environments where perfect replication of demonstrations is unrealistic and small errors can accumulate catastrophically. We introduce Cago (Capability-Aware Goal…

人工智能 · 计算机科学 2026-01-14 Yuanlin Duan , Yuning Wang , Wenjie Qiu , He Zhu

We study the problem of sample efficient reinforcement learning, where prior data such as demonstrations are provided for initialization in lieu of a dense reward signal. A natural approach is to incorporate an imitation learning objective,…

机器学习 · 计算机科学 2025-06-10 Perry Dong , Alec M. Lessing , Annie S. Chen , Chelsea Finn

Robust real-world learning should benefit from both demonstrations and interactions with the environment. Current approaches to learning from demonstration and reward perform supervised learning on expert demonstration data and use…

人工智能 · 计算机科学 2019-05-31 Yang Gao , Huazhe Xu , Ji Lin , Fisher Yu , Sergey Levine , Trevor Darrell

Learning from demonstration (LfD) techniques seek to enable novice users to teach robots novel tasks in the real world. However, prior work has shown that robot-centric LfD approaches, such as Dataset Aggregation (DAgger), do not perform…

机器人学 · 计算机科学 2021-10-08 Mariah L. Schrum , Erin Hedlund , Matthew C. Gombolay

Robust imitation learning using disturbance injections overcomes issues of limited variation in demonstrations. However, these methods assume demonstrations are optimal, and that policy stabilization can be learned via simple augmentations.…

机器人学 · 计算机科学 2022-05-10 Hirotaka Tahara , Hikaru Sasaki , Hanbit Oh , Brendan Michael , Takamitsu Matsubara

Automating robotic surgery via learning from demonstration (LfD) techniques is extremely challenging. This is because surgical tasks often involve sequential decision-making processes with complex interactions of physical objects and have…

机器人学 · 计算机科学 2024-10-11 Zohre Karimi , Shing-Hei Ho , Bao Thach , Alan Kuntz , Daniel S. Brown

Methods for learning from demonstration (LfD) have shown success in acquiring behavior policies by imitating a user. However, even for a single task, LfD may require numerous demonstrations. For versatile agents that must learn many tasks…

机器学习 · 计算机科学 2022-07-04 Jorge A. Mendez , Shashank Shivkumar , Eric Eaton

Imitation learning (IL) is a framework that learns to imitate expert behavior from demonstrations. Recently, IL shows promising results on high dimensional and control tasks. However, IL typically suffers from sample inefficiency in terms…

机器学习 · 计算机科学 2021-11-24 Lihua Zhang

With growing access to versatile robotics, it is beneficial for end users to be able to teach robots tasks without needing to code a control policy. One possibility is to teach the robot through successful task executions. However,…

机器人学 · 计算机科学 2021-04-01 Aleksandra Kalinowska , Ahalya Prabhakar , Kathleen Fitzsimons , Todd Murphey

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as homogeneous, thereby…

机器学习 · 计算机科学 2024-12-16 Mark Beliaev , Ramtin Pedarsani

Practical Imitation Learning (IL) systems rely on large human demonstration datasets for successful policy learning. However, challenges lie in maintaining the quality of collected data and addressing the suboptimal nature of some…

机器人学 · 计算机科学 2025-05-07 Sachit Kuhar , Shuo Cheng , Shivang Chopra , Matthew Bronars , Danfei Xu

Many existing imitation learning datasets are collected from multiple demonstrators, each with different expertise at different parts of the environment. Yet, standard imitation learning algorithms typically treat all demonstrators as…

机器学习 · 计算机科学 2022-06-14 Mark Beliaev , Andy Shih , Stefano Ermon , Dorsa Sadigh , Ramtin Pedarsani

Deep reinforcement learning (DRL) is a promising way to achieve human-like autonomous driving. However, the low sample efficiency and difficulty of designing reward functions for DRL would hinder its applications in practice. In light of…

机器人学 · 计算机科学 2021-10-29 Zhiyu Huang , Jingda Wu , Chen Lv

Many advanced Learning from Demonstration (LfD) methods consider the decomposition of complex, real-world tasks into simpler sub-tasks. By reusing the corresponding sub-policies within and between tasks, they provide training data for each…

机器学习 · 计算机科学 2018-08-13 Kyriacos Shiarlis , Markus Wulfmeier , Sasha Salter , Shimon Whiteson , Ingmar Posner

Imitation learning has achieved great success in many sequential decision-making tasks, in which a neural agent is learned by imitating collected human demonstrations. However, existing algorithms typically require a large number of…

机器学习 · 计算机科学 2023-06-14 Tianxiang Zhao , Wenchao Yu , Suhang Wang , Lu Wang , Xiang Zhang , Yuncong Chen , Yanchi Liu , Wei Cheng , Haifeng Chen

Imitation learning is a popular paradigm to teach robots new tasks, but collecting robot demonstrations through teleoperation or kinesthetic teaching is tedious and time-consuming. In contrast, directly demonstrating a task using our human…

机器人学 · 计算机科学 2026-02-16 Nick Heppert , Minh Quang Nguyen , Abhinav Valada

Learning from Demonstration (LfD) is a paradigm that allows robots to learn complex manipulation tasks that can not be easily scripted, but can be demonstrated by a human teacher. One of the challenges of LfD is to enable robots to acquire…

机器人学 · 计算机科学 2021-02-08 Miguel Arduengo , Adrià Colomé , Júlia Borràs , Luis Sentis , Carme Torras

A major bottleneck in imitation learning is the requirement of a large number of expert demonstrations, which can be expensive or inaccessible. Learning from supplementary demonstrations without strict quality requirements has emerged as a…

机器学习 · 计算机科学 2024-12-31 Jiangdong Fan , Hongcai He , Paul Weng , Hui Xu , Jie Shao

Learning-from-demonstrations is an emerging paradigm to obtain effective robot control policies for complex tasks via reinforcement learning without the need to explicitly design reward functions. However, it is susceptible to imperfections…

机器人学 · 计算机科学 2021-02-16 Aniruddh G. Puranic , Jyotirmoy V. Deshmukh , Stefanos Nikolaidis