English
Related papers

Related papers: ThriftyDAgger: Budget-Aware Novelty and Risk Gatin…

200 papers

Deep neural networks trained on demonstrations of human actions give robot the ability to perform self-driving on the road. However, navigation in a pedestrian-rich environment, such as a campus setup, is still challenging---one needs to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Jing Bi , Tianyou Xiao , Qiuyue Sun , Chenliang Xu

Existing on-policy imitation learning algorithms, such as DAgger, assume access to a fixed supervisor. However, there are many settings where the supervisor may evolve during policy learning, such as a human performing a novel task or an…

Machine Learning · Computer Science 2020-05-19 Ashwin Balakrishna , Brijen Thananjeyan , Jonathan Lee , Felix Li , Arsh Zahed , Joseph E. Gonzalez , Ken Goldberg

Human teaching effort is a significant bottleneck for the broader applicability of interactive imitation learning. To reduce the number of required queries, existing methods employ active learning to query the human teacher only in…

Machine Learning · Computer Science 2025-08-08 Jelle Luijkx , Zlatan Ajanović , Laura Ferranti , Jens Kober

Interactive imitation learning is an efficient, model-free method through which a robot can learn a task by repetitively iterating an execution of a learning policy and a data collection by querying human demonstrations. However, deploying…

Robotics · Computer Science 2024-02-22 Hanbit Oh , Takamitsu Matsubara

Imitation Learning is a promising paradigm for learning complex robot manipulation skills by reproducing behavior from human demonstrations. However, manipulation tasks often contain bottleneck regions that require a sequence of precise…

Robotics · Computer Science 2020-12-15 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Yuke Zhu , Li Fei-Fei , Silvio Savarese

As robots become ubiquitous in the workforce, it is essential that human-robot collaboration be both intuitive and adaptive. A robot's quality improves based on its ability to explicitly reason about the time-varying (i.e. learning curves)…

Robotics · Computer Science 2020-07-10 Ruisen Liu , Manisha Natarajan , Matthew Gombolay

Solving sequential decision prediction problems, including those in imitation learning settings, requires mitigating the problem of covariate shift. The standard approach, DAgger, relies on capturing expert behaviour in all states that the…

Machine Learning · Computer Science 2019-06-20 Paul Budnarain , Renato Ferreira Pinto Junior , Ilan Kogan

Visual imitation learning provides a framework for learning complex manipulation behaviors by leveraging human demonstrations. However, current interfaces for imitation such as kinesthetic teaching or teleoperation prohibitively restrict…

Robotics · Computer Science 2020-08-12 Sarah Young , Dhiraj Gandhi , Shubham Tulsiani , Abhinav Gupta , Pieter Abbeel , Lerrel Pinto

While Machine learning gives rise to astonishing results in automated systems, it is usually at the cost of large data requirements. This makes many successful algorithms from machine learning unsuitable for human-machine interaction, where…

Human-Computer Interaction · Computer Science 2021-09-30 Jan Philip Göpfert , Ulrike Kuhl , Lukas Hindemith , Heiko Wersing , Barbara Hammer

Imitation learning is a powerful paradigm for training robotic policies, yet its performance is limited by compounding errors: minor policy inaccuracies could drive robots into unseen out-of-distribution (OOD) states in the training set,…

Robotics · Computer Science 2026-04-14 Anlan Yu , Zaishu Chen , Peili Song , Zhiqing Hong , Haotian Wang , Desheng Zhang , Tian He , Yi Ding , Daqing Zhang

As robots and other intelligent agents move from simple environments and problems to more complex, unstructured settings, manually programming their behavior has become increasingly challenging and expensive. Often, it is easier for a…

Robotics · Computer Science 2018-11-19 Takayuki Osa , Joni Pajarinen , Gerhard Neumann , J. Andrew Bagnell , Pieter Abbeel , Jan Peters

Deep Reinforcement Learning (RL) techniques can benefit greatly from leveraging prior experience, which can be either self-generated or acquired from other entities. Action advising is a framework that provides a flexible way to transfer…

Machine Learning · Computer Science 2021-07-01 Ercument Ilhan , Jeremy Gow , Diego Perez-Liebana

Recent successes in machine learning have led to a shift in the design of autonomous systems, improving performance on existing tasks and rendering new applications possible. Data-focused approaches gain relevance across diverse, intricate…

Machine Learning · Computer Science 2019-04-17 Markus Wulfmeier

The primary goal of reinforcement learning is to develop decision-making policies that prioritize optimal performance, frequently without considering safety. In contrast, safe reinforcement learning seeks to reduce or avoid unsafe behavior.…

Machine Learning · Computer Science 2025-06-17 Zahra Shahrooei , Ali Baheri

Shared-autonomy imitation learning lets a human correct a robot in real time, mitigating covariate-shift errors. Yet existing approaches ignore two critical factors: (i) the operator's cognitive load and (ii) the risk created by delayed or…

Robotics · Computer Science 2025-06-18 Taewoo Kim , Donghyung Kim , Minsu Jang , Jaehong Kim

In practice, imitation learning is preferred over pure reinforcement learning whenever it is possible to design a teaching agent to provide expert supervision. However, we show that when the teaching agent makes decisions with access to…

Machine Learning · Computer Science 2021-12-06 Luca Weihs , Unnat Jain , Iou-Jen Liu , Jordi Salvador , Svetlana Lazebnik , Aniruddha Kembhavi , Alexander Schwing

Diffusion policies trained via offline behavioral cloning have recently gained traction in robotic motion generation. While effective, these policies typically require a large number of trainable parameters. This model size affords powerful…

Robotics · Computer Science 2025-04-29 Xiatao Sun , Shuo Yang , Yinxing Chen , Francis Fan , Yiyan Liang , Daniel Rakita

A learning dialogue agent can infer its behaviour from interactions with the users. These interactions can be taken from either human-to-human or human-machine conversations. However, human interactions are scarce and costly, making…

Computation and Language · Computer Science 2020-12-10 Thibault Cordier , Tanguy Urvoy , Lina M. Rojas-Barahona , Fabrice Lefèvre

Dexterous object manipulation remains an open problem in robotics, despite the rapid progress in machine learning during the past decade. We argue that a hindrance is the high cost of experimentation on real systems, in terms of both time…

Ensuring human safety in collaborative robotics can compromise efficiency because traditional safety measures increase robot cycle time when human interaction is frequent. This paper proposes a safety-aware approach to mitigate efficiency…

Robotics · Computer Science 2025-12-22 M. Faroni , A. Spano , A. M. Zanchettin , P. Rocco