中文
相关论文

相关论文: Sample-Efficient Expert Query Control in Active Im…

200 篇论文

Providing expert trajectories in the context of Imitation Learning is often expensive and time-consuming. The goal must therefore be to create algorithms which require as little expert data as possible. In this paper we present an algorithm…

机器学习 · 计算机科学 2022-06-14 Jonas Nüßlein , Steffen Illium , Robert Müller , Thomas Gabor , Claudia Linnhoff-Popien

Although robotic imitation learning (RIL) is promising for embodied intelligent robots, existing RIL approaches rely on computationally intensive multi-model trajectory predictions, resulting in slow execution and limited real-time…

机器人学 · 计算机科学 2024-12-31 Jun Xie , Zhicheng Wang , Jianwei Tan , Huanxu Lin , Xiaoguang Ma

Many modern methods for imitation learning and inverse reinforcement learning, such as GAIL or AIRL, are based on an adversarial formulation. These methods apply GANs to match the expert's distribution over states and actions with the…

机器学习 · 计算机科学 2020-08-11 Oleg Arenz , Gerhard Neumann

We propose a general framework for causal Imitation Learning (IL) with hidden confounders, which subsumes several existing settings. Our framework accounts for two types of hidden confounders: (a) variables observed by the expert but not by…

机器学习 · 计算机科学 2026-02-02 Daqian Shao , Thomas Kleine Buening , Marta Kwiatkowska

We develop algorithms for imitation learning from policy data that was corrupted by temporally correlated noise in expert actions. When noise affects multiple timesteps of recorded data, it can manifest as spurious correlations between…

机器学习 · 计算机科学 2022-02-04 Gokul Swamy , Sanjiban Choudhury , J. Andrew Bagnell , Zhiwei Steven Wu

Most existing imitation learning approaches assume the demonstrations are drawn from experts who are optimal, but relaxing this assumption enables us to use a wider range of data. Standard imitation learning may learn a suboptimal policy…

机器学习 · 计算机科学 2022-01-27 Songyuan Zhang , Zhangjie Cao , Dorsa Sadigh , Yanan Sui

Exemplar-Free Class Incremental Learning (EFCIL) tackles the problem of training a model on a sequence of tasks without access to past data. Existing state-of-the-art methods represent classes as Gaussian distributions in the feature…

机器学习 · 计算机科学 2024-10-29 Grzegorz Rypeść , Sebastian Cygert , Tomasz Trzciński , Bartłomiej Twardowski

Imitation learning (IL) has achieved considerable success in solving complex sequential decision-making problems. However, current IL methods mainly assume that the environment for learning policies is the same as the environment for…

机器学习 · 计算机科学 2023-10-24 Siyuan Li , Xun Wang , Rongchang Zuo , Kewu Sun , Lingfei Cui , Jishiyu Ding , Peng Liu , Zhe Ma

We introduce supervised contrastive active learning (SCAL) and propose efficient query strategies in active learning based on the feature similarity (featuresim) and principal component analysis based feature-reconstruction error (fre) to…

机器学习 · 计算机科学 2022-08-16 Ranganath Krishnan , Nilesh Ahuja , Alok Sinha , Mahesh Subedar , Omesh Tickoo , Ravi Iyer

Imitation learning aims to learn a policy from observing expert demonstrations without access to reward signals from environments. Generative adversarial imitation learning (GAIL) formulates imitation learning as adversarial learning,…

机器学习 · 计算机科学 2024-11-27 Chun-Mao Lai , Hsiang-Chun Wang , Ping-Chun Hsieh , Yu-Chiang Frank Wang , Min-Hung Chen , Shao-Hua Sun

In many settings, it is desirable to learn decision-making and control policies through learning or bootstrapping from expert demonstrations. The most common approaches under this Imitation Learning (IL) framework are Behavioural Cloning…

机器学习 · 计算机科学 2019-11-07 Seyed Kamyar Seyed Ghasemipour , Richard Zemel , Shixiang Gu

Learning visuomotor policies for agile quadrotor flight presents significant difficulties, primarily from inefficient policy exploration caused by high-dimensional visual inputs and the need for precise and low-latency control. To address…

机器人学 · 计算机科学 2024-11-13 Jiaxu Xing , Angel Romero , Leonard Bauersfeld , Davide Scaramuzza

Continual Imitation Learning (CiL) involves extracting and accumulating task knowledge from demonstrations across multiple stages and tasks to achieve a multi-task policy. With recent advancements in foundation models, there has been a…

机器学习 · 计算机科学 2025-01-22 Daehee Lee , Minjong Yoo , Woo Kyung Kim , Wonje Choi , Honguk Woo

Imitation learning methods seek to learn from an expert either through behavioral cloning (BC) of the policy or inverse reinforcement learning (IRL) of the reward. Such methods enable agents to learn complex tasks from humans that are…

机器学习 · 计算机科学 2023-12-07 Joe Watson , Sandy H. Huang , Nicolas Heess

Understanding an agent's goals from its behavior is fundamental to aligning AI systems with human intentions. Existing goal recognition methods typically rely on an optimal goal-oriented policy representation, which may differ from the…

人工智能 · 计算机科学 2026-02-17 Osher Elhadad , Felipe Meneguzzi , Reuth Mirsky

Training a policy in a source domain for deployment in the target domain under a dynamics shift can be challenging, often resulting in performance degradation. Previous work tackles this challenge by training on the source domain with…

机器学习 · 计算机科学 2024-11-18 Yihong Guo , Yixuan Wang , Yuanyuan Shi , Pan Xu , Anqi Liu

End-to-end autonomous driving models trained solely with imitation learning (IL) often suffer from poor generalization. In contrast, reinforcement learning (RL) promotes exploration through reward maximization but faces challenges such as…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Xiaoji Zheng , Ziyuan Yang , Yanhao Chen , Yuhang Peng , Yuanrong Tang , Gengyuan Liu , Bokui Chen , Jiangtao Gong

Few-Shot Class-Incremental Learning (FSCIL) models aim to incrementally learn new classes with scarce samples while preserving knowledge of old ones. Existing FSCIL methods usually fine-tune the entire backbone, leading to overfitting and…

机器学习 · 计算机科学 2024-07-18 Chenxi Liu , Zhenyi Wang , Tianyi Xiong , Ruibo Chen , Yihan Wu , Junfeng Guo , Heng Huang

Imitation Learning (IL) methods seek to match the behavior of an agent with that of an expert. In the present work, we propose a new IL method based on a conceptually simple algorithm: Primal Wasserstein Imitation Learning (PWIL), which…

机器学习 · 计算机科学 2021-03-18 Robert Dadashi , Léonard Hussenot , Matthieu Geist , Olivier Pietquin

Compared to reinforcement learning, imitation learning (IL) is a powerful paradigm for training agents to learn control policies efficiently from expert demonstrations. However, in most cases, obtaining demonstration data is costly and…

机器学习 · 计算机科学 2019-03-20 Naijun Liu , Tao Lu , Yinghao Cai , Boyao Li , Shuo Wang