English
Related papers

Related papers: Cross-Domain Imitation Learning with a Dual Struct…

200 papers

In this paper, we present \textbf{C}ont\textbf{E}xtual \textbf{I}mitation \textbf{L}earning~(CEIL), a general and broadly applicable algorithm for imitation learning (IL). Inspired by the formulation of hindsight information matching, we…

Machine Learning · Computer Science 2023-10-27 Jinxin Liu , Li He , Yachen Kang , Zifeng Zhuang , Donglin Wang , Huazhe Xu

Semi-supervised imitation learning (SSIL) consists in learning a policy from a small dataset of action-labeled trajectories and a much larger dataset of action-free trajectories. Some SSIL methods learn an inverse dynamics model (IDM) to…

Machine Learning · Computer Science 2026-02-04 Sacha Morin , Moonsub Byeon , Alexia Jolicoeur-Martineau , Sébastien Lachapelle

We study the question of how to imitate tasks across domains with discrepancies such as embodiment, viewpoint, and dynamics mismatch. Many prior works require paired, aligned demonstrations and an additional RL step that requires…

Machine Learning · Computer Science 2020-07-21 Kuno Kim , Yihong Gu , Jiaming Song , Shengjia Zhao , Stefano Ermon

The use of imitation learning to learn a single policy for a complex task that has multiple modes or hierarchical structure can be challenging. In fact, previous work has shown that when the modes are known, learning separate policies for…

Machine Learning · Computer Science 2019-03-13 Arjun Sharma , Mohit Sharma , Nicholas Rhinehart , Kris M. Kitani

Hierarchical Imitation Learning (HIL) is an effective way for robots to learn sub-skills from long-horizon unsegmented demonstrations. However, the learned hierarchical structure lacks the mechanism to transfer across multi-tasks or to new…

Robotics · Computer Science 2022-02-22 Chongkai Gao , Yizhou Jiang , Feng Chen

In this paper we propose a novel dual adversarial co-learning approach for multi-domain text classification (MDTC). The approach learns shared-private networks for feature extraction and deploys dual adversarial regularizations to align…

Machine Learning · Computer Science 2019-09-19 Yuan Wu , Yuhong Guo

Some imitation learning methods combine behavioural cloning with self-supervision to infer actions from state pairs. However, most rely on a large number of expert trajectories to increase generalisation and human intervention to capture…

Machine Learning · Computer Science 2024-07-23 Nathan Gavenski , Juarez Monteiro , Felipe Meneguzzi , Michael Luck , Odinaldo Rodrigues

This paper focuses on Federated Domain-Incremental Learning (FDIL) where each client continues to learn incremental tasks where their domain shifts from each other. We propose a novel adaptive knowledge matching-based personalized FDIL…

Machine Learning · Computer Science 2024-07-19 Yichen Li , Wenchao Xu , Haozhao Wang , Ruixuan Li , Yining Qi , Jingcai Guo

Human beings are able to understand objectives and learn by simply observing others perform a task. Imitation learning methods aim to replicate such capabilities, however, they generally depend on access to a full set of optimal states and…

Machine Learning · Computer Science 2021-03-10 Edoardo Cetin , Oya Celiktutan

Deep imitation learning enables robots to learn from expert demonstrations to perform tasks such as lane following or obstacle avoidance. However, in the traditional imitation learning framework, one model only learns one task, and thus it…

Computer Vision and Pattern Recognition · Computer Science 2018-08-19 Junhong Xu , Qiwei Liu , Hanqing Guo , Aaron Kageza , Saeed AlQarni , Shaoen Wu

Imitation learning (IL) aims to learn a policy from expert demonstrations that minimizes the discrepancy between the learner and expert behaviors. Various imitation learning algorithms have been proposed with different pre-determined…

Machine Learning · Computer Science 2020-11-20 Xin Zhang , Yanhua Li , Ziming Zhang , Zhi-Li Zhang

Imitation learning aims to learn a policy from observing expert demonstrations without access to reward signals from environments. Generative adversarial imitation learning (GAIL) formulates imitation learning as adversarial learning,…

Machine Learning · Computer Science 2024-11-27 Chun-Mao Lai , Hsiang-Chun Wang , Ping-Chun Hsieh , Yu-Chiang Frank Wang , Min-Hung Chen , Shao-Hua Sun

Deep learning has achieved notable success in 3D object detection with the advent of large-scale point cloud datasets. However, severe performance degradation in the past trained classes, i.e., catastrophic forgetting, still remains a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Ziyuan Zhao , Mingxi Xu , Peisheng Qian , Ramanpreet Singh Pahwa , Richard Chang

Most existing imitation learning approaches assume the demonstrations are drawn from experts who are optimal, but relaxing this assumption enables us to use a wider range of data. Standard imitation learning may learn a suboptimal policy…

Machine Learning · Computer Science 2022-01-27 Songyuan Zhang , Zhangjie Cao , Dorsa Sadigh , Yanan Sui

Causality has been combined with machine learning to produce robust representations for domain generalization. Most existing methods of this type require massive data from multiple domains to identify causal features by cross-domain…

Machine Learning · Computer Science 2024-03-01 Yang Chen , Yitao Liang , Zhouchen Lin

Continual learning (CL) aims to train models sequentially over multiple domains without forgetting previously learned knowledge. However, existing CL methods optimize for in-domain performance and are therefore prone to learning spurious,…

Machine Learning · Computer Science 2026-05-18 Pascal Janetzky , Tobias Schlagenhauf , Stefan Feuerriegel

Multimodal demonstrations provide robots with an abundance of information to make sense of the world. However, such abundance may not always lead to good performance when it comes to learning sensorimotor control policies from human…

Machine Learning · Computer Science 2023-03-07 Yilun Hao , Ruinan Wang , Zhangjie Cao , Zihan Wang , Yuchen Cui , Dorsa Sadigh

Machine-learning paradigms such as imitation learning and reinforcement learning can generate highly performant agents in a variety of complex environments. However, commonly used methods require large quantities of data and/or a known…

Machine Learning · Computer Science 2024-03-05 Noah Ford , Ryan W. Gardner , Austin Juhl , Nathan Larson

Imitating skills from low-quality datasets, such as sub-optimal demonstrations and observations with distractors, is common in real-world applications. In this work, we focus on the problem of Learning from Noisy Demonstrations (LND), where…

Machine Learning · Computer Science 2024-04-05 Kaichen Huang , Hai-Hang Sun , Shenghua Wan , Minghao Shao , Shuai Feng , Le Gan , De-Chuan Zhan

Offline imitation learning (IL) is a powerful method to solve decision-making problems from expert demonstrations without reward labels. Existing offline IL methods suffer from severe performance degeneration under limited expert data.…

Machine Learning · Computer Science 2023-01-11 Wenjia Zhang , Haoran Xu , Haoyi Niu , Peng Cheng , Ming Li , Heming Zhang , Guyue Zhou , Xianyuan Zhan