English
Related papers

Related papers: Domain-Invariant Per-Frame Feature Extraction for …

200 papers

Human beings are able to understand objectives and learn by simply observing others perform a task. Imitation learning methods aim to replicate such capabilities, however, they generally depend on access to a full set of optimal states and…

Machine Learning · Computer Science 2021-03-10 Edoardo Cetin , Oya Celiktutan

Often times in imitation learning (IL), the environment we collect expert demonstrations in and the environment we want to deploy our learned policy in aren't exactly the same (e.g. demonstrations collected in simulation but deployment in…

Neural and Evolutionary Computing · Computer Science 2024-06-19 Silvia Sapora , Gokul Swamy , Chris Lu , Yee Whye Teh , Jakob Nicolaus Foerster

Incremental Learning (IL) aims to accumulate knowledge from sequential input tasks while overcoming catastrophic forgetting. Existing IL methods typically assume that an incoming task has only increments of classes or domains, referred to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Min-Yeong Park , Jae-Ho Lee , Gyeong-Moon Park

As artificial intelligence advances rapidly, particularly with the advent of GANs and diffusion models, the accuracy of Image Inpainting Localization (IIL) has become increasingly challenging. Current IIL methods face two main challenges: a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Kai Wang , Shaozhang Niu , Qixian Hao , Jiwei Zhang

Imitation learning seeks to circumvent the difficulty in designing proper reward functions for training agents by utilizing expert behavior. With environments modeled as Markov Decision Processes (MDP), most of the existing imitation…

Machine Learning · Computer Science 2021-05-24 Dripta S. Raychaudhuri , Sujoy Paul , Jeroen van Baar , Amit K. Roy-Chowdhury

Imitation learning (IL) is a frequently used approach for data-efficient policy learning. Many IL methods, such as Dataset Aggregation (DAgger), combat challenges like distributional shift by interacting with oracular experts.…

Robotics · Computer Science 2021-06-08 Mandy Xie , Anqi Li , Karl Van Wyk , Frank Dellaert , Byron Boots , Nathan Ratliff

We show that a critical vulnerability in adversarial imitation is the tendency of discriminator networks to learn spurious associations between visual features and expert labels. When the discriminator focuses on task-irrelevant features,…

In many sequential decision-making problems (e.g., robotics control, game playing, sequential prediction), human or expert data is available containing useful information about the task. However, imitation learning (IL) from a small amount…

Machine Learning · Computer Science 2022-11-04 Divyansh Garg , Shuvam Chakraborty , Chris Cundy , Jiaming Song , Matthieu Geist , Stefano Ermon

While combining imitation learning (IL) and reinforcement learning (RL) is a promising way to address poor sample efficiency in autonomous behavior acquisition, methods that do so typically assume that the requisite behavior demonstrations…

Machine Learning · Computer Science 2025-08-19 Caroline Wang , Garrett Warnell , Peter Stone

In recent years, the upstream of Large Language Models (LLM) has also encouraged the computer vision community to work on substantial multimodal datasets and train models on a scale in a self-/semi-supervised manner, resulting in Vision…

Computer Vision and Pattern Recognition · Computer Science 2024-06-17 Keno Moenck , Duc Trung Thieu , Julian Koch , Thorsten Schüppstuhl

We present a novel and unified deep learning framework which is capable of learning domain-invariant representation from data across multiple domains. Realized by adversarial training with additional ability to exploit domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Alexander H. Liu , Yen-Cheng Liu , Yu-Ying Yeh , Yu-Chiang Frank Wang

Recent advances in unsupervised domain adaptation (UDA) techniques have witnessed great success in cross-domain computer vision tasks, enhancing the generalization ability of data-driven deep learning architectures by bridging the domain…

Computer Vision and Pattern Recognition · Computer Science 2022-01-07 Dongnan Liu , Chaoyi Zhang , Yang Song , Heng Huang , Chenyu Wang , Michael Barnett , Weidong Cai

Imitation Learning (IL) has achieved remarkable success across various domains, including robotics, autonomous driving, and healthcare, by enabling agents to learn complex behaviors from expert demonstrations. However, existing IL methods…

Machine Learning · Computer Science 2026-01-06 Shangzhe Li , Zhiao Huang , Hao Su

Many imitation learning (IL) algorithms use inverse reinforcement learning (IRL) to infer a reward function that aligns with the demonstration. However, the inferred reward functions often fail to capture the underlying task objectives. In…

Machine Learning · Computer Science 2024-11-01 Weichao Zhou , Wenchao Li

In offline imitation learning (IL), an agent aims to learn an optimal expert behavior policy without additional online environment interactions. However, in many real-world scenarios, such as robotics manipulation, the offline dataset is…

Machine Learning · Computer Science 2024-01-01 Bowei He , Zexu Sun , Jinxin Liu , Shuai Zhang , Xu Chen , Chen Ma

In Imitation Learning (IL), utilizing suboptimal and heterogeneous demonstrations presents a substantial challenge due to the varied nature of real-world data. However, standard IL algorithms consider these datasets as homogeneous, thereby…

Machine Learning · Computer Science 2024-12-16 Mark Beliaev , Ramtin Pedarsani

When faced with accomplishing a task, human experts exhibit intentional behavior. Their unique intents shape their plans and decisions, resulting in experts demonstrating diverse behaviors to accomplish the same task. Due to the…

Machine Learning · Computer Science 2024-04-29 Sangwon Seo , Vaibhav Unhelkar

Recovering reward function from expert demonstrations is a fundamental problem in reinforcement learning. The recovered reward function captures the motivation of the expert. Agents can imitate experts by following these reward functions in…

Machine Learning · Computer Science 2024-06-27 Fan-Ming Luo , Xingchen Cao , Rong-Jun Qin , Yang Yu

Visuomotor imitation learning policies enable robots to efficiently acquire manipulation skills from visual demonstrations. However, as scene complexity and visual distractions increase, policies that perform well in simple settings often…

Artificial Intelligence · Computer Science 2025-11-11 Yuhang Dong , Haizhou Ge , Yupei Zeng , Jiangning Zhang , Beiwen Tian , Hongrui Zhu , Yufei Jia , Ruixiang Wang , Zhucun Xue , Guyue Zhou , Longhua Ma , Guanzhong Tian

Compared with the image-based static facial expression recognition (SFER) task, the dynamic facial expression recognition (DFER) task based on video sequences is closer to the natural expression recognition scene. However, DFER is often…

Computer Vision and Pattern Recognition · Computer Science 2022-08-23 Hanting Li , Hongjing Niu , Zhaoqing Zhu , Feng Zhao