中文
相关论文

相关论文: Adversarial Imitation Learning from Video using a …

200 篇论文

To learn from data collected in diverse dynamics, Imitation from Observation (IfO) methods leverage expert state trajectories based on the premise that recovering expert state distributions in other dynamics facilitates policy learning in…

机器学习 · 计算机科学 2025-03-11 Zhenghai Xue , Lang Feng , Jiacheng Xu , Kang Kang , Xiang Wen , Bo An , Shuicheng Yan

We consider the problem of learning from observation (LfO), in which the agent aims to mimic the expert's behavior from the state-only demonstrations by experts. We additionally assume that the agent cannot interact with the environment but…

机器学习 · 计算机科学 2022-10-19 Geon-Hyeong Kim , Jongmin Lee , Youngsoo Jang , Hongseok Yang , Kee-Eung Kim

MoCo is effective for unsupervised image representation learning. In this paper, we propose VideoMoCo for unsupervised video representation learning. Given a video sequence as an input sample, we improve the temporal feature representations…

计算机视觉与模式识别 · 计算机科学 2021-03-18 Tian Pan , Yibing Song , Tianyu Yang , Wenhao Jiang , Wei Liu

Imitation Learning from observation describes policy learning in a similar way to human learning. An agent's policy is trained by observing an expert performing a task. While many state-only imitation learning approaches are based on…

机器学习 · 计算机科学 2024-10-02 Damian Boborzi , Christoph-Nikolas Straehle , Jens S. Buchner , Lars Mikelsons

Imitation learning seeks to learn an expert policy from sampled demonstrations. However, in the real world, it is often difficult to find a perfect expert and avoiding dangerous behaviors becomes relevant for safety reasons. We present the…

机器学习 · 计算机科学 2019-09-26 David Venuto , Leonard Boussioux , Junhao Wang , Rola Dali , Jhelum Chakravorty , Yoshua Bengio , Doina Precup

In this paper, we present a method for learning from video demonstrations by using human feedback to construct a mapping between the standard representation of the agent and the visual representation of the demonstration. In this way, we…

机器学习 · 计算机科学 2019-10-01 Sunil Gandhi , Tim Oates , Tinoosh Mohsenin , Nicholas Waytowich

Human behavior understanding in videos is a complex, still unsolved problem and requires to accurately model motion at both the local (pixel-wise dense prediction) and global (aggregation of motion cues) levels. Current approaches based on…

计算机视觉与模式识别 · 计算机科学 2019-09-19 C. Spampinato , S. Palazzo , P. D'Oro , D. Giordano , M. Shah

Face spoofing causes severe security threats in face recognition systems. Previous anti-spoofing works focused on supervised techniques, typically with either binary or auxiliary supervision. Most of them suffer from limited robustness and…

计算机视觉与模式识别 · 计算机科学 2020-05-25 Chengwei Chen , Wang Yuan , Xuequan Lu , Lizhuang Ma

Imitation learning has traditionally been applied to learn a single task from demonstrations thereof. The requirement of structured and isolated demonstrations limits the scalability of imitation learning approaches as they are difficult to…

机器人学 · 计算机科学 2017-11-27 Karol Hausman , Yevgen Chebotar , Stefan Schaal , Gaurav Sukhatme , Joseph Lim

This paper introduces a novel application of Supervised Contrastive Learning (SupCon) to Imitation Learning (IL), with a focus on learning more effective state representations for agents in video game environments. The goal is to obtain…

人工智能 · 计算机科学 2025-09-16 Carlos Celemin , Joseph Brennan , Pierluigi Vito Amadori , Tim Bradley

The learn-from-observation (LfO) paradigm is a human-inspired mode for a robot to learn to perform a task simply by watching it being performed. LfO can facilitate robot integration on factory floors by minimizing disruption and reducing…

计算机视觉与模式识别 · 计算机科学 2024-04-09 Ehsan Asali , Prashant Doshi , Jin Sun

Imitation learning enables robots to learn from demonstrations. Previous imitation learning algorithms usually assume access to optimal expert demonstrations. However, in many real-world applications, this assumption is limiting. Most…

机器学习 · 计算机科学 2021-03-11 Zhangjie Cao , Dorsa Sadigh

Accurate and robust localization is a fundamental need for mobile agents. Visual-inertial odometry (VIO) algorithms exploit the information from camera and inertial sensors to estimate position and translation. Recent deep learning based…

计算机视觉与模式识别 · 计算机科学 2022-09-20 Zheming Tu , Changhao Chen , Xianfei Pan , Ruochen Liu , Jiarui Cui , Jun Mao

In everyday life collaboration tasks between human operators and robots, the former necessitate simple ways for programming new skills, the latter have to show adaptive capabilities to cope with environmental changes. The joint use of…

机器人学 · 计算机科学 2023-09-15 Rocco Felici , Matteo Saveriano , Loris Roveda , Antonio Paolillo

This paper explores a simple regularizer for reinforcement learning by proposing Generative Adversarial Self-Imitation Learning (GASIL), which encourages the agent to imitate past good trajectories via generative adversarial imitation…

机器学习 · 计算机科学 2018-12-04 Yijie Guo , Junhyuk Oh , Satinder Singh , Honglak Lee

One of the main issues in Imitation Learning is the erroneous behavior of an agent when facing out-of-distribution situations, not covered by the set of demonstrations given by the expert. In this work, we tackle this problem by introducing…

机器人学 · 计算机科学 2020-11-20 Norman Di Palo , Edward Johns

Recently, appearance-based gaze estimation has been attracting attention in computer vision, and remarkable improvements have been achieved using various deep learning techniques. Despite such progress, most methods aim to infer gaze…

计算机视觉与模式识别 · 计算机科学 2024-01-26 Suneung Kim , Woo-Jeoung Nam , Seong-Whan Lee

In generative adversarial imitation learning (GAIL), the agent aims to learn a policy from an expert demonstration so that its performance cannot be discriminated from the expert policy on a certain predefined reward set. In this paper, we…

机器学习 · 计算机科学 2021-08-20 Zhihan Liu , Yufeng Zhang , Zuyue Fu , Zhuoran Yang , Zhaoran Wang

We propose ADIOS, a masked image model (MIM) framework for self-supervised learning, which simultaneously learns a masking function and an image encoder using an adversarial objective. The image encoder is trained to minimise the distance…

计算机视觉与模式识别 · 计算机科学 2022-07-07 Yuge Shi , N. Siddharth , Philip H. S. Torr , Adam R. Kosiorek

Imitation learning (IL) aims to learn a policy from expert demonstrations that minimizes the discrepancy between the learner and expert behaviors. Various imitation learning algorithms have been proposed with different pre-determined…

机器学习 · 计算机科学 2020-11-20 Xin Zhang , Yanhua Li , Ziming Zhang , Zhi-Li Zhang