English
Related papers

Related papers: An Imitation from Observation Approach to Transfer…

200 papers

Inverse Reinforcement Learning (IRL) describes the problem of learning an unknown reward function of a Markov Decision Process (MDP) from observed behavior of an agent. Since the agent's behavior originates in its policy and MDP policies…

Artificial Intelligence · Computer Science 2016-04-14 Michael Herman , Tobias Gindele , Jörg Wagner , Felix Schmitt , Wolfram Burgard

In many sequential decision-making problems (e.g., robotics control, game playing, sequential prediction), human or expert data is available containing useful information about the task. However, imitation learning (IL) from a small amount…

Machine Learning · Computer Science 2022-11-04 Divyansh Garg , Shuvam Chakraborty , Chris Cundy , Jiaming Song , Matthieu Geist , Stefano Ermon

Adversarial examples, crafted by adding perturbations imperceptible to humans, can deceive neural networks. Recent studies identify the adversarial transferability across various models, \textit{i.e.}, the cross-model attack ability of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-25 Rongyi Zhu , Zeliang Zhang , Susan Liang , Zhuo Liu , Chenliang Xu

One-shot imitation is to learn a new task from a single demonstration, yet it is a challenging problem to adopt it for complex tasks with the high domain diversity inherent in a non-stationary environment. To tackle the problem, we explore…

Artificial Intelligence · Computer Science 2024-02-14 Sangwoo Shin , Daehee Lee , Minjong Yoo , Woo Kyung Kim , Honguk Woo

Deploying learned decision-making systems often requires transferring to new sites where the sensing pipeline differs. In such cases, observations can change in semantics and dimensionality even when action primitives and objectives remain…

Machine Learning · Computer Science 2026-04-28 Zherui Huang , Yicheng Liu , Chumeng Liang , Guanjie Zheng

We examine the problem of learning mappings from state to state, suitable for use in a model-based reinforcement-learning setting, that simultaneously generalize to novel states and can capture stochastic transitions. We show that currently…

Machine Learning · Computer Science 2017-10-27 Yuhang Song , Christopher Grimm , Xianming Wang , Michael L. Littman

The success of deep reinforcement learning (RL) and imitation learning (IL) in vision-based robotic manipulation typically hinges on the expense of large scale data collection. With simulation, data to train a policy can be collected…

Robotics · Computer Science 2021-07-06 Daniel Ho , Kanishka Rao , Zhuo Xu , Eric Jang , Mohi Khansari , Yunfei Bai

Imitation learning (IL) is a frequently used approach for data-efficient policy learning. Many IL methods, such as Dataset Aggregation (DAgger), combat challenges like distributional shift by interacting with oracular experts.…

Robotics · Computer Science 2021-06-08 Mandy Xie , Anqi Li , Karl Van Wyk , Frank Dellaert , Byron Boots , Nathan Ratliff

Adversarial Imitation Learning is traditionally framed as a two-player zero-sum game between a learner and an adversarially chosen cost function, and can therefore be thought of as the sequential generalization of a Generative Adversarial…

Machine Learning · Computer Science 2025-03-04 Runzhe Wu , Yiding Chen , Gokul Swamy , Kianté Brantley , Wen Sun

Human demonstration data is often ambiguous and incomplete, motivating imitation learning approaches that also exhibit reliable planning behavior. A common paradigm to perform planning-from-demonstration involves learning a reward function…

Neural network models are vulnerable to adversarial examples, and adversarial transferability further increases the risk of adversarial attacks. Current methods based on transferability often rely on substitute models, which can be…

Computation and Language · Computer Science 2023-11-07 Minxuan Lv , Chengwei Dai , Kun Li , Wei Zhou , Songlin Hu

In this paper, we propose the use of generative artificial intelligence (AI) to improve zero-shot performance of a pre-trained policy by altering observations during inference. Modern robotic systems, powered by advanced neural networks,…

Robotics · Computer Science 2023-11-30 Yusuke Miyashita , Dimitris Gahtidis , Colin La , Jeremy Rabinowicz , Jurgen Leitner

The growing use of virtual autonomous agents in applications like games and entertainment demands better control policies for natural-looking movements and actions. Unlike the conventional approach of hard-coding motion routines, we propose…

Machine Learning · Computer Science 2019-10-28 Subhajit Chaudhury , Daiki Kimura , Asim Munawar , Ryuki Tachibana

Utilizing well-trained representations in transfer learning often results in superior performance and faster convergence compared to training from scratch. However, even if such good representations are transferred, a model can easily…

Computer Vision and Pattern Recognition · Computer Science 2024-01-08 SeokHyun Seo , Jinwoo Hong , JungWoo Chae , Kyungyul Kim , Sangheum Hwang

Learning-based approaches for solving large sequential decision making problems have become popular in recent years. The resulting agents perform differently and their characteristics depend on those of the underlying learning approach.…

Machine Learning · Computer Science 2020-08-04 Timo P. Gros , Daniel Höller , Jörg Hoffmann , Verena Wolf

This paper proposes an algorithm that aims to improve generalization for reinforcement learning agents by removing overfitting to confounding features. Our approach consists of a max-min game theoretic objective. A generator transfers the…

Machine Learning · Computer Science 2023-08-31 Md Masudur Rahman , Yexiang Xue

Real-world multi-agent systems may require ad hoc teaming, where an agent must coordinate with other previously unseen teammates to solve a task in a zero-shot manner. Prior work often either selects a pretrained policy based on an inferred…

Multiagent Systems · Computer Science 2026-04-01 Rupal Nigam , Niket Parikh , Hamid Osooli , Mikihisa Yuasa , Jacob Heglund , Huy T. Tran

We are interested in solving the problem of imitation learning with a limited amount of real-world expert data. Existing offline imitation methods often struggle with poor data coverage and severe performance degradation. We propose a…

Robotics · Computer Science 2025-10-06 Yilin Wang , Shangzhe Li , Haoyi Niu , Zhiao Huang , Weitong Zhang , Hao Su

In many cases an intelligent agent may want to learn how to mimic a single observed demonstrated trajectory. In this work we consider how to perform such procedural learning from observation, which could help to enable agents to better use…

Machine Learning · Computer Science 2019-04-22 Tong Mu , Karan Goel , Emma Brunskill

Coordinating the motion of robots with high degrees of freedom (DoF) to grasp objects gives rise to many challenges. In this paper, we propose a novel imitation learning approach to learn a policy that directly predicts 23 DoF grasp…

Robotics · Computer Science 2024-11-22 Martin Matak , Karl Van Wyk , Tucker Hermans