English
Related papers

Related papers: Interactive Imitation Learning in State-Space

200 papers

While recent advances in deep reinforcement learning have allowed autonomous learning agents to succeed at a variety of complex tasks, existing algorithms generally require a lot of training data. One way to increase the speed at which…

Artificial Intelligence · Computer Science 2018-01-23 Garrett Warnell , Nicholas Waytowich , Vernon Lawhern , Peter Stone

Imitation Learning is a promising paradigm for learning complex robot manipulation skills by reproducing behavior from human demonstrations. However, manipulation tasks often contain bottleneck regions that require a sequence of precise…

Robotics · Computer Science 2020-12-15 Ajay Mandlekar , Danfei Xu , Roberto Martín-Martín , Yuke Zhu , Li Fei-Fei , Silvio Savarese

Growing concerns regarding the operational usage of AI models in the real-world has caused a surge of interest in explaining AI models' decisions to humans. Reinforcement Learning is not an exception in this regard. In this work, we propose…

Machine Learning · Computer Science 2023-10-06 Omid Davoodi , Majid Komeili

In many real-world settings, an agent must learn to act in environments where no reward signal can be specified, but a set of expert demonstrations is available. Imitation learning (IL) is a popular framework for learning policies from such…

Machine Learning · Computer Science 2024-07-02 Risto Vuorio , Mattie Fellows , Cong Lu , Clémence Grislain , Shimon Whiteson

Multi-agent imitation learning aims to train multiple agents to perform tasks from demonstrations by learning a mapping between observations and actions, which is essential for understanding physical, social, and team-play systems. However,…

Machine Learning · Computer Science 2021-07-13 Hongwei Wang , Lantao Yu , Zhangjie Cao , Stefano Ermon

Latent space representations are critical for understanding and improving the behavior of machine learning models, yet they often remain obscure and intricate. Understanding and exploring the latent space has the potential to contribute…

Machine Learning · Computer Science 2025-05-13 Daniel Geissler , Lars Krupp , Vishal Banwari , David Habusch , Bo Zhou , Paul Lukowicz , Jakob Karolus

Choosing an appropriate representation of the environment for the underlying decision-making process of the reinforcement learning agent is not always straightforward. The state representation should be inclusive enough to allow the agent…

One of the main issues in Imitation Learning is the erroneous behavior of an agent when facing out-of-distribution situations, not covered by the set of demonstrations given by the expert. In this work, we tackle this problem by introducing…

Robotics · Computer Science 2020-11-20 Norman Di Palo , Edward Johns

Imitation learning trains a policy by mimicking expert demonstrations. Various imitation methods were proposed and empirically evaluated, meanwhile, their theoretical understanding needs further studies. In this paper, we firstly analyze…

Machine Learning · Computer Science 2020-10-23 Tian Xu , Ziniu Li , Yang Yu

In an unfamiliar setting, a model-based reinforcement learning agent can be limited by the accuracy of its world model. In this work, we present a novel, training-free approach to improving the performance of such agents separately from…

Machine Learning · Computer Science 2024-02-26 Martin Benfeghoul , Umais Zahid , Qinghai Guo , Zafeirios Fountas

Artificial agents, particularly humanoid robots, interact with their environment, objects, and people using cameras, actuators, and physical presence. Their communication methods are often pre-programmed, limiting their actions and…

Artificial Intelligence · Computer Science 2024-06-17 Federico Tavella , Aphrodite Galata , Angelo Cangelosi

The goal of imitation learning is to mimic expert behavior from demonstrations, without access to an explicit reward signal. A popular class of approach infers the (unknown) reward function via inverse reinforcement learning (IRL) followed…

Machine Learning · Computer Science 2022-04-19 Carl Qi , Pieter Abbeel , Aditya Grover

Reinforcement learning agents can learn to solve sequential decision tasks by interacting with the environment. Human knowledge of how to solve these tasks can be incorporated using imitation learning, where the agent learns to imitate…

Artificial Intelligence · Computer Science 2019-09-24 Ruohan Zhang , Faraz Torabi , Lin Guan , Dana H. Ballard , Peter Stone

The interactive partially observable Markov decision process (I-POMDP) is a recently developed framework which extends the POMDP to the multi-agent setting by including agent models in the state space. This paper argues for formulating the…

Robotics · Computer Science 2012-04-03 Mark P. Woodward , Robert J. Wood

Behavior cloning of expert demonstrations can speed up learning optimal policies in a more sample-efficient way over reinforcement learning. However, the policy cannot extrapolate well to unseen states outside of the demonstration data,…

Machine Learning · Computer Science 2022-10-19 Jung Yeon Park , Lawson L. S. Wong

There is a high demand for high-quality Non-Player Characters (NPCs) in video games. Hand-crafting their behavior is a labor intensive and error prone engineering process with limited controls exposed to the game designers. We propose to…

Machine Learning · Computer Science 2019-06-04 Igor Borovikov , Jesse Harder , Michael Sadovsky , Ahmad Beirami

Reinforcement learning has enjoyed multiple successes in recent years. However, these successes typically require very large amounts of data before an agent achieves acceptable performance. This paper introduces a novel way of combating…

Artificial Intelligence · Computer Science 2018-05-14 Zhaodong Wang , Matthew E. Taylor

Imitation learning, in which learning is performed by demonstration, has been studied and advanced for sequential decision-making tasks in which a reward function is not predefined. However, imitation learning methods still require numerous…

Machine Learning · Computer Science 2024-01-24 Dahuin Jung , Hyungyu Lee , Sungroh Yoon

This paper presents a novel approach combining inductive logic programming with reinforcement learning to improve training performance and explainability. We exploit inductive learning of answer set programs from noisy examples to learn a…

Artificial Intelligence · Computer Science 2025-01-14 Celeste Veronese , Daniele Meli , Alessandro Farinelli

Imitation learning enables robots to learn from demonstrations. Previous imitation learning algorithms usually assume access to optimal expert demonstrations. However, in many real-world applications, this assumption is limiting. Most…

Machine Learning · Computer Science 2021-03-11 Zhangjie Cao , Dorsa Sadigh