English
Related papers

Related papers: Interactive Imitation Learning in State-Space

200 papers

In this paper, we describe a novel approach to imitation learning that infers latent policies directly from state observations. We introduce a method that characterizes the causal effects of latent actions on observations while…

Machine Learning · Computer Science 2019-05-14 Ashley D. Edwards , Himanshu Sahni , Yannick Schroecker , Charles L. Isbell

Imitation learning is an effective approach for training game-playing agents and, consequently, for efficient game production. However, generalization - the ability to perform well in related but unseen scenarios - is an essential…

Machine Learning · Computer Science 2024-04-09 Derek Yadgaroff , Alessandro Sestini , Konrad Tollmar , Ayca Ozcelikkale , Linus Gisslén

Existing imitation learning approaches often require that the complete demonstration data, including sequences of actions and states, are available. In this paper, we consider a more realistic and difficult scenario where a reinforcement…

Machine Learning · Computer Science 2019-03-12 Xiaoxiao Guo , Shiyu Chang , Mo Yu , Gerald Tesauro , Murray Campbell

One of the key challenges in visual imitation learning is collecting large amounts of expert demonstrations for a given task. While methods for collecting human demonstrations are becoming easier with teleoperation methods and the use of…

Robotics · Computer Science 2021-07-20 Sarah Young , Jyothish Pari , Pieter Abbeel , Lerrel Pinto

Acquiring complex behaviors is essential for artificially intelligent agents, yet learning these behaviors in high-dimensional settings poses a significant challenge due to the vast search space. Traditional reinforcement learning (RL)…

Machine Learning · Computer Science 2025-04-22 Mert Albaba , Sammy Christen , Thomas Langarek , Christoph Gebhardt , Otmar Hilliges , Michael J. Black

Despite the widely successful applications, bootstrapping and fine-tuning semantic parsers are still a tedious process with challenges such as costly data annotation and privacy risks. In this paper, we suggest an alternative,…

Computation and Language · Computer Science 2020-10-19 Ziyu Yao , Yiqi Tang , Wen-tau Yih , Huan Sun , Yu Su

Behavioral skills or policies for autonomous agents are conventionally learned from reward functions, via reinforcement learning, or from demonstrations, via imitation learning. However, both modes of task specification have their…

We compare how well agents aggregate information in two repeated social learning environments. In the first setting agents have access to a public data set. In the second they have access to the same data, and also to the past actions of…

Theoretical Economics · Economics 2026-05-20 Marina Agranov , Gabriel Lopez-Moctezuma , Philipp Strack , Omer Tamuz

Imitation learning field requires expert data to train agents in a task. Most often, this learning approach suffers from the absence of available data, which results in techniques being tested on its dataset. Creating datasets is a…

Machine Learning · Computer Science 2024-03-04 Nathan Gavenski , Michael Luck , Odinaldo Rodrigues

Imitation learning seeks to circumvent the difficulty in designing proper reward functions for training agents by utilizing expert behavior. With environments modeled as Markov Decision Processes (MDP), most of the existing imitation…

Machine Learning · Computer Science 2021-05-24 Dripta S. Raychaudhuri , Sujoy Paul , Jeroen van Baar , Amit K. Roy-Chowdhury

Effective human-AI coordination requires artificial agents capable of exhibiting and responding to human-like behaviors while adapting to changing contexts. Imitation learning has emerged as one of the prominent approaches to build such…

Artificial Intelligence · Computer Science 2026-02-25 Rakshit Trivedi , Kartik Sharma , David C Parkes

Because imitation learning relies on human demonstrations in hard-to-simulate settings, the inclusion of force control in this method has resulted in a shortage of training data, even with a simple change in speed. Although the field of…

Robotics · Computer Science 2025-05-07 Nozomu Masuya , Hiroshi Sato , Koki Yamane , Takuya Kusume , Sho Sakaino , Toshiaki Tsuji

Effective coordination of agents actions in partially-observable domains is a major challenge of multi-agent systems research. To address this, many researchers have developed techniques that allow the agents to make decisions based on…

Multiagent Systems · Computer Science 2011-09-28 P. S. Dutta , N. R. Jennings , L. Moreau

Humans can leverage hierarchical structures to split a task into sub-tasks and solve problems efficiently. Both imitation and reinforcement learning or a combination of them with hierarchical structures have been proven to be an efficient…

Robotics · Computer Science 2020-12-15 Yaru Niu , Yijun Gu

Reinforcement Learning has suffered from poor reward specification, and issues for reward hacking even in simple enough domains. Preference Based Reinforcement Learning attempts to solve the issue by utilizing binary feedbacks on queried…

Artificial Intelligence · Computer Science 2023-02-20 Mudit Verma , Subbarao Kambhampati

Interactive reinforcement learning provides a way for agents to learn to solve tasks from evaluative feedback provided by a human user. Previous research showed that humans give copious feedback early in training but very sparsely…

Human-Computer Interaction · Computer Science 2020-01-24 Guangliang Li , Hamdi Dibeklioğlu , Shimon Whiteson , Hayley Hung

Online imitation learning (IL) is an algorithmic framework that leverages interactions with expert policies for efficient policy optimization. Here policies are optimized by performing online learning on a sequence of loss functions that…

Machine Learning · Computer Science 2021-02-23 Xinyan Yan , Byron Boots , Ching-An Cheng

Information theoretic sensor management approaches are an ideal solution to state estimation problems when considering the optimal control of multi-agent systems, however they are too computationally intensive for large state spaces,…

Multiagent Systems · Computer Science 2021-02-02 William A. Dawson , Ruben Glatt , Edward Rusu , Braden C. Soper , Ryan A. Goldhahn

Realistic fine-grained multi-agent simulation of real-world complex systems is crucial for many downstream tasks such as reinforcement learning. Recent work has used generative models (GANs in particular) for providing high-fidelity…

Machine Learning · Computer Science 2022-02-25 Changyu Chen , Avinandan Bose , Shih-Fen Cheng , Arunesh Sinha

Imitation Learning (IL) has emerged as a powerful approach in robotics, allowing robots to acquire new skills by mimicking human actions. Despite its potential, the data collection process for IL remains a significant challenge due to the…

Robotics · Computer Science 2025-05-23 Hamidreza Kasaei , Mohammadreza Kasaei