English
Related papers

Related papers: SS-MAIL: Self-Supervised Multi-Agent Imitation Lea…

200 papers

Recent developments in multi-agent imitation learning have shown promising results for modeling the behavior of human drivers. However, it is challenging to capture emergent traffic behaviors that are observed in real-world datasets. Such…

Multi-task Imitation Learning (MIL) aims to train a policy capable of performing a distribution of tasks based on multi-task expert demonstrations, which is essential for general-purpose robots. Existing MIL algorithms suffer from low data…

Machine Learning · Computer Science 2023-06-29 Jiayu Chen , Dipesh Tamboli , Tian Lan , Vaneet Aggarwal

Adversarial Imitation Learning (AIL) faces challenges with sample inefficiency because of its reliance on sufficient on-policy data to evaluate the performance of the current policy during reward function updates. In this work, we study the…

Machine Learning · Computer Science 2024-05-28 Yilei Chen , Vittorio Giammarino , James Queeney , Ioannis Ch. Paschalidis

Adversarial imitation learning (AIL) has become a popular alternative to supervised imitation learning that reduces the distribution shift suffered by the latter. However, AIL requires effective exploration during an online reinforcement…

Machine Learning · Computer Science 2023-10-16 Trevor Ablett , Bryan Chan , Jonathan Kelly

Model-free reinforcement learning algorithms have exhibited great potential in solving single-task sequential decision-making problems with high-dimensional observations and long horizons, but are known to be hard to generalize across…

Machine Learning · Computer Science 2023-05-30 Boyuan Chen , Chuning Zhu , Pulkit Agrawal , Kaiqing Zhang , Abhishek Gupta

Safety and scalability are two critical challenges faced by practical Multi-Agent Systems (MAS). However, existing Multi-Agent Reinforcement Learning (MARL) algorithms that rely solely on reward shaping are ineffective in ensuring safety,…

Multiagent Systems · Computer Science 2025-04-02 Haikuo Du , Fandi Gou , Yunze Cai

We introduce a new mathematical model of multi-agent reinforcement learning, the Multi-Agent Informational Learning Processor "MAILP" model. The model is based on the notion that agents have policies for a certain amount of information,…

Multiagent Systems · Computer Science 2021-11-17 J. K. Terry , Nathaniel Grammel

Generative Adversarial Imitation Learning (GAIL) is a powerful and practical approach for learning sequential decision-making policies. Different from Reinforcement Learning (RL), GAIL takes advantage of demonstration data by experts (e.g.,…

Machine Learning · Computer Science 2020-01-14 Minshuo Chen , Yizhou Wang , Tianyi Liu , Zhuoran Yang , Xingguo Li , Zhaoran Wang , Tuo Zhao

As robots become more integrated in society, their ability to coordinate with other robots and humans on multi-modal tasks (those with multiple valid solutions) is crucial. Such behaviors can be learned from expert demonstrations via…

Robotics · Computer Science 2026-05-15 Dayi Dong , Maulik Bhatt , Seoyeon Choi , Negar Mehr

Existing Class Incremental Learning (CIL) methods are based on a supervised classification framework sensitive to data labels. When updating them based on the new class data, they suffer from catastrophic forgetting: the model cannot…

Machine Learning · Computer Science 2021-11-23 Zixuan Ni , Siliang Tang , Yueting Zhuang

While Adversarial Imitation Learning (AIL) algorithms have recently led to state-of-the-art results on various imitation learning benchmarks, it is unclear as to what impact various design decisions have on performance. To this end, we…

Machine Learning · Computer Science 2022-02-15 Eddy Hudson , Garrett Warnell , Peter Stone

Imitation learning is the task of replicating expert policy from demonstrations, without access to a reward function. This task becomes particularly challenging when the expert exhibits a mixture of behaviors. Prior work has introduced…

Machine Learning · Computer Science 2022-05-10 Arash Vahabpour , Tianyi Wang , Qiujing Lu , Omead Pooladzandi , Vwani Roychowdhury

Designing adaptive mechanisms to align individual and collective interests remains a central challenge in artificial social intelligence. Existing methods often struggle with modeling heterogeneous agents possessing persistent latent traits…

Computers and Society · Computer Science 2025-10-23 Xiaoyuan Zhang , Yizhe Huang , Chengdong Ma , Zhixun Chen , Long Ma , Yali Du , Song-Chun Zhu , Yaodong Yang , Xue Feng

Imitation learning has been a trend recently, yet training a generalist agent across multiple tasks still requires large-scale expert demonstrations, which are costly and labor-intensive to collect. To address the challenge of limited…

Robotics · Computer Science 2025-09-25 Yifan Ye , Jun Cen , Jing Chen , Zhihe Lu

In this paper, we study cooperative multi-agent reinforcement learning (MARL) where the joint reward exhibits submodularity, which is a natural property capturing diminishing marginal returns when adding agents to a team. Unlike standard…

Machine Learning · Computer Science 2026-03-10 Wenjing Chen , Chengyuan Qian , Shuo Xing , Yi Zhou , Victoria Crawford

Imitation learning aims to solve the problem of defining reward functions in real-world decision-making tasks. The current popular approach is the Adversarial Imitation Learning (AIL) framework, which matches expert state-action occupancy…

Machine Learning · Computer Science 2023-12-13 Bingzheng Wang , Guoqiang Wu , Teng Pang , Yan Zhang , Yilong Yin

Flocking control is a challenging problem, where multiple agents, such as drones or vehicles, need to reach a target position while maintaining the flock and avoiding collisions with obstacles and collisions among agents in the environment.…

Machine Learning · Computer Science 2022-09-20 Yunbo Qiu , Yue Jin , Jian Wang , Xudong Zhang

Imitation learning (IL) enables robots to acquire skills quickly by transferring expert knowledge, which is widely adopted in reinforcement learning (RL) to initialize exploration. However, in long-horizon motion planning tasks, a…

Robotics · Computer Science 2021-03-30 Sha Luo , Hamidreza Kasaei , Lambert Schomaker

Deep generative models have recently shown great promise in imitation learning for motor control. Given enough data, even supervised approaches can do one-shot imitation learning; however, they are vulnerable to cascading failures when the…

Machine Learning · Computer Science 2017-07-17 Ziyu Wang , Josh Merel , Scott Reed , Greg Wayne , Nando de Freitas , Nicolas Heess

Offline Imitation Learning (IL) methods such as Behavior Cloning are effective at acquiring complex robotic manipulation skills. However, existing IL-trained policies are confined to executing the task at the same speed as shown in…