English
Related papers

Related papers: Multi-Agent Imitation Learning for Driving Simulat…

200 papers

Verification and validation of autonomous driving (AD) systems and components is of increasing importance, as such technology increases in real-world prevalence. Safety-critical scenario generation is a key approach to robustify AD policies…

Robotics · Computer Science 2025-07-15 Benjamin Stoler , Ingrid Navarro , Jonathan Francis , Jean Oh

We study multi-agent reinforcement learning (MARL) for tasks in complex high-dimensional environments, such as autonomous driving. MARL is known to suffer from the \textit{partial observability} and \textit{non-stationarity} issues. To…

Robotics · Computer Science 2025-06-11 Hang Wang , Dechen Gao , Junshan Zhang

Mixed cooperative-competitive control scenarios such as human-machine interaction with individual goals of the interacting partners are very challenging for reinforcement learning agents. In order to contribute towards intuitive…

Systems and Control · Electrical Eng. & Systems 2020-03-03 Florian Köpf , Alexander Nitsch , Michael Flad , Sören Hohmann

Multi-agent learning provides a potential framework for learning and simulating traffic behaviors. This paper proposes a novel architecture to learn multiple driving behaviors in a traffic scenario. The proposed architecture can learn…

Machine Learning · Computer Science 2018-11-20 Meha Kaushik , Phaniteja S , K. Madhava Krishna

Data-driven simulators promise high data-efficiency for driving policy learning. When used for modelling interactions, this data-efficiency becomes a bottleneck: Small underlying datasets often lack interesting and challenging edge cases…

Conditional imitation learning (CIL) trains deep neural networks, in an end-to-end manner, to mimic human driving. This approach has demonstrated suitable vehicle control when following roads, avoiding obstacles, or taking specific turns at…

Robotics · Computer Science 2022-11-22 Hesham M. Eraqi , Mohamed N. Moustafa , Jens Honer

Simulation environments are good for learning different driving tasks like lane changing, parking or handling intersections etc. in an abstract manner. However, these simulation environments often restrict themselves to operate under…

Machine Learning · Computer Science 2021-11-01 Ashish Rana , Avleen Malhi

Simulation has the potential to massively scale evaluation of self-driving systems enabling rapid development as well as safe deployment. To close the gap between simulation and the real world, we need to simulate realistic multi-agent…

Robotics · Computer Science 2021-01-19 Simon Suo , Sebastian Regalado , Sergio Casas , Raquel Urtasun

Current methods to learn controllers for autonomous vehicles (AVs) focus on behavioural cloning. Being trained only on exact historic data, the resulting agents often generalize poorly to novel scenarios. Simulators provide the opportunity…

Artificial Intelligence · Computer Science 2025-11-19 Asen Nachkov , Danda Pani Paudel , Luc Van Gool

Evaluating the decision-making system is indispensable in developing autonomous vehicles, while realistic and challenging safety-critical test scenarios play a crucial role. Obtaining these scenarios is non-trivial, thanks to the…

Robotics · Computer Science 2024-08-08 Kunkun Hao , Yonggang Luo , Wen Cui , Yuqiao Bai , Jucheng Yang , Songyang Yan , Yuxi Pan , Zijiang Yang

Imitation learning targets deriving a mapping from states to actions, a.k.a. policy, from expert demonstrations. Existing methods for imitation learning typically require any actions in the demonstrations to be fully available, which is…

Machine Learning · Computer Science 2019-06-25 Mingfei Sun , Xiaojuan Ma

The introduction of the generative adversarial imitation learning (GAIL) algorithm has spurred the development of scalable imitation learning approaches using deep neural networks. Many of the algorithms that followed used a similar…

Machine Learning · Computer Science 2023-09-21 Kai Arulkumaran , Dan Ogawa Lillrank

The current landscape of multi-agent expert imitation is broadly dominated by two families of algorithms - Behavioral Cloning (BC) and Adversarial Imitation Learning (AIL). BC approaches suffer from compounding errors, as they ignore the…

Artificial Intelligence · Computer Science 2021-10-19 Akshay Dharmavaram , Tejus Gupta , Jiachen Li , Katia P. Sycara

This paper explores a simple regularizer for reinforcement learning by proposing Generative Adversarial Self-Imitation Learning (GASIL), which encourages the agent to imitate past good trajectories via generative adversarial imitation…

Machine Learning · Computer Science 2018-12-04 Yijie Guo , Junhyuk Oh , Satinder Singh , Honglak Lee

Many modern methods for imitation learning and inverse reinforcement learning, such as GAIL or AIRL, are based on an adversarial formulation. These methods apply GANs to match the expert's distribution over states and actions with the…

Machine Learning · Computer Science 2020-08-11 Oleg Arenz , Gerhard Neumann

Understanding and modeling individual travel behavior responses is crucial for urban mobility regulation and policy evaluation. The Markov decision process (MDP) provides a structured framework for dynamic travel behavior modeling at the…

Machine Learning · Computer Science 2025-09-09 Yuanyuan Wu , Zhenlin Qin , Leizhen Wang , Xiaolei Ma , Zhenliang Ma

In multi-agent systems, complex interacting behaviors arise due to the high correlations among agents. However, previous work on modeling multi-agent interactions from demonstrations is primarily constrained by assuming the independence…

Multiagent Systems · Computer Science 2020-06-12 Minghuan Liu , Ming Zhou , Weinan Zhang , Yuzheng Zhuang , Jun Wang , Wulong Liu , Yong Yu

Human drivers can seamlessly adapt their driving decisions across geographical locations with diverse conditions and rules of the road, e.g., left vs. right-hand traffic. In contrast, existing models for autonomous driving have been thus…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Ruizhao Zhu , Peng Huang , Eshed Ohn-Bar , Venkatesh Saligrama

Making decisions in complex driving environments is a challenging task for autonomous agents. Imitation learning methods have great potentials for achieving such a goal. Adversarial Inverse Reinforcement Learning (AIRL) is one of the…

Artificial Intelligence · Computer Science 2021-03-29 Pin Wang , Dapeng Liu , Jiayu Chen , Hanhan Li , Ching-Yao Chan

Learning motor skills for sports or performance driving is often done with professional instruction from expert human teachers, whose availability is limited. Our goal is to enable automated teaching via a learned model that interacts with…