English
Related papers

Related papers: Analyzing Closed-loop Training Techniques for Real…

200 papers

Driving safety is a top priority for autonomous vehicles. Orthogonal to prior work handling accident-prone traffic events by algorithm designs at the policy level, we investigate a Closed-loop Adversarial Training (CAT) framework for safe…

Machine Learning · Computer Science 2023-10-20 Linrui Zhang , Zhenghao Peng , Quanyi Li , Bolei Zhou

Reinforcement learning has received high research interest for developing planning approaches in automated driving. Most prior works consider the end-to-end planning task that yields direct control commands and rarely deploy their algorithm…

Robotics · Computer Science 2023-07-31 Marvin Klimke , Benjamin Völz , Michael Buchholz

Traffic simulation aims to learn a policy for traffic agents that, when unrolled in closed-loop, faithfully recovers the joint distribution of trajectories observed in the real world. Inspired by large language models, tokenized multi-agent…

Machine Learning · Computer Science 2025-03-17 Zhejun Zhang , Peter Karkus , Maximilian Igl , Wenhao Ding , Yuxiao Chen , Boris Ivanovic , Marco Pavone

Training self-driving cars is often challenging since they require a vast amount of labeled data in multiple real-world contexts, which is computationally and memory intensive. Researchers often resort to driving simulators to train the…

Artificial Intelligence · Computer Science 2022-12-01 Avinash Amballa , Advaith P. , Pradip Sasmal , Sumohana Channappayya

In this paper a deep reinforcement based multi-agent path planning approach is introduced. The experiments are realized in a simulation environment and in this environment different multi-agent path planning problems are produced. The…

Machine Learning · Computer Science 2021-10-05 Mert Çetinkaya

For a foreseeable future, autonomous vehicles (AVs) will operate in traffic together with human-driven vehicles. Their planning and control systems need extensive testing, including early-stage testing in simulations where the interactions…

Robotics · Computer Science 2020-07-21 Ran Tian , Nan Li , Ilya Kolmanovsky , Yildiray Yildiz , Anouck Girard

Simulating realistic driving behavior is crucial for developing and testing autonomous systems in complex traffic environments. Equally important is the ability to control the behavior of simulated agents to tailor scenarios to specific…

Artificial Intelligence · Computer Science 2025-01-23 Vasileios Lioutas , Adam Scibior , Matthew Niedoba , Berend Zwartsenberg , Frank Wood

One of the potential capabilities of Connected and Autonomous Vehicles (CAVs) is that they can have different route choice behavior and driving behavior compared to human Driven Vehicles (HDVs). This will lead to mixed traffic flow with…

Systems and Control · Electrical Eng. & Systems 2023-01-27 Behzad Bamdad Mehrabani , Jakob Erdmann , Luca Sgambi , Seyedehsan Seyedabrishami , Maaike Snelder

Trajectory planning in autonomous driving is highly dependent on predicting the emergent behavior of other road users. Learning-based methods are currently showing impressive results in simulation-based challenges, with transformer-based…

Machine Learning · Computer Science 2024-08-08 Lars Ullrich , Alex McMaster , Knut Graichen

Lane change is a very demanding driving task and number of traffic accidents are induced by mistaken maneuvers. An automated lane change system has the potential to reduce driver workload and to improve driving safety. One challenge is how…

Robotics · Computer Science 2021-01-01 Zheng Wang , Muhua Guan , Jin Lan , Bo Yang , Tsutomu Kaizuka , Junichi Taki , Kimihiko Nakano

Simulations are gaining increasingly significance in the field of autonomous driving due to the demand for rapid prototyping and extensive testing. Employing physics-based simulation brings several benefits at an affordable cost, while…

In this work the problem of path planning for an autonomous vehicle that moves on a freeway is considered. The most common approaches that are used to address this problem are based on optimal control methods, which make assumptions about…

Robotics · Computer Science 2020-02-19 Konstantinos Makantasis , Maria Kontorinaki , Ioannis Nikolos

This paper investigates how to utilize different forms of human interaction to safely train autonomous systems in real-time by learning from both human demonstrations and interventions. We implement two components of the Cycle-of-Learning…

Artificial Intelligence · Computer Science 2018-11-30 Vinicius G. Goecks , Gregory M. Gremillion , Vernon J. Lawhern , John Valasek , Nicholas R. Waytowich

Merging into dense highway traffic for an autonomous vehicle is a complex decision-making task, wherein the vehicle must identify a potential gap and coordinate with surrounding human drivers, each of whom may exhibit diverse driving…

Autonomous systems have achieved superhuman performance in isolation or simulation, yet they remain brittle in shared, dynamic real-world spaces. This failure stems from the dominant single-agent paradigm for physical applications, where…

Robotics · Computer Science 2026-05-22 Ismail Geles , Leonard Bauersfeld , Markus Wulfmeier , Davide Scaramuzza

Multi-agent interaction is a fundamental aspect of autonomous driving in the real world. Despite more than a decade of research and development, the problem of how to competently interact with diverse road users in diverse scenarios remains…

Modelling pedestrian-driver interactions is critical for understanding human road user behaviour and developing safe autonomous vehicle systems. Existing approaches often rely on rule-based logic, game-theoretic models, or 'black-box'…

Artificial Intelligence · Computer Science 2025-11-03 Yueyang Wang , Mehmet Dogar , Gustav Markkula

Autonomous vehicles (AVs) are now operating on public roads, which makes their testing and validation more critical than ever. Simulation offers a safe and controlled environment for evaluating AV performance in varied conditions. However,…

Artificial Intelligence · Computer Science 2026-04-15 Saeed Rahmani , Shiva Rasouli , Daphne Cornelisse , Eugene Vinitsky , Bart van Arem , Simeon C. Calvert

As the foundation of closed-loop training and evaluation in autonomous driving, traffic simulation still faces two fundamental challenges: covariate shift introduced by open-loop imitation learning and limited capacity to reflect the…

Robotics · Computer Science 2026-02-03 Keyu Chen , Wenchao Sun , Hao Cheng , Zheng Fu , Sifa Zheng

Simulation stands as a cornerstone for safe and efficient autonomous driving development. At its core a simulation system ought to produce realistic, reactive, and controllable traffic patterns. In this paper, we propose ProSim, a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Shuhan Tan , Boris Ivanovic , Yuxiao Chen , Boyi Li , Xinshuo Weng , Yulong Cao , Philipp Krähenbühl , Marco Pavone