English
Related papers

Related papers: Analyzing Closed-loop Training Techniques for Real…

200 papers

Simulation data can be utilized to extend real-world driving data in order to cover edge cases, such as vehicle accidents. The importance of handling edge cases can be observed in the high societal costs in handling car accidents, as well…

Robotics · Computer Science 2020-07-24 Shivam Akhauri , Laura Zheng , Ming Lin

Autonomous driving faces challenges in navigating complex real-world traffic, requiring safe handling of both common and critical scenarios. Reinforcement learning (RL), a prominent method in end-to-end driving, enables agents to learn…

Robotics · Computer Science 2026-03-09 Ahmed Abouelazm , Johannes Ratz , Philip Schörner , J. Marius Zöllner

Although multi-agent reinforcement learning can tackle systems of strategically interacting entities, it currently fails in scalability and lacks rigorous convergence guarantees. Crucially, learning in multi-agent systems can become…

Multiagent Systems · Computer Science 2018-03-15 David Mguni , Joel Jennings , Enrique Munoz de Cote

In contemporary autonomous driving testing, virtual simulation has become an important approach due to its efficiency and cost effectiveness. However, existing methods usually rely on reinforcement learning to generate risky scenarios,…

Robotics · Computer Science 2026-03-24 Chen Xiong , Cheng Wang , Yuhang Liu , Zirui Wu , Ye Tian

With the adoption of autonomous vehicles on our roads, we will witness a mixed-autonomy environment where autonomous and human-driven vehicles must learn to co-exist by sharing the same road infrastructure. To attain socially-desirable…

Robotics · Computer Science 2025-12-11 Behrad Toghi , Rodolfo Valiente , Dorsa Sadigh , Ramtin Pedarsani , Yaser P. Fallah

Maneuvering in dense traffic is a challenging task for autonomous vehicles because it requires reasoning about the stochastic behaviors of many other participants. In addition, the agent must achieve the maneuver within a limited time and…

Artificial Intelligence · Computer Science 2020-05-26 Maxime Bouton , Alireza Nakhaei , David Isele , Kikuo Fujimura , Mykel J. Kochenderfer

Deep reinforcement learning has shown promise in various engineering applications, including vehicular traffic control. The non-stationary nature of traffic, especially in the lane-free environment with more degrees of freedom in vehicle…

Robotics · Computer Science 2024-06-24 Mehran Berahman , Majid Rostami-Shahrbabaki , Klaus Bogenberger

End-to-end approaches to autonomous driving have high sample complexity and are difficult to scale to realistic urban driving. Simulation can help end-to-end driving systems by providing a cheap, safe, and diverse training environment. Yet…

Robotics · Computer Science 2018-12-14 Matthias Müller , Alexey Dosovitskiy , Bernard Ghanem , Vladlen Koltun

Existing end-to-end autonomous driving (AD) algorithms typically follow the Imitation Learning (IL) paradigm, which faces challenges such as causal confusion and an open-loop gap. In this work, we propose RAD, a 3DGS-based closed-loop…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Hao Gao , Shaoyu Chen , Bo Jiang , Bencheng Liao , Yiang Shi , Xiaoyang Guo , Yuechuan Pu , Haoran Yin , Xiangyu Li , Xinbang Zhang , Ying Zhang , Wenyu Liu , Qian Zhang , Xinggang Wang

Simulations are attractive environments for training agents as they provide an abundant source of data and alleviate certain safety concerns during the training process. But the behaviours developed by agents in simulation are often…

Robotics · Computer Science 2018-09-21 Xue Bin Peng , Marcin Andrychowicz , Wojciech Zaremba , Pieter Abbeel

Despite significant progress in autonomous vehicles (AVs), the development of driving policies that ensure both the safety of AVs and traffic flow efficiency has not yet been fully explored. In this paper, we propose an enhanced…

Machine Learning · Computer Science 2024-06-18 Zilin Huang , Zihao Sheng , Chengyuan Ma , Sikai Chen

When learning to behave in a stochastic environment where safety is critical, such as driving a vehicle in traffic, it is natural for human drivers to plan fallback strategies as a backup to use if ever there is an unexpected change in the…

Machine Learning · Computer Science 2022-04-12 Ugo Lecerf , Christelle Yemdji-Tchassi , Sébastien Aubert , Pietro Michiardi

Interactive multi-agent simulation algorithms are used to compute the trajectories and behaviors of different entities in virtual reality scenarios. However, current methods involve considerable parameter tweaking to generate plausible…

Graphics · Computer Science 2018-12-04 Jiaping Ren , Wei Xiang , Yangxi Xiao , Ruigang Yang , Dinesh Manocha , Xiaogang Jin

Artificial intelligence systems increasingly involve continual learning to enable flexibility in general situations that are not encountered during system training. Human interaction with autonomous systems is broadly studied, but research…

Deep Reinforcement Learning (DRL) has shown remarkable success in solving complex tasks across various research fields. However, transferring DRL agents to the real world is still challenging due to the significant discrepancies between…

Machine Learning · Computer Science 2024-10-22 Dianzhao Li , Ostap Okhrin

Shared control schemes allow a human driver to work with an automated driving agent in driver-vehicle systems while retaining the driver's abilities to control. The human driver, as an essential agent in the driver-vehicle shared control…

Systems and Control · Electrical Eng. & Systems 2020-08-10 Wenshuo Wang , Xiaoxiang Na , Dongpu Cao , Jianwei Gong , Junqiang Xi , Yang Xi , Fei-Yue Wang

The imitation learning of self-driving vehicle policies through behavioral cloning is often carried out in an open-loop fashion, ignoring the effect of actions to future states. Training such policies purely with Empirical Risk Minimization…

Machine Learning · Computer Science 2022-10-12 Eesha Kumar , Yiming Zhang , Stefano Pini , Simon Stent , Ana Ferreira , Sergey Zagoruyko , Christian S. Perone

Training and education in human-centered fields require authentic practice, yet realistic simulations of human behavior have remained limited. We present a multi-agent psychological simulation system that models internal cognitive-affective…

Artificial Intelligence · Computer Science 2025-11-05 Xiangen Hu , Jiarui Tong , Sheng Xu

Autonomous cars are well known for being vulnerable to adversarial attacks that can compromise the safety of the car and pose danger to other road users. To effectively defend against adversaries, it is required to not only test autonomous…

Artificial Intelligence · Computer Science 2023-02-22 Aizaz Sharif , Dusica Marijan

Embodied agents struggle to generalize to new environments, even when those environments share similar underlying structures to their training settings. Most current approaches to generating these training environments follow an open-loop…

Robotics · Computer Science 2026-02-09 Teresa Yeo , Dulaj Weerakoon , Dulanga Weerakoon , Archan Misra