English
Related papers

Related papers: Continual Driving Policy Optimization with Closed-…

200 papers

Recently, safe reinforcement learning (RL) with the actor-critic structure for continuous control tasks has received increasing attention. It is still challenging to learn a near-optimal control policy with safety and convergence…

Machine Learning · Computer Science 2024-02-06 Xinglong Zhang , Yaoqian Peng , Biao Luo , Wei Pan , Xin Xu , Haibin Xie

Autonomous driving policies are typically trained via open-loop behavior cloning of human demonstrations. However, such policies suffer from covariate shift when deployed in closed loop, leading to compounding errors. We introduce Rollouts…

As the foundation of closed-loop training and evaluation in autonomous driving, traffic simulation still faces two fundamental challenges: covariate shift introduced by open-loop imitation learning and limited capacity to reflect the…

Robotics · Computer Science 2026-02-03 Keyu Chen , Wenchao Sun , Hao Cheng , Zheng Fu , Sifa Zheng

Autonomous vehicles (AVs) have the potential to prevent accidents caused by drivers errors and reduce road traffic risks. Due to the nature of heavy vehicles, whose collisions cause more serious crashes, the weights of vehicles need to be…

Robotics · Computer Science 2024-05-08 Di Chen , Hao Li , Zhicheng Jin , Huizhao Tu , Meixin Zhu

ML-based motion planning is a promising approach to produce agents that exhibit complex behaviors, and automatically adapt to novel environments. In the context of autonomous driving, it is common to treat all available training data…

Generating safe and non-conservative behaviors in dense, dynamic environments remains challenging for automated vehicles due to the stochastic nature of traffic participants' behaviors and their implicit interaction with the ego vehicle.…

Robotics · Computer Science 2023-09-13 Tong Li , Lu Zhang , Sikang Liu , Shaojie Shen

Reinforcement learning (RL) has emerged as a promising paradigm in complex and continuous robotic tasks, however, safe exploration has been one of the main challenges, especially in contact-rich manipulation tasks in unstructured…

Robotics · Computer Science 2024-06-21 Heng Zhang , Gokhan Solak , Gustavo J. G. Lahr , Arash Ajoudani

Ensuring the safety of autonomous vehicles (AVs) requires identifying rare but critical failure cases that on-road testing alone cannot discover. High-fidelity simulations provide a scalable alternative, but automatically generating…

Machine Learning · Computer Science 2024-11-27 Amar Kulkarni , Shangtong Zhang , Madhur Behl

Evaluating the performance of autonomous vehicle planning algorithms necessitates simulating long-tail safety-critical traffic scenarios. However, traditional methods for generating such scenarios often fall short in terms of…

Robotics · Computer Science 2024-08-08 Wei-Jer Chang , Francesco Pittaluga , Masayoshi Tomizuka , Wei Zhan , Manmohan Chandraker

Collaborative navigation becomes essential in situations of occluded scenarios in autonomous driving where independent driving policies are likely to lead to collisions. One promising approach to address this issue is through the use of…

Robotics · Computer Science 2024-12-12 Leandro Parada , Hanlin Tian , Jose Escribano , Panagiotis Angeloudis

Scenario-based testing has emerged as a common method for autonomous vehicles (AVs) safety assessment, offering a more efficient alternative to mile-based testing by focusing on high-risk scenarios. However, fundamental questions persist…

Software Engineering · Computer Science 2025-07-17 Xingyu Zhao , Robab Aghazadeh-Chakherlou , Chih-Hong Cheng , Peter Popov , Lorenzo Strigini

Safety-critical scenarios are essential for training and evaluating autonomous driving (AD) systems, yet remain extremely rare in real-world driving datasets. To address this, we propose Real-world Crash Grounding (RCG), a scenario…

Robotics · Computer Science 2025-07-16 Benjamin Stoler , Juliet Yang , Jonathan Francis , Jean Oh

Existing end-to-end autonomous driving (AD) algorithms typically follow the Imitation Learning (IL) paradigm, which faces challenges such as causal confusion and an open-loop gap. In this work, we propose RAD, a 3DGS-based closed-loop…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Hao Gao , Shaoyu Chen , Bo Jiang , Bencheng Liao , Yiang Shi , Xiaoyang Guo , Yuechuan Pu , Haoran Yin , Xiangyu Li , Xinbang Zhang , Ying Zhang , Wenyu Liu , Qian Zhang , Xinggang Wang

We present a versatile NeRF-based simulator for testing autonomous driving (AD) software systems, designed with a focus on sensor-realistic closed-loop evaluation and the creation of safety-critical scenarios. The simulator learns from…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 William Ljungbergh , Adam Tonderski , Joakim Johnander , Holger Caesar , Kalle Åström , Michael Felsberg , Christoffer Petersson

We introduce a curriculum learning algorithm, Variational Automatic Curriculum Learning (VACL), for solving challenging goal-conditioned cooperative multi-agent reinforcement learning problems. We motivate our paradigm through a variational…

Machine Learning · Computer Science 2023-12-12 Jiayu Chen , Yuanxin Zhang , Yuanfan Xu , Huimin Ma , Huazhong Yang , Jiaming Song , Yu Wang , Yi Wu

Ensuring and improving the safety of autonomous driving systems (ADS) is crucial for the deployment of highly automated vehicles, especially in safety-critical events. To address the rarity issue, adversarial scenario generation methods are…

Machine Learning · Computer Science 2025-06-10 Yuewen Mei , Tong Nie , Jian Sun , Ye Tian

To ensure their safe use, autonomous vehicles (AVs) must meet rigorous certification criteria that involve executing maneuvers safely within (arbitrary) scenarios where other actors perform their intended maneuvers. For that purpose,…

Software Engineering · Computer Science 2026-05-27 Aren A. Babikian , Attila Ficsor , Oszkár Semeráth , Gunter Mussbacher , Dániel Varró

Virtual scenario-based testing methods to validate autonomous driving systems are predominantly centred around collision avoidance, and lack a comprehensive approach to evaluate optimal driving behaviour holistically. Furthermore, current…

Robotics · Computer Science 2024-08-01 Kethan Reddy , Elias Nassif , Panagiotis Angeloudis , Mohammed Quddus , Washington Ochieng

Handling pre-crash scenarios is still a major challenge for self-driving cars due to limited practical data and human-driving behavior datasets. We introduce DISC (Driving Styles In Simulated Crashes), one of the first datasets designed to…

Developing autonomous driving systems for complex traffic environments requires balancing multiple objectives, such as avoiding collisions, obeying traffic rules, and making efficient progress. In many situations, these objectives cannot be…

‹ Prev 1 3 4 5 6 7 10 Next ›