English
Related papers

Related papers: PCASim: Promptable Closed-loop Adversarial Simulat…

200 papers

Systematic testing of autonomous vehicles operating in complex real-world scenarios is a difficult and expensive problem. We present Paracosm, a reactive language for writing test scenarios for autonomous driving systems. Paracosm allows…

Software Engineering · Computer Science 2021-01-19 Rupak Majumdar , Aman Mathur , Marcus Pirron , Laura Stegner , Damien Zufferey

Rigorously testing autonomy systems is essential for making safe self-driving vehicles (SDV) a reality. It requires one to generate safety critical scenarios beyond what can be collected safely in the world, as many scenarios happen rarely…

Computer Vision and Pattern Recognition · Computer Science 2023-08-04 Ze Yang , Yun Chen , Jingkang Wang , Sivabalan Manivasagam , Wei-Chiu Ma , Anqi Joyce Yang , Raquel Urtasun

Autonomous Driving Systems (ADS) require diverse and safety-critical traffic scenarios for effective training and testing, but the existing data generation methods struggle to provide flexibility and scalability. We propose LASER, a novel…

Robotics · Computer Science 2024-10-25 Hao Gao , Jingyue Wang , Wenyang Fang , Jingwei Xu , Yunpeng Huang , Taolue Chen , Xiaoxing Ma

We address the problem of ego-vehicle navigation in dense simulated traffic environments populated by road agents with varying driver behaviors. Navigation in such environments is challenging due to unpredictability in agents' actions…

Robotics · Computer Science 2022-02-15 Angelos Mavrogiannis , Rohan Chandra , Dinesh Manocha

This paper presents YatSim, an open-source program for simulating consensus-based control strategies in urban traffic networks. Urban traffic is a multi-agent system which requires agreement among the agents to guarantees performance,…

Systems and Control · Computer Science 2018-10-29 Alexander Martin Dethof , Fabio Molinari

Human trajectory forecasting is crucial in applications such as autonomous driving, robotics and surveillance. Accurate forecasting requires models to consider various factors, including social interactions, multi-modal predictions,…

Computer Vision and Pattern Recognition · Computer Science 2026-03-02 Giacomo Rosin , Muhammad Rameez Ur Rahman , Sebastiano Vascon

Benchmarking vision-based driving policies is challenging. On one hand, open-loop evaluation with real data is easy, but these results do not reflect closed-loop performance. On the other, closed-loop evaluation is possible in simulation,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Daniel Dauner , Marcel Hallgarten , Tianyu Li , Xinshuo Weng , Zhiyu Huang , Zetong Yang , Hongyang Li , Igor Gilitschenski , Boris Ivanovic , Marco Pavone , Andreas Geiger , Kashyap Chitta

Recent advances in high-fidelity simulators have enabled closed-loop training of autonomous driving agents, potentially solving the distribution shift in training v.s. deployment and allowing training to be scaled both safely and cheaply.…

Robotics · Computer Science 2023-06-29 Chris Zhang , Runsheng Guo , Wenyuan Zeng , Yuwen Xiong , Binbin Dai , Rui Hu , Mengye Ren , Raquel Urtasun

In the future, powerful AI systems may be deployed in high-stakes settings, where a single failure could be catastrophic. One technique for improving AI safety in high-stakes settings is adversarial training, which uses an adversary to…

Supervised open-loop training has been widely adopted for training traffic simulation models; however, it fails to capture the inherently dynamic, multi-agent interactions common in complex driving scenarios. We introduce RLFTSim, a…

Realistic traffic simulation is crucial for developing self-driving software in a safe and scalable manner prior to real-world deployment. Typically, imitation learning (IL) is used to learn human-like traffic agents directly from…

Robotics · Computer Science 2023-11-03 Chris Zhang , James Tu , Lunjun Zhang , Kelvin Wong , Simon Suo , Raquel Urtasun

Recently significant progress has been made in vehicle prediction and planning algorithms for autonomous driving. However, it remains quite challenging for an autonomous vehicle to plan its trajectory in complex scenarios when it is…

Robotics · Computer Science 2023-07-25 Xiangguo Liu , Ruochen Jiao , Yixuan Wang , Yimin Han , Bowen Zheng , Qi Zhu

Generating realistic and controllable traffic scenes from natural language can greatly enhance the development and evaluation of autonomous driving systems. However, this task poses unique challenges: (1) grounding free-form text into…

Robotics · Computer Science 2026-03-27 Bo-Kai Ruan , Hao-Tang Tsui , Yung-Hui Li , Hong-Han Shuai

Despite promising progress in reinforcement learning (RL), developing algorithms for autonomous driving (AD) remains challenging: one of the critical issues being the absence of an open-source platform capable of training and effectively…

Machine Learning · Computer Science 2021-11-16 Parth Kothari , Christian Perone , Luca Bergamini , Alexandre Alahi , Peter Ondruska

Despite significant recent progress in the field of autonomous driving, modern methods still struggle and can incur serious accidents when encountering long-tail unforeseen events and challenging urban scenarios. On the one hand, large…

Computer Vision and Pattern Recognition · Computer Science 2023-12-22 Hao Shao , Yuxuan Hu , Letian Wang , Steven L. Waslander , Yu Liu , Hongsheng Li

Current validation methods often rely on recorded data and basic functional checks, which may not be sufficient to encompass the scenarios an autonomous vehicle might encounter. In addition, there is a growing need for complex scenarios…

Robotics · Computer Science 2024-02-08 Marc Kaufeld , Rainer Trauth , Johannes Betz

With the growing popularity of digital twin and autonomous driving in transportation, the demand for simulation systems capable of generating high-fidelity and reliable scenarios is increasing. Existing simulation systems suffer from a lack…

Systems and Control · Electrical Eng. & Systems 2023-07-27 Licheng Wen , Daocheng Fu , Song Mao , Pinlong Cai , Min Dou , Yikang Li , Yu Qiao

In the past few decades, autonomous driving algorithms have made significant progress in perception, planning, and control. However, evaluating individual components does not fully reflect the performance of entire systems, highlighting the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hongyu Zhou , Longzhong Lin , Jiabao Wang , Yichong Lu , Dongfeng Bai , Bingbing Liu , Yue Wang , Andreas Geiger , Yiyi Liao

To improve efficiency and reduce failures in autonomous vehicles, research has focused on developing robust and safe learning methods that take into account disturbances in the environment. Existing literature in robust reinforcement…

Machine Learning · Computer Science 2019-03-12 Xiaobai Ma , Katherine Driggs-Campbell , Mykel J. Kochenderfer

End-to-end models for autonomous driving hold the promise of learning complex behaviors directly from sensor data, but face critical challenges in safety and handling long-tail events. Reinforcement Learning (RL) offers a promising path to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Tianyi Yan , Tao Tang , Xingtai Gui , Yongkang Li , Jiasen Zhesng , Weiyao Huang , Lingdong Kong , Wencheng Han , Xia Zhou , Xueyang Zhang , Yifei Zhan , Kun Zhan , Cheng-zhong Xu , Jianbing Shen