English
Related papers

Related papers: SynAD: Enhancing Real-World End-to-End Autonomous …

200 papers

We propose UAD, a method for vision-based end-to-end autonomous driving (E2EAD), achieving the best open-loop evaluation performance in nuScenes, meanwhile showing robust closed-loop driving quality in CARLA. Our motivation stems from the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Mingzhe Guo , Zhipeng Zhang , Yuan He , Ke Wang , Liping Jing

Strategies that include the generation of synthetic data are beginning to be viable as obtaining real data can be logistically complicated, very expensive or slow. Not only the capture of the data can lead to complications, but also its…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Paola Natalia Canas , Juan Diego Ortega , Marcos Nieto , Oihana Otaegui

Deep vision models are now mature enough to be integrated in industrial and possibly critical applications such as autonomous navigation. Yet, data collection and labeling to train such models requires too much efforts and costs for a…

Machine Learning · Computer Science 2025-10-24 Estelle Chigot , Dennis G. Wilson , Meriem Ghrib , Fabrice Jimenez , Thomas Oberlin

We present a new interaction mechanism of prediction and planning for end-to-end autonomous driving, called PPAD (Iterative Interaction of Prediction and Planning Autonomous Driving), which considers the timestep-wise interaction to better…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Zhili Chen , Maosheng Ye , Shuangjie Xu , Tongyi Cao , Qifeng Chen

This study underscores the vital importance of intelligent driving functions in enhancing road safety and driving comfort. Central to our research is the challenge of obtaining sufficient test data for evaluating these functions, especially…

Robotics · Computer Science 2024-02-06 Nico Schick , Franjo Čičak

Modeling complicated interactions among the ego-vehicle, road agents, and map elements has been a crucial part for safety-critical autonomous driving. Previous works on end-to-end autonomous driving rely on the attention mechanism for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Yunpeng Zhang , Deheng Qian , Ding Li , Yifeng Pan , Yong Chen , Zhenbao Liang , Zhiyao Zhang , Shurui Zhang , Hongxu Li , Maolei Fu , Yun Ye , Zhujin Liang , Yi Shan , Dalong Du

End-to-End (E2E) planning has become a powerful paradigm for autonomous driving, yet current systems remain fundamentally uncertainty-blind. They assume perception outputs are fully reliable, even in ambiguous or poorly observed scenes,…

Robotics · Computer Science 2025-12-01 Wonjeong Ryu , Seungjun Yu , Seokha Moon , Hojun Choi , Junsung Park , Jinkyu Kim , Hyunjung Shim

Autonomous Driving (AD) systems demand the high levels of safety assurance. Despite significant advancements in AD demonstrated on open-source benchmarks like Longest6 and Bench2Drive, existing datasets still lack regulatory-compliant…

Robotics · Computer Science 2025-05-21 Jingzheng Li , Tiancheng Wang , Xingyu Peng , Jiacheng Chen , Zhijun Chen , Bing Li , Xianglong Liu

We present SSOD, the first end-to-end analysis-by synthesis framework with controllable GANs for the task of self-supervised object detection. We use collections of real world images without bounding box annotations to learn to synthesize…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Siva Karthik Mustikovela , Shalini De Mello , Aayush Prakash , Umar Iqbal , Sifei Liu , Thu Nguyen-Phuoc , Carsten Rother , Jan Kautz

Current validation methods often rely on recorded data and basic functional checks, which may not be sufficient to encompass the scenarios an autonomous vehicle might encounter. In addition, there is a growing need for complex scenarios…

Robotics · Computer Science 2024-02-08 Marc Kaufeld , Rainer Trauth , Johannes Betz

End-to-end autonomous driving systems promise stronger performance through unified optimization of perception, motion forecasting, and planning. However, vision-based approaches face fundamental limitations in adverse weather conditions,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Philipp Wolters , Johannes Gilg , Torben Teepe , Gerhard Rigoll

Simulation is a crucial step in ensuring accurate, efficient, and realistic Connected and Autonomous Vehicles (CAVs) testing and validation. As the adoption of CAV accelerates, the integration of real-world data into simulation environments…

Robotics · Computer Science 2024-09-27 Junwei You , Pei Li , Yang Cheng , Keshu Wu , Rui Gan , Steven T. Parker , Bin Ran

Synthesizing free-view photo-realistic images is an important task in multimedia. With the development of advanced driver assistance systems~(ADAS) and their applications in autonomous vehicles, experimenting with different scenarios…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Zhuopeng Li , Lu Li , Zeyu Ma , Ping Zhang , Junbo Chen , Jianke Zhu

Over the past few years there is a growing interest in the learning-based self driving system. To ensure safety, such systems are first developed and validated in simulators before being deployed in the real world. However, most of the…

Robotics · Computer Science 2021-03-15 Quanyi Li , Zhenghao Peng , Qihang Zhang , Chunxiao Liu , Bolei Zhou

Diffusion models have become a popular choice for decision-making tasks in robotics, and more recently, are also being considered for solving autonomous driving tasks. However, their applications and evaluations in autonomous driving remain…

Driving safety is a top priority for autonomous vehicles. Orthogonal to prior work handling accident-prone traffic events by algorithm designs at the policy level, we investigate a Closed-loop Adversarial Training (CAT) framework for safe…

Machine Learning · Computer Science 2023-10-20 Linrui Zhang , Zhenghao Peng , Quanyi Li , Bolei Zhou

Driving simulation plays a crucial role in developing reliable driving agents by providing controlled, evaluative environments. To enable meaningful assessments, a high-quality driving simulator must satisfy several key requirements:…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Junzhe Jiang , Nan Song , Jingyu Li , Xiatian Zhu , Li Zhang

In many real-world settings, regulations and economic incentives permit the sharing of models but not data across institutional boundaries. In such scenarios, practitioners might hope to adapt models to new domains, without losing…

Machine Learning · Computer Science 2025-08-29 Yewon Byun , Sanket Vaibhav Mehta , Saurabh Garg , Emma Strubell , Michael Oberst , Bryan Wilder , Zachary C. Lipton

We present an overview and evaluation of a new, systematic approach for generation of highly realistic, annotated synthetic data for training of deep neural networks in computer vision tasks. The main contribution is a procedural world…

Computer Vision and Pattern Recognition · Computer Science 2017-10-19 Apostolia Tsirikoglou , Joel Kronander , Magnus Wrenninge , Jonas Unger

In the autonomous driving domain, data collection and annotation from real vehicles are expensive and sometimes unsafe. Simulators are often used for data augmentation, which requires realistic sensor models that are hard to formulate and…

Computer Vision and Pattern Recognition · Computer Science 2019-05-20 Ahmad El Sallab , Ibrahim Sobh , Mohamed Zahran , Nader Essam