English
Related papers

Related papers: SynAD: Enhancing Real-World End-to-End Autonomous …

200 papers

Imitation learning is a promising approach to end-to-end training of autonomous vehicle controllers. Typically the driving process with such approaches is entirely automatic and black-box, although in practice it is desirable to control the…

Robotics · Computer Science 2020-11-23 Renhao Wang , Adam Scibior , Frank Wood

End-to-end autonomous driving methods aim to directly map raw sensor inputs to future driving actions such as planned trajectories, bypassing traditional modular pipelines. While these approaches have shown promise, they often operate under…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Bozhou Zhang , Nan Song , Jingyu Li , Xiatian Zhu , Jiankang Deng , Li Zhang

Modular end-to-end (ME2E) autonomous driving paradigms combine modular interpretability with global optimization capability and have demonstrated strong performance. However, existing studies mainly focus on accuracy improvement, while…

Artificial Intelligence · Computer Science 2026-01-13 Chengzhi Ji , Xingfeng Li , Zhaodong Lv , Hao Sun , Pan Liu , Hao Frank Yang , Ziyuan Pu

To advance research in learning-based defogging algorithms, various synthetic fog datasets have been developed. However, existing datasets created using the Atmospheric Scattering Model (ASM) or real-time rendering engines often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Yiming Xie , Henglu Wei , Zhenyi Liu , Xiaoyu Wang , Xiangyang Ji

Many safety-critical applications, especially in autonomous driving, require reliable object detectors. They can be very effectively assisted by a method to search for and identify potential failures and systematic errors before these…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Valentyn Boreiko , Matthias Hein , Jan Hendrik Metzen

Deep-learning-based techniques have been widely adopted for autonomous driving software stacks for mass production in recent years, focusing primarily on perception modules, with some work extending this method to prediction modules.…

Robotics · Computer Science 2024-06-03 Weijian Sun , Yanbo Jia , Qi Zeng , Zihao Liu , Jiang Liao , Yue Li , Xianfeng Li

Scalable training data generation is a critical problem in deep learning. We propose PennSyn2Real - a photo-realistic synthetic dataset consisting of more than 100,000 4K images of more than 20 types of micro aerial vehicles (MAVs). The…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Ty Nguyen , Ian D. Miller , Avi Cohen , Dinesh Thakur , Shashank Prasad , Camillo J. Taylor , Pratik Chaudrahi , Vijay Kumar

This paper addresses the challenge of overfitting in the learning of dynamical systems by introducing a novel approach for the generation of synthetic data, aimed at enhancing model generalization and robustness in scenarios characterized…

Machine Learning · Computer Science 2024-03-11 Dario Piga , Matteo Rufolo , Gabriele Maroni , Manas Mejari , Marco Forgione

Driving simulators play a large role in developing and testing new intelligent vehicle systems. The visual fidelity of the simulation is critical for building vision-based algorithms and conducting human driver experiments. Low visual…

Computer Vision and Pattern Recognition · Computer Science 2022-07-22 Ekim Yurtsever , Dongfang Yang , Ibrahim Mert Koc , Keith A. Redmill

With the development and the increasing interests in ML/DL fields, companies are eager to apply Machine Learning/Deep Learning approaches to increase service quality and customer experience. Federated Learning was implemented as an…

Machine Learning · Computer Science 2022-01-02 Hongyi Zhang , Jan Bosch , Helena Holmström Olsson

Collecting real-world data is often considered the bottleneck of Artificial Intelligence, stalling the research progress in several fields, one of which is camera localization. End-to-end camera localization methods are still outperformed…

Computer Vision and Pattern Recognition · Computer Science 2023-05-30 Daniel Coelho , Miguel Oliveira , Paulo Dias

Although many AI applications of interest require specialized multi-modal models, relevant data to train such models is inherently scarce or inaccessible. Filling these gaps with human annotators is prohibitively expensive, error-prone, and…

Artificial Intelligence · Computer Science 2026-04-01 Tim R. Davidson , Benoit Seguin , Enrico Bacis , Cesar Ilharco , Hamza Harkous

Evaluating and ensuring the adversarial robustness of autonomous driving (AD) systems is a critical and unresolved challenge. This paper introduces MetAdv, a novel adversarial testing platform that enables realistic, dynamic, and…

During the process of driving, humans usually rely on multiple senses to gather information and make decisions. Analogously, in order to achieve embodied intelligence in autonomous driving, it is essential to integrate multidimensional…

Self-driving cars relying solely on ego-centric perception face limitations in sensing, often failing to detect occluded, faraway objects. Collaborative autonomous driving (CAV) seems like a promising direction, but collecting data for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-03 Tai-Yu Pan , Sooyoung Jeon , Mengdi Fan , Jinsu Yoo , Zhenyang Feng , Mark Campbell , Kilian Q. Weinberger , Bharath Hariharan , Wei-Lun Chao

End-to-End Autonomous Driving (E2E-AD) systems are typically grouped by the nature of their outputs: (i) waypoint-based models that predict a future trajectory, and (ii) action-based models that directly output throttle, steer and brake.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jorge Daniel Rodríguez-Vidal , Gabriel Villalonga , Diego Porres , Antonio M. López Peña

Autonomous parking fundamentally differs from on-road driving due to its frequent direction changes and complex maneuvering requirements. However, existing End-to-End (E2E) planning methods often simplify the parking task into a geometric…

Robotics · Computer Science 2026-02-26 Jishu Miao , Han Chen , Jiankun Zhai , Qi Liu , Tsubasa Hirakawa , Takayoshi Yamashita , Hironobu Fujiyoshi

Recent breakthroughs in autonomous driving have been propelled by advances in robust world modeling, fundamentally transforming how vehicles interpret dynamic scenes and execute safe decision-making. World models have emerged as a linchpin…

Robotics · Computer Science 2025-09-11 Tuo Feng , Wenguan Wang , Yi Yang

End-to-end autonomous driving has gained significant attention for its potential to learn robust behavior in interactive scenarios and scale with data. Popular architectures often build on separate modules for perception and planning…

Robotics · Computer Science 2026-03-17 David Holtz , Niklas Hanselmann , Simon Doll , Marius Cordts , Bernt Schiele

In recent years, considerable progress has been made towards a vehicle's ability to operate autonomously. An end-to-end approach attempts to achieve autonomous driving using a single, comprehensive software component. Recent breakthroughs…

Robotics · Computer Science 2019-05-17 Hege Haavaldsen , Max Aasboe , Frank Lindseth