English
Related papers

Related papers: SynAD: Enhancing Real-World End-to-End Autonomous …

200 papers

Safe and scalable deployment of end-to-end (E2E) autonomous driving requires extensive and diverse data, particularly safety-critical events. Existing data are mostly generated from simulators with a significant sim-to-real gap or collected…

Robotics · Computer Science 2025-09-18 Jiawei Wang , Haowei Sun , Xintao Yan , Shuo Feng , Jun Gao , Henry X. Liu

End-to-end autonomous driving (AD) systems increasingly adopt vision-language-action (VLA) models, yet they typically ignore the passenger's emotional state, which is central to comfort and AD acceptance. We introduce Open-Domain End-to-End…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Yihong Tang , Haicheng Liao , Tong Nie , Junlin He , Ao Qu , Kehua Chen , Wei Ma , Zhenning Li , Lijun Sun , Chengzhong Xu

Reliable anticipation of traffic accidents is essential for advancing autonomous driving systems. However, this objective is limited by two fundamental challenges: the scarcity of diverse, high-quality training data and the frequent absence…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yanchen Guan , Haicheng Liao , Chengyue Wang , Xingcheng Liu , Jiaxun Zhang , Zhenning Li

Autonomous driving relies on a huge volume of real-world data to be labeled to high precision. Alternative solutions seek to exploit driving simulators that can generate large amounts of labeled data with a plethora of content variations.…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 David Acuna , Jonah Philion , Sanja Fidler

In recent years, autonomous parking has made significant advances, yet parking tasks still face challenges in extreme scenarios such as mechanical and dead-end parking slots, often resulting in failures. This is mainly due to traditional…

Robotics · Computer Science 2026-05-12 Changze Li , Zhe Chen , Shaoyu Chen , Lisen Mu , Yijian Li , Yuelong Yu , Qian Zhang , Qing Su , Ming Yang , Tong Qin

Autonomous driving system development is critically dependent on the ability to replay complex and diverse traffic scenarios in simulation. In such scenarios, the ability to accurately simulate the vehicle sensors such as cameras, lidar or…

Computer Vision and Pattern Recognition · Computer Science 2020-06-26 Zhenpei Yang , Yuning Chai , Dragomir Anguelov , Yin Zhou , Pei Sun , Dumitru Erhan , Sean Rafferty , Henrik Kretzschmar

An intelligent driving system should dynamically formulate appropriate driving strategies based on the current environment and vehicle status while ensuring system security and reliability. However, methods based on reinforcement learning…

Robotics · Computer Science 2025-09-11 Zuojin Tang , Xiaoyu Chen , Yongqiang Li , Jianyu Chen

This paper presents a pioneering exploration into the integration of fine-grained human supervision within the autonomous driving domain to enhance system performance. The current advances in End-to-End autonomous driving normally are…

Robotics · Computer Science 2024-08-21 Yiqun Duan , Zhuoli Zhuang , Jinzhao Zhou , Yu-Cheng Chang , Yu-Kai Wang , Chin-Teng Lin

Generating representative rear-end crash scenarios is crucial for safety assessments of Advanced Driver Assistance Systems (ADAS) and Automated Driving systems (ADS). However, existing methods for scenario generation face challenges such as…

Robotics · Computer Science 2024-06-25 Jian Wu , Carol Flannagan , Ulrich Sander , Jonas Bärgman

Ensuring the safety and reliability of Automated Driving Systems (ADS) remains a critical challenge, as traditional verification methods such as large-scale on-road testing are prohibitively costly and time-consuming.To address…

Software Engineering · Computer Science 2025-12-18 Ji Zhou , Yongqi Zhao , Yixian Hu , Hexuan Li , Zhengguo Gu , Nan Xu , Arno Eichberger

Recently, event-based vision sensors have gained attention for autonomous driving applications, as conventional RGB cameras face limitations in handling challenging dynamic conditions. However, the availability of real-world and synthetic…

Computer Vision and Pattern Recognition · Computer Science 2024-04-24 Manideep Reddy Aliminati , Bharatesh Chakravarthi , Aayush Atul Verma , Arpitsinh Vaghela , Hua Wei , Xuesong Zhou , Yezhou Yang

Understanding the world in first-person view is fundamental in Augmented Reality (AR). This immersive perspective brings dramatic visual changes and unique challenges compared to third-person views. Synthetic data has empowered…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Gen Li , Kaifeng Zhao , Siwei Zhang , Xiaozhong Lyu , Mihai Dusmanu , Yan Zhang , Marc Pollefeys , Siyu Tang

End-to-End paradigms use a unified framework to implement multi-tasks in an autonomous driving system. Despite simplicity and clarity, the performance of end-to-end autonomous driving methods on sub-tasks is still far behind the single-task…

Learning contextual and spatial environmental representations enhances autonomous vehicle's hazard anticipation and decision-making in complex scenarios. Recent perception systems enhance spatial understanding with sensor fusion but often…

Robotics · Computer Science 2024-01-18 Shoaib Azam , Farzeen Munir , Ville Kyrki , Moongu Jeon , Witold Pedrycz

Personalization, while extensively studied in conventional autonomous driving pipelines, has been largely overlooked in the context of end-to-end autonomous driving (E2EAD), despite its critical role in fostering user trust, safety…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ruiyang Hao , Bowen Jing , Haibao Yu , Zaiqing Nie

End-to-end autonomous driving is a fully differentiable machine learning system that takes raw sensor input data and other metadata as prior information and directly outputs the ego vehicle's control signals or planned trajectories. This…

Robotics · Computer Science 2023-12-01 Apoorv Singh

While developing perception based deep learning models, the benefit of synthetic data is enormous. However, performance of networks trained with synthetic data for certain computer vision tasks degrade significantly when tested on real…

Computer Vision and Pattern Recognition · Computer Science 2023-02-09 Koustav Mullick , Harshil Jain , Sanchit Gupta , Amit Arvind Kale

The well-established modular autonomous driving system is decoupled into different standalone tasks, e.g. perception, prediction and planning, suffering from information loss and error accumulation across modules. In contrast, end-to-end…

Computer Vision and Pattern Recognition · Computer Science 2024-06-03 Wenchao Sun , Xuewu Lin , Yining Shi , Chuang Zhang , Haoran Wu , Sifa Zheng

Deep learning models for self-driving cars require a diverse training dataset to manage critical driving scenarios on public roads safely. This includes having data from divergent trajectories, such as the oncoming traffic lane or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-08 Jonathan Schmidt , Qadeer Khan , Daniel Cremers

We present a novel synthetically generated multi-modal dataset, SCaRL, to enable the training and validation of autonomous driving solutions. Multi-modal datasets are essential to attain the robustness and high accuracy required by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-28 Avinash Nittur Ramesh , Aitor Correas-Serrano , María González-Huici