English
Related papers

Related papers: End-to-end Autonomous Driving: Challenges and Fron…

200 papers

Driving safety is a top priority for autonomous vehicles. Orthogonal to prior work handling accident-prone traffic events by algorithm designs at the policy level, we investigate a Closed-loop Adversarial Training (CAT) framework for safe…

Machine Learning · Computer Science 2023-10-20 Linrui Zhang , Zhenghao Peng , Quanyi Li , Bolei Zhou

In the past two decades, autonomous driving has been catalyzed into reality by the growing capabilities of machine learning. This paradigm shift possesses significant potential to transform the future of mobility and reshape our society as…

Robotics · Computer Science 2022-10-21 Richard Chakra

Autonomous vehicles, including self driving cars, ground robots, and drones, rely on multi-modal sensor pipelines for safe operation, yet remain vulnerable to adversarial sensor attacks. A critical gap is the lack of a systematic end-to-end…

Cryptography and Security · Computer Science 2025-11-18 Qingzhao Zhang , Shaocheng Luo , Z. Morley Mao , Miroslav Pajic , Michael K. Reiter

Urban environments offer a challenging scenario for autonomous driving. Globally localizing information, such as a GPS signal, can be unreliable due to signal shadowing and multipath errors. Detailed a priori maps of the environment with…

Robotics · Computer Science 2021-08-12 Jordan Chipka

Multi-sensor fusion is essential for autonomous vehicle localization, as it is capable of integrating data from various sources for enhanced accuracy and reliability. The accuracy of the integrated location and orientation depends on the…

Robotics · Computer Science 2025-03-10 Changhong Lin , Jiarong Lin , Zhiqiang Sui , XiaoZhi Qu , Rui Wang , Kehua Sheng , Bo Zhang

Vision-Language Models (VLMs) have demonstrated significant potential for end-to-end autonomous driving. However, the field still lacks a practical platform that enables dynamic model updates, rapid validation, fair comparison, and…

Robotics · Computer Science 2025-09-16 Zhijie Qiao , Haowei Li , Zhong Cao , Henry X. Liu

Current end-to-end autonomous driving methods either run a controller based on a planned trajectory or perform control prediction directly, which have spanned two separately studied lines of research. Seeing their potential mutual benefits…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Penghao Wu , Xiaosong Jia , Li Chen , Junchi Yan , Hongyang Li , Yu Qiao

Autonomous driving techniques have been flourishing in recent years while thirsting for huge amounts of high-quality data. However, it is difficult for real-world datasets to keep up with the pace of changing requirements due to their…

Image and Video Processing · Electrical Eng. & Systems 2024-02-29 Zhihang Song , Zimin He , Xingyu Li , Qiming Ma , Ruibo Ming , Zhiqi Mao , Huaxin Pei , Lihui Peng , Jianming Hu , Danya Yao , Yi Zhang

Autonomous driving presents many challenges due to the large number of scenarios the autonomous vehicle (AV) may encounter. End-to-end deep learning models are comparatively simplistic models that can handle a broad set of scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhongying CuiZhu , Francois Charette , Amin Ghafourian , Debo Shi , Matthew Cui , Anjali Krishnamachar , Iman Soltani

As big data becomes ubiquitous across domains, and more and more stakeholders aspire to make the most of their data, demand for machine learning tools has spurred researchers to explore the possibilities of automated machine learning…

The rapid advancement of artificial intelligence is enabling the development of increasingly autonomous robots capable of operating beyond engineered factory settings and into the unstructured environments of human life. This shift raises a…

As passenger vehicle technologies have advanced, so have their capabilities to avoid obstacles, especially with developments in tires, suspensions, steering, as well as safety technologies like ABS, ESC, and more recently, ADAS systems.…

Robotics · Computer Science 2021-06-22 Evan Lowe , Levent Guvenç

The field of autonomous mobile robots has undergone dramatic advancements over the past decades. Despite achieving important milestones, several challenges are yet to be addressed. Aggregating the achievements of the robotic community as…

Since DARPA started Grand Challenges in 2004 and Urban Challenges in 2007, autonomous driving has been the most active field of AI applications. This paper gives an overview about technical aspects of autonomous driving technologies and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-12 Yu Huang , Yue Chen , Zijiang Yang

End-to-end learning has become a widely applicable and studied problem in training predictive ML models to be aware of their impact on downstream decision-making tasks. These end-to-end models often outperform traditional methods that…

Machine Learning · Computer Science 2025-05-19 Rares Cristian , Pavithra Harsha , Georgia Perakis , Brian Quanz

Since the 2004 DARPA Grand Challenge, the autonomous driving technology has witnessed nearly two decades of rapid development. Particularly, in recent years, with the application of new sensors and deep learning technologies extending to…

Cryptography and Security · Computer Science 2022-10-21 Hui Cao , Wenlong Zou , Yinkun Wang , Ting Song , Mengjun Liu

End-to-end autonomous driving directly generates planning trajectories from raw sensor data, yet it typically relies on costly perception supervision to extract scene information. A critical research challenge arises: constructing an…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Yupeng Zheng , Pengxuan Yang , Zebin Xing , Qichao Zhang , Yuhang Zheng , Yinfeng Gao , Pengfei Li , Teng Zhang , Zhongpu Xia , Peng Jia , Dongbin Zhao

While end-to-end autonomous driving has achieved remarkable progress in geometric control, current systems remain constrained by a command-following paradigm that relies on simple navigational instructions. Transitioning to genuinely…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Huan Zheng , Yucheng Zhou , Tianyi Yan , Jiayi Su , Hongjun Chen , Dubing Chen , Xingtai Gui , Wencheng Han , Runzhou Tao , Zhongying Qiu , Jianfei Yang , Jianbing Shen

End-to-end autonomous driving provides a feasible way to automatically maximize overall driving system performance by directly mapping the raw pixels from a front-facing camera to control signals. Recent advanced methods construct a latent…

Machine Learning · Computer Science 2024-05-21 Zeyu Gao , Yao Mu , Chen Chen , Jingliang Duan , Shengbo Eben Li , Ping Luo , Yanfeng Lu

Recent breakthroughs in autonomous driving have been propelled by advances in robust world modeling, fundamentally transforming how vehicles interpret dynamic scenes and execute safe decision-making. World models have emerged as a linchpin…

Robotics · Computer Science 2025-09-11 Tuo Feng , Wenguan Wang , Yi Yang