English
Related papers

Related papers: Incorporating Orientations into End-to-end Driving…

200 papers

Research interest in end-to-end autonomous driving has surged owing to its fully differentiable design integrating modular tasks, i.e. perception, prediction and planing, which enables optimization in pursuit of the ultimate goal. Despite…

Artificial Intelligence · Computer Science 2025-06-04 Anqing Jiang , Yu Gao , Zhigang Sun , Yiru Wang , Jijun Wang , Jinghao Chai , Qian Cao , Yuweng Heng , Hao Jiang , Yunda Dong , Zongzheng Zhang , Xianda Guo , Hao Sun , Hao Zhao

End-to-End (E2E) planning has become a powerful paradigm for autonomous driving, yet current systems remain fundamentally uncertainty-blind. They assume perception outputs are fully reliable, even in ambiguous or poorly observed scenes,…

Robotics · Computer Science 2025-12-01 Wonjeong Ryu , Seungjun Yu , Seokha Moon , Hojun Choi , Junsung Park , Jinkyu Kim , Hyunjung Shim

Existing deep-learning based monocular orientation estimation algorithms faces the problem of confusion between the anterior and posterior parts of the objects, caused by the feature similarity of such parts in typical objects in traffic…

Computer Vision and Pattern Recognition · Computer Science 2020-12-22 Chenchen Zhao , Hao Li

Autonomous driving is a challenging task that requires perceiving and understanding the surrounding environment for safe trajectory planning. While existing vision-based end-to-end models have achieved promising results, these methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-01-16 Tengpeng Li , Hanli Wang , Xianfei Li , Wenlong Liao , Tao He , Pai Peng

Visual perception is the most critical input for driving decisions. In this study, our aim is to understand relationship between saliency and driving decisions. We present a novel attention-based saliency map prediction model for making…

Computer Vision and Pattern Recognition · Computer Science 2020-02-26 Ekrem Aksoy , Ahmet Yazıcı , Mahmut Kasap

Practical autonomous driving requires models that generalize by reasoning through spatial-temporal possibilities to exclude unsafe outcomes. While state-of-the-art (SOTA) methods use parallel planning architectures, they fail to explicitly…

Robotics · Computer Science 2026-05-12 Yanhao Wu , Haoyang Zhang , Fei He , Rui Wu , Yanhu Shan , Congpei Qiu , Liang Gao , Wei Ke , Tong Zhang

End-to-end autonomous driving aims to generate safe and plausible planning policies from raw sensor input. Driving world models have shown great potential in learning rich representations by predicting the future evolution of a driving…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Xingtai Gui , Meijie Zhang , Tianyi Yan , Wencheng Han , Jiahao Gong , Feiyang Tan , Cheng-zhong Xu , Jianbing Shen

Optical sensors and learning algorithms for autonomous vehicles have dramatically advanced in the past few years. Nonetheless, the reliability of today's autonomous vehicles is hindered by the limited line-of-sight sensing capability and…

Computer Vision and Pattern Recognition · Computer Science 2022-11-21 Jiaxun Cui , Hang Qiu , Dian Chen , Peter Stone , Yuke Zhu

Autonomous vehicle (AV) stacks have traditionally relied on decomposed approaches, with separate modules handling perception, prediction, and planning. However, this design introduces information loss during inter-module communication,…

Accurately estimating the position of static objects, such as traffic lights, from the moving camera of a self-driving car is a challenging problem. In this work, we present a system that improves the localization of static objects by…

Computer Vision and Pattern Recognition · Computer Science 2021-01-05 Mohamed Chaabane , Lionel Gueguen , Ameni Trabelsi , Ross Beveridge , Stephen O'Hara

End-to-end autonomous driving has made impressive progress in recent years. Existing methods usually adopt the decoupled encoder-decoder paradigm, where the encoder extracts hidden features from raw sensor data, and the decoder outputs the…

Computer Vision and Pattern Recognition · Computer Science 2023-05-11 Xiaosong Jia , Penghao Wu , Li Chen , Jiangwei Xie , Conghui He , Junchi Yan , Hongyang Li

This research aims to explore the application of deep learning in autonomous driving computer vision technology and its impact on improving system performance. By using advanced technologies such as convolutional neural networks (CNN),…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jingyu Zhang , Jin Cao , Jinghao Chang , Xinjin Li , Houze Liu , Zhenglin Li

With the rapid development of machine learning, autonomous driving has become a hot issue, making urgent demands for more intelligent perception and planning systems. Self-driving cars can avoid traffic crashes with precisely predicted…

Robotics · Computer Science 2021-11-01 Jianbang Liu , Xinyu Mao , Yuqi Fang , Delong Zhu , Max Q. -H. Meng

End-to-end learning for autonomous navigation has received substantial attention recently as a promising method for reducing modeling error. However, its data complexity, especially around generalization to unseen environments, is high. We…

Robotics · Computer Science 2019-04-04 Xiangyun Meng , Nathan Ratliff , Yu Xiang , Dieter Fox

Robust perception-action models should be learned from training data with diverse visual appearances and realistic behaviors, yet current approaches to deep visuomotor policy learning have been generally limited to in-situ models learned…

Computer Vision and Pattern Recognition · Computer Science 2017-07-25 Huazhe Xu , Yang Gao , Fisher Yu , Trevor Darrell

Safety remains one of the most critical challenges in autonomous driving systems. In recent years, the end-to-end driving has shown great promise in advancing vehicle autonomy in a scalable manner. However, existing approaches often face…

Robotics · Computer Science 2025-05-12 Zhiwei Zhang , Ruichen Yang , Ke Wu , Zijun Xu , Jingchu Liu , Lisen Mu , Zhongxue Gan , Wenchao Ding

Autonomous racing has rapidly gained research attention. Traditionally, racing cars rely on 2D LiDAR as their primary visual system. In this work, we explore the integration of an event camera with the existing system to provide enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Zhuyun Zhou , Zongwei Wu , Florian Bolli , Rémi Boutteau , Fan Yang , Radu Timofte , Dominique Ginhac , Tobi Delbruck

We present a framework for vision-based model predictive control (MPC) for the task of aggressive, high-speed autonomous driving. Our approach uses deep convolutional neural networks to predict cost functions from input video which are…

Robotics · Computer Science 2017-07-18 Paul Drews , Grady Williams , Brian Goldfain , Evangelos A. Theodorou , James M. Rehg

In recent years, fully differentiable end-to-end autonomous driving systems have become a research hotspot in the field of intelligent transportation. Among various research directions, automatic parking is particularly critical as it aims…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Hangyu Du , Chee-Meng Chew

Traditional autonomous driving methods adopt a modular design, decomposing tasks into sub-tasks. In contrast, end-to-end autonomous driving directly outputs actions from raw sensor data, avoiding error accumulation. However, training an…

Robotics · Computer Science 2024-11-22 Zeyu Dong , Yimin Zhu , Yansong Li , Kevin Mahon , Yu Sun