English
Related papers

Related papers: Active Learning from Scene Embeddings for End-to-E…

200 papers

Current deep learning based autonomous driving approaches yield impressive results also leading to in-production deployment in certain controlled scenarios. One of the most popular and fascinating approaches relies on learning vehicle…

Computer Vision and Pattern Recognition · Computer Science 2020-06-08 Luca Cultrera , Lorenzo Seidenari , Federico Becattini , Pietro Pala , Alberto Del Bimbo

Visual bird's eye view (BEV) perception, due to its excellent perceptual capabilities, is progressively replacing costly LiDAR-based perception systems, especially in the realm of urban intelligent driving. However, this type of perception…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Lei He , Qiaoyi Wang , Honglin Sun , Qing Xu , Bolin Gao , Shengbo Eben Li , Jianqiang Wang , Keqiang Li

In this paper, we present a novel end-to-end deep neural network model for autonomous driving that takes monocular image sequence as input, and directly generates the steering control angle. Firstly, we model the end-to-end driving problem…

Robotics · Computer Science 2021-03-11 Peng Wan , Zhenbo Song , Jianfeng Lu

Modular design of planning-oriented autonomous driving has markedly advanced end-to-end systems. However, existing architectures remain constrained by an over-reliance on ego status, hindering generalization and robust scene understanding.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Jiacheng Tang , Mingyue Feng , Jiachao Liu , Yaonong Wang , Jian Pu

Autonomous driving presents many challenges due to the large number of scenarios the autonomous vehicle (AV) may encounter. End-to-end deep learning models are comparatively simplistic models that can handle a broad set of scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2023-06-16 Zhongying CuiZhu , Francois Charette , Amin Ghafourian , Debo Shi , Matthew Cui , Anjali Krishnamachar , Iman Soltani

3D object detection in Bird's-Eye-View (BEV) space has recently emerged as a prevalent approach in the field of autonomous driving. Despite the demonstrated improvements in accuracy and velocity estimation compared to perspective view…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Yuxin Li , Qiang Han , Mengying Yu , Yuxin Jiang , Chaikiat Yeo , Yiheng Li , Zihang Huang , Nini Liu , Hsuanhan Chen , Xiaojun Wu

A semantic map of the road scene, covering fundamental road elements, is an essential ingredient in autonomous driving systems. It provides important perception foundations for positioning and planning when rendered in the Bird's-Eye-View…

Computer Vision and Pattern Recognition · Computer Science 2023-09-07 Siyu Li , Kailun Yang , Hao Shi , Jiaming Zhang , Jiacheng Lin , Zhifeng Teng , Zhiyong Li

Human drivers rely on commonsense reasoning to navigate diverse and dynamic real-world scenarios. Existing end-to-end (E2E) autonomous driving (AD) models are typically optimized to mimic driving patterns observed in data, without capturing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Yi Xu , Yuxin Hu , Zaiwei Zhang , Gregory P. Meyer , Siva Karthik Mustikovela , Siddhartha Srinivasa , Eric M. Wolff , Xin Huang

Perception is essential for autonomous driving system. Recent approaches based on Bird's-eye-view (BEV) and deep learning have made significant progress. However, there exists challenging issues including lengthy development cycles, poor…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuqi Dai , Jian Sun , Shengbo Eben Li , Qing Xu , Jianqiang Wang , Lei He , Keqiang Li

Semantic scene segmentation from a bird's-eye-view (BEV) perspective plays a crucial role in facilitating planning and decision-making for mobile robots. Although recent vision-only methods have demonstrated notable advancements in…

An accurate understanding of a self-driving vehicle's surrounding environment is crucial for its navigation system. To enhance the effectiveness of existing algorithms and facilitate further research, it is essential to provide…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Abtin Mahyar , Hossein Motamednia , Dara Rahmati

Autonomous vehicles (AV) require that neural networks used for perception be robust to different viewpoints if they are to be deployed across many types of vehicles without the repeated cost of data collection and labeling for each. AV…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Tzofi Klinghoffer , Jonah Philion , Wenzheng Chen , Or Litany , Zan Gojcic , Jungseock Joo , Ramesh Raskar , Sanja Fidler , Jose M. Alvarez

Trajectory sampling in the Frenet(road-aligned) frame, is one of the most popular methods for motion planning of autonomous vehicles. It operates by sampling a set of behavioural inputs, such as lane offset and forward speed, before solving…

Robotics · Computer Science 2023-10-24 Jatan Shrestha , Simon Idoko , Basant Sharma , Arun Kumar Singh

Human drivers adeptly navigate complex scenarios by utilizing rich attentional semantics, but the current autonomous systems struggle to replicate this ability, as they often lose critical semantic information when converting 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-09-19 Pei Liu , Haipeng Liu , Haichao Liu , Xin Liu , Jinxin Ni , Jun Ma

Autonomous vehicle perception systems have traditionally relied on costly LiDAR sensors to generate precise environmental representations. In this paper, we propose a camera-only perception framework that produces Bird's Eye View (BEV) maps…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Anupkumar Bochare

In recent years, vision-based end-to-end autonomous driving has emerged as a new paradigm. However, popular end-to-end approaches typically rely on visual feature extraction networks trained under label supervision. This limited supervision…

Robotics · Computer Science 2025-11-04 Ling Niu , Xiaoji Zheng , Han Wang , Chen Zheng , Ziyuan Yang , Bokui Chen , Jiangtao Gong

Autonomous driving is a multi-task problem requiring a deep understanding of the visual environment. End-to-end autonomous systems have attracted increasing interest as a method of learning to drive without exhaustively programming…

Computer Vision and Pattern Recognition · Computer Science 2019-09-12 Alexander Makrigiorgos , Ali Shafti , Alex Harston , Julien Gerard , A. Aldo Faisal

Depth estimation is a cornerstone of perception in autonomous driving and robotic systems. The considerable cost and relatively sparse data acquisition of LiDAR systems have led to the exploration of cost-effective alternatives, notably,…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Yucheng Mao , Ruowen Zhao , Tianbao Zhang , Hang Zhao

Understanding road geometry is a critical component of the autonomous vehicle (AV) stack. While high-definition (HD) maps can readily provide such information, they suffer from high labeling and maintenance costs. Accordingly, many recent…

Robotics · Computer Science 2024-07-10 Xunjiang Gu , Guanyu Song , Igor Gilitschenski , Marco Pavone , Boris Ivanovic

Autonomous vehicle (AV) systems rely on robust perception models as a cornerstone of safety assurance. However, objects encountered on the road exhibit a long-tailed distribution, with rare or unseen categories posing challenges to a…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Mingfu Liang , Jong-Chyi Su , Samuel Schulter , Sparsh Garg , Shiyu Zhao , Ying Wu , Manmohan Chandraker