English
Related papers

Related papers: Active Learning from Scene Embeddings for End-to-E…

200 papers

Detection of moving objects is a very important task in autonomous driving systems. After the perception phase, motion planning is typically performed in Bird's Eye View (BEV) space. This would require projection of objects detected on the…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 Hazem Rashed , Mariam Essam , Maha Mohamed , Ahmad El Sallab , Senthil Yogamani

Semantic Bird's Eye View (BEV) maps offer a rich representation with strong occlusion reasoning for various decision making tasks in autonomous driving. However, most BEV mapping approaches employ a fully supervised learning paradigm that…

Computer Vision and Pattern Recognition · Computer Science 2024-05-30 Nikhil Gosala , Kürsat Petek , B Ravi Kiran , Senthil Yogamani , Paulo Drews-Jr , Wolfram Burgard , Abhinav Valada

Multi-view image generation in autonomous driving demands consistent 3D scene understanding across camera views. Most existing methods treat this problem as a 2D image set generation task, lacking explicit 3D modeling. However, we argue…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zeming Chen , Hang Zhao

End-to-End paradigms use a unified framework to implement multi-tasks in an autonomous driving system. Despite simplicity and clarity, the performance of end-to-end autonomous driving methods on sub-tasks is still far behind the single-task…

Bird's Eye View (BEV) semantic maps have recently garnered a lot of attention as a useful representation of the environment to tackle assisted and autonomous driving tasks. However, most of the existing work focuses on the fully supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Henrique Piñeiro Monteagudo , Leonardo Taccari , Aurel Pjetri , Francesco Sambo , Samuele Salti

In the field of autonomous driving and mobile robotics, there has been a significant shift in the methods used to create Bird's Eye View (BEV) representations. This shift is characterised by using transformers and learning to fuse…

Robotics · Computer Science 2024-10-29 Mehdi Hosseinzadeh , Ian Reid

Autonomous navigation requires scene understanding of the action-space to move or anticipate events. For planner agents moving on the ground plane, such as autonomous vehicles, this translates to scene understanding in the bird's-eye view…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Yigit Baran Can , Alexander Liniger , Ozan Unal , Danda Paudel , Luc Van Gool

Autonomous driving systems face significant challenges in perceiving complex environments and making real-time decisions. Traditional modular approaches, while offering interpretability, suffer from error propagation and coordination…

Artificial Intelligence · Computer Science 2025-08-11 Siyi Lu , Run Liu , Dongsheng Yang , Lei He

The integration of Large Language Models (LLMs) into autonomous driving has attracted growing interest for their strong reasoning and semantic understanding abilities, which are essential for handling complex decision-making and long-tail…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Thomas Monninger , Shaoyuan Xie , Qi Alfred Chen , Sihao Ding

Birds' Eye View (BEV) semantic segmentation is an indispensable perception task in end-to-end autonomous driving systems. Unsupervised and semi-supervised learning for BEV tasks, as pivotal for real-world applications, underperform due to…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Siyu Li , Fei Teng , Yihong Cao , Kailun Yang , Zhiyong Li , Yaonan Wang

Deep learning has revolutionized autonomous driving by enabling vehicles to perceive and interpret their surroundings with remarkable accuracy. This progress is attributed to various deep learning models, including Mediated Perception,…

Robotics · Computer Science 2023-12-12 Hemanth Manjunatha , Panagiotis Tsiotras

End-to-end autonomous driving recently emerged as a promising research direction to target autonomy from a full-stack perspective. Along this line, many of the latest works follow an open-loop evaluation setting on nuScenes to study the…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Zhiqi Li , Zhiding Yu , Shiyi Lan , Jiahan Li , Jan Kautz , Tong Lu , Jose M. Alvarez

End-to-end (E2E) autonomous driving heavily relies on closed-loop simulation, where perception, planning, and control are jointly trained and evaluated in interactive environments. Yet, most existing datasets are collected from the real…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Zhijie Qiao , Zhong Cao , Henry X. Liu

Most automated driving systems comprise a diverse sensor set, including several cameras, Radars, and LiDARs, ensuring a complete 360\deg coverage in near and far regions. Unlike Radar and LiDAR, which measure directly in 3D, cameras capture…

Awareness of the road scene is an essential component for both autonomous vehicles and Advances Driver Assistance Systems and is gaining importance both for the academia and car companies. This paper presents a way to learn a semantic-aware…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Andrea Palazzi , Guido Borghi , Davide Abati , Simone Calderara , Rita Cucchiara

Accurate localization ability is fundamental in autonomous driving. Traditional visual localization frameworks approach the semantic map-matching problem with geometric models, which rely on complex parameter tuning and thus hinder…

Computer Vision and Pattern Recognition · Computer Science 2022-11-29 Zhihuang Zhang , Meng Xu , Wenqiang Zhou , Tao Peng , Liang Li , Stefan Poslad

Prediction, decision-making, and motion planning are essential for autonomous driving. In most contemporary works, they are considered as individual modules or combined into a multi-task learning paradigm with a shared backbone but separate…

Robotics · Computer Science 2023-10-17 Pengqin Wang , Meixin Zhu , Hongliang Lu , Hui Zhong , Xianda Chen , Shaojie Shen , Xuesong Wang , Yinhai Wang

Autonomous navigation requires structured representation of the road network and instance-wise identification of the other traffic agents. Since the traffic scene is defined on the ground plane, this corresponds to scene understanding in…

Computer Vision and Pattern Recognition · Computer Science 2021-10-06 Yigit Baran Can , Alexander Liniger , Danda Pani Paudel , Luc Van Gool

Recent advancements in deep learning and the availability of high-quality real-world driving datasets have propelled end-to-end autonomous driving. Despite this progress, relying solely on real-world data limits the variety of driving…

Robotics · Computer Science 2025-10-29 Jongsuk Kim , Jaeyoung Lee , Gyojin Han , Dongjae Lee , Minki Jeong , Junmo Kim

Achieving reliable and safe autonomous driving in off-road environments requires accurate and efficient terrain traversability analysis. However, this task faces several challenges, including the scarcity of large-scale datasets tailored…

Robotics · Computer Science 2025-04-17 Yafeng Bu , Zhenping Sun , Xiaohui Li , Jun Zeng , Xin Zhang , Hui Shen