English
Related papers

Related papers: Understanding Bird's-Eye View of Road Semantics us…

200 papers

Moving object detection and segmentation is an essential task in the Autonomous Driving pipeline. Detecting and isolating static and moving components of a vehicle's surroundings are particularly crucial in path planning and localization…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 Sambit Mohapatra , Mona Hodaei , Senthil Yogamani , Stefan Milz , Heinrich Gotzig , Martin Simon , Hazem Rashed , Patrick Maeder

LiDAR is crucial for robust 3D scene perception in autonomous driving. LiDAR perception has the largest body of literature after camera perception. However, multi-task learning across tasks like detection, segmentation, and motion…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Sambit Mohapatra , Senthil Yogamani , Varun Ravi Kumar , Stefan Milz , Heinrich Gotzig , Patrick Mäder

Autonomous Vehicles (AVs) use multiple sensors to gather information about their surroundings. By sharing sensor data between Connected Autonomous Vehicles (CAVs), the safety and reliability of these vehicles can be improved through a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Donghao Qiao , Farhana Zulkernine

In this paper, we propose M$^2$BEV, a unified framework that jointly performs 3D object detection and map segmentation in the Birds Eye View~(BEV) space with multi-camera image inputs. Unlike the majority of previous works which separately…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Enze Xie , Zhiding Yu , Daquan Zhou , Jonah Philion , Anima Anandkumar , Sanja Fidler , Ping Luo , Jose M. Alvarez

Today's autonomous vehicles rely extensively on high-definition 3D maps to navigate the environment. While this approach works well when these maps are completely up-to-date, safe autonomous vehicles must be able to corroborate the map's…

Computer Vision and Pattern Recognition · Computer Science 2016-12-09 Ari Seff , Jianxiong Xiao

Accurate object detection and prediction are critical to ensure the safety and efficiency of self-driving architectures. Predicting object trajectories and occupancy enables autonomous vehicles to anticipate movements and make decisions…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Miguel Antunes-García , Luis M. Bergasa , Santiago Montiel-Marín , Rafael Barea , Fabio Sánchez-García , Ángel Llamazares

The recent surge in interest in autonomous driving stems from its rapidly developing capacity to enhance safety, efficiency, and convenience. A pivotal aspect of autonomous driving technology is its perceptual systems, where core algorithms…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Qi Zhang , Siyuan Gou , Wenbin Li

In autonomous driving, high-definition (HD) maps and semantic maps in bird's-eye view (BEV) are essential for accurate localization, planning, and decision-making. This paper introduces an enhanced End-to-End model named MapFM for online…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Leonid Ivanov , Vasily Yuryev , Dmitry Yudin

Perceiving the world and forecasting its future state is a critical task for self-driving. Supervised approaches leverage annotated object labels to learn a model of the world -- traditionally with object detections and trajectory…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Ben Agro , Quinlan Sykora , Sergio Casas , Thomas Gilles , Raquel Urtasun

This paper provides a review of deep learning applications in scene understanding in autonomous robots, including innovations in object detection, semantic and instance segmentation, depth estimation, 3D reconstruction, and visual SLAM. It…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Afia Maham , Dur E Nayab Tashfa

The ability to perform semantic segmentation in real-time capable applications with limited hardware is of great importance. One such application is the interpretation of the visual bird's-eye view, which requires the semantic segmentation…

Computer Vision and Pattern Recognition · Computer Science 2018-11-30 Timo Sämann , Karl Amende , Stefan Milz , Christian Witt , Martin Simon , Johannes Petzold

Infrastructure-based perception plays a crucial role in intelligent transportation systems, offering global situational awareness and enabling cooperative autonomy. However, existing camera-based detection models often underperform in such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Yun Zhang , Zhaoliang Zheng , Johnson Liu , Zhiyu Huang , Zewei Zhou , Zonglin Meng , Tianhui Cai , Jiaqi Ma

Identifying moving objects is an essential capability for autonomous systems, as it provides critical information for pose estimation, navigation, collision avoidance, and static map construction. In this paper, we present MotionBEV, a fast…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Bo Zhou , Jiapeng Xie , Yan Pan , Jiajie Wu , Chuanzhao Lu

In this paper, we address the novel, highly challenging problem of estimating the layout of a complex urban driving scenario. Given a single color image captured from a driving platform, we aim to predict the bird's-eye view layout of the…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Kaustubh Mani , Swapnil Daga , Shubhika Garg , N. Sai Shankar , Krishna Murthy Jatavallabhula , K. Madhava Krishna

3D perception based on the representations learned from multi-camera bird's-eye-view (BEV) is trending as cameras are cost-effective for mass production in autonomous driving industry. However, there exists a distinct performance gap…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Zeyu Wang , Dingwen Li , Chenxu Luo , Cihang Xie , Xiaodong Yang

Accurate and comprehensive semantic segmentation of Bird's Eye View (BEV) is essential for ensuring safe and proactive navigation in autonomous driving. Although cooperative perception has exceeded the detection capabilities of single-agent…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Dominik Rößle , Jeremias Gerner , Klaus Bogenberger , Daniel Cremers , Stefanie Schmidtner , Torsten Schön

Achieving robust and real-time 3D perception is fundamental for autonomous vehicles. While most existing 3D perception methods prioritize detection accuracy, they often overlook critical aspects such as computational efficiency, onboard…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Trung Pham , Mehran Maghoumi , Wanli Jiang , Bala Siva Sashank Jujjavarapu , Mehdi Sajjadi , Xin Liu , Hsuan-Chu Lin , Bor-Jeng Chen , Giang Truong , Chao Fang , Junghyun Kwon , Minwoo Park

The bird's-eye-view (BEV) representation allows robust learning of multiple tasks for autonomous driving including road layout estimation and 3D object detection. However, contemporary methods for unified road layout estimation and 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-09-20 Curie Kim , Ue-Hwan Kim

Cross-view image matching for geo-localisation is a challenging problem due to the significant visual difference between aerial and ground-level viewpoints. The method provides localisation capabilities from geo-referenced images,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Tavis Shore , Simon Hadfield , Oscar Mendez

While most recent autonomous driving system focuses on developing perception methods on ego-vehicle sensors, people tend to overlook an alternative approach to leverage intelligent roadside cameras to extend the perception ability beyond…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Lei Yang , Tao Tang , Jun Li , Peng Chen , Kun Yuan , Li Wang , Yi Huang , Xinyu Zhang , Kaicheng Yu