English
Related papers

Related papers: Vision-Centric BEV Perception: A Survey

200 papers

Goal-driven mobile robot navigation in map-less environments requires effective state representations for reliable decision-making. Inspired by the favorable properties of Bird's-Eye View (BEV) in point clouds for visual perception, this…

Robotics · Computer Science 2024-09-04 Jiahao Jiang , Yuxiang Yang , Yingqi Deng , Chenlong Ma , Jing Zhang

Bird's Eye View (BEV) representations are tremendously useful for perception-related automated driving tasks. However, generating BEVs from surround-view fisheye camera images is challenging due to the strong distortions introduced by such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Ekta U. Samani , Feng Tao , Harshavardhan R. Dasari , Sihao Ding , Ashis G. Banerjee

We explore Bird's-Eye View (BEV) generation, converting a BEV map into its corresponding multi-view street images. Valued for its unified spatial representation aiding multi-sensor fusion, BEV is pivotal for various autonomous driving…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Xiaojie Xu , Tianshuo Xu , Fulong Ma , Yingcong Chen

This paper aims at achieving fine-grained building attribute segmentation in a cross-view scenario, i.e., using satellite and street-view image pairs. The main challenge lies in overcoming the significant perspective differences between…

Computer Vision and Pattern Recognition · Computer Science 2024-04-04 Junyan Ye , Qiyan Luo , Jinhua Yu , Huaping Zhong , Zhimeng Zheng , Conghui He , Weijia Li

Autonomous navigation requires scene understanding of the action-space to move or anticipate events. For planner agents moving on the ground plane, such as autonomous vehicles, this translates to scene understanding in the bird's-eye view…

Computer Vision and Pattern Recognition · Computer Science 2022-01-17 Yigit Baran Can , Alexander Liniger , Ozan Unal , Danda Paudel , Luc Van Gool

Visual bird's eye view (BEV) semantic segmentation helps autonomous vehicles understand the surrounding environment only from images, including static elements (e.g., roads) and dynamic elements (e.g., vehicles, pedestrians). However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Junyu Zhu , Lina Liu , Yu Tang , Feng Wen , Wanlong Li , Yong Liu

Bird's Eye View (BEV) semantic maps have recently garnered a lot of attention as a useful representation of the environment to tackle assisted and autonomous driving tasks. However, most of the existing work focuses on the fully supervised…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Henrique Piñeiro Monteagudo , Leonardo Taccari , Aurel Pjetri , Francesco Sambo , Samuele Salti

Bird's-Eye-View (BEV) representation has emerged as a mainstream paradigm for multi-view 3D object detection, demonstrating impressive perceptual capabilities. However, existing methods overlook the geometric quality of BEV representation,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Jinqing Zhang , Yanan Zhang , Yunlong Qi , Zehua Fu , Qingjie Liu , Yunhong Wang

Seeing only a tiny part of the whole is not knowing the full circumstance. Bird's-eye-view (BEV) perception, a process of obtaining allocentric maps from egocentric views, is restricted when using a narrow Field of View (FoV) alone. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Zhifeng Teng , Jiaming Zhang , Kailun Yang , Kunyu Peng , Hao Shi , Simon Reiß , Ke Cao , Rainer Stiefelhagen

In the field of autonomous driving, Bird's-Eye-View (BEV) perception has attracted increasing attention in the community since it provides more comprehensive information compared with pinhole front-view images and panoramas. Traditional BEV…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Jiale Wei , Junwei Zheng , Ruiping Liu , Jie Hu , Jiaming Zhang , Rainer Stiefelhagen

The Bird-Eye-View (BEV) is one of the most widely-used scene representations for visual perception in Autonomous Vehicles (AVs) due to its well suited compatibility to downstream tasks. For the enhanced safety of AVs, modeling perception…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Asen Nachkov , Martin Danelljan , Danda Pani Paudel , Luc Van Gool

Autonomous vehicles (AV) require that neural networks used for perception be robust to different viewpoints if they are to be deployed across many types of vehicles without the repeated cost of data collection and labeling for each. AV…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Tzofi Klinghoffer , Jonah Philion , Wenzheng Chen , Or Litany , Zan Gojcic , Jungseock Joo , Ramesh Raskar , Sanja Fidler , Jose M. Alvarez

Multi-modal sensor fusion in Bird's Eye View (BEV) representation has become the leading approach for 3D object detection. However, existing methods often rely on depth estimators or transformer encoders to transform image features into BEV…

Computer Vision and Pattern Recognition · Computer Science 2025-07-14 Yongjin Lee , Hyeon-Mun Jeong , Yurim Jeon , Sanghyun Kim

Detecting diverse objects within complex indoor 3D point clouds presents significant challenges for robotic perception, particularly with varied object shapes, clutter, and the co-existence of static and dynamic elements where traditional…

Robotics · Computer Science 2025-07-24 Haichuan Li , Changda Tian , Panos Trahanias , Tomi Westerlund

Bird's-eye view (BEV) maps are an important geometrically structured representation widely used in robotics, in particular self-driving vehicles and terrestrial robots. Existing algorithms either require depth information for the geometric…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Gianluca Monaci , Leonid Antsfeld , Boris Chidlovskii , Christian Wolf

The integration of Large Language Models (LLMs) into autonomous driving has attracted growing interest for their strong reasoning and semantic understanding abilities, which are essential for handling complex decision-making and long-tail…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Thomas Monninger , Shaoyuan Xie , Qi Alfred Chen , Sihao Ding

Bird's-Eye View (BEV) maps provide a structured, top-down abstraction that is crucial for autonomous-driving perception. In this work, we employ Cross-View Transformers (CVT) for learning to map camera images to three BEV's channels - road,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Felipe Carlos dos Santos , Eric Aislan Antonelo , Gustavo Claudio Karl Couto

Multi-sensor fusion is essential for an accurate and reliable autonomous driving system. Recent approaches are based on point-level fusion: augmenting the LiDAR point cloud with camera features. However, the camera-to-LiDAR projection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhijian Liu , Haotian Tang , Alexander Amini , Xinyu Yang , Huizi Mao , Daniela Rus , Song Han

The advancement of vision-only Bird's-Eye-View (BEV) perception, a core paradigm for cost-effective autonomous driving, is hindered by the long-standing fundamental trade-off between perception accuracy and on-device deployment efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yuanpeng Chen , Hui Song , Sheng Yang , Wei Tao , Shanhui Mo , Shuang Zhang , Xiao Hua , Tiankun Zhao

In this paper, we propose M$^2$BEV, a unified framework that jointly performs 3D object detection and map segmentation in the Birds Eye View~(BEV) space with multi-camera image inputs. Unlike the majority of previous works which separately…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Enze Xie , Zhiding Yu , Daquan Zhou , Jonah Philion , Anima Anandkumar , Sanja Fidler , Ping Luo , Jose M. Alvarez