English
Related papers

Related papers: Multi-camera Bird's Eye View Perception for Autono…

200 papers

Bird's eye view (BEV) semantic segmentation plays a crucial role in spatial sensing for autonomous driving. Although recent literature has made significant progress on BEV map understanding, they are all based on single-agent camera-based…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Runsheng Xu , Zhengzhong Tu , Hao Xiang , Wei Shao , Bolei Zhou , Jiaqi Ma

Infrastructure-based perception plays a crucial role in intelligent transportation systems, offering global situational awareness and enabling cooperative autonomy. However, existing camera-based detection models often underperform in such…

Computer Vision and Pattern Recognition · Computer Science 2025-10-29 Yun Zhang , Zhaoliang Zheng , Johnson Liu , Zhiyu Huang , Zewei Zhou , Zonglin Meng , Tianhui Cai , Jiaqi Ma

Recent vision-only perception models for autonomous driving achieved promising results by encoding multi-view image features into Bird's-Eye-View (BEV) space. A critical step and the main bottleneck of these methods is transforming image…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Jiayu Yang , Enze Xie , Miaomiao Liu , Jose M. Alvarez

In the field of autonomous driving and mobile robotics, there has been a significant shift in the methods used to create Bird's Eye View (BEV) representations. This shift is characterised by using transformers and learning to fuse…

Robotics · Computer Science 2024-10-29 Mehdi Hosseinzadeh , Ian Reid

Modern methods for vision-centric autonomous driving perception widely adopt the bird's-eye-view (BEV) representation to describe a 3D scene. Despite its better efficiency than voxel representation, it has difficulty describing the…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yuanhui Huang , Wenzhao Zheng , Yunpeng Zhang , Jie Zhou , Jiwen Lu

Perception is essential for autonomous driving system. Recent approaches based on Bird's-eye-view (BEV) and deep learning have made significant progress. However, there exists challenging issues including lengthy development cycles, poor…

Computer Vision and Pattern Recognition · Computer Science 2024-07-29 Yuqi Dai , Jian Sun , Shengbo Eben Li , Qing Xu , Jianqiang Wang , Lei He , Keqiang Li

Single camera 3D perception for traffic monitoring faces significant challenges due to occlusion and limited field of view. Moreover, fusing information from multiple cameras at the image feature level is difficult because of different view…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Arpitsinh Vaghela , Duo Lu , Aayush Atul Verma , Bharatesh Chakravarthi , Hua Wei , Yezhou Yang

Integrating LiDAR and Camera information into Bird's-Eye-View (BEV) has become an essential topic for 3D object detection in autonomous driving. Existing methods mostly adopt an independent dual-branch framework to generate LiDAR and camera…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hongxiang Cai , Zeyuan Zhang , Zhenyu Zhou , Ziyin Li , Wenbo Ding , Jiuhua Zhao

Recently, perception task based on Bird's-Eye View (BEV) representation has drawn more and more attention, and BEV representation is promising as the foundation for next-generation Autonomous Vehicle (AV) perception. However, most existing…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Yangguang Li , Bin Huang , Zeren Chen , Yufeng Cui , Feng Liang , Mingzhu Shen , Fenggang Liu , Enze Xie , Lu Sheng , Wanli Ouyang , Jing Shao

Awareness of the road scene is an essential component for both autonomous vehicles and Advances Driver Assistance Systems and is gaining importance both for the academia and car companies. This paper presents a way to learn a semantic-aware…

Computer Vision and Pattern Recognition · Computer Science 2017-06-27 Andrea Palazzi , Guido Borghi , Davide Abati , Simone Calderara , Rita Cucchiara

Current research in semantic bird's-eye view segmentation for autonomous driving focuses solely on optimizing neural network models using a single dataset, typically nuScenes. This practice leads to the development of highly specialized…

Computer Vision and Pattern Recognition · Computer Science 2026-04-29 Manuel Alejandro Diaz-Zapata , Wenqian Liu , Robin Baruffa , Christian Laugier

Bird's-eye-view (BEV) is a powerful and widely adopted representation for road scenes that captures surrounding objects and their spatial locations, along with overall context in the scene. In this work, we focus on bird's eye semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Mong H. Ng , Kaahan Radia , Jianfei Chen , Dequan Wang , Ionel Gog , Joseph E. Gonzalez

In this paper, we propose M$^2$BEV, a unified framework that jointly performs 3D object detection and map segmentation in the Birds Eye View~(BEV) space with multi-camera image inputs. Unlike the majority of previous works which separately…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Enze Xie , Zhiding Yu , Daquan Zhou , Jonah Philion , Anima Anandkumar , Sanja Fidler , Ping Luo , Jose M. Alvarez

Autonomous Vehicles (AVs) use multiple sensors to gather information about their surroundings. By sharing sensor data between Connected Autonomous Vehicles (CAVs), the safety and reliability of these vehicles can be improved through a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Donghao Qiao , Farhana Zulkernine

Vision-based Bird's Eye View (BEV) representation is an emerging perception formulation for autonomous driving. The core challenge is to construct BEV space with multi-camera features, which is a one-to-many ill-posed problem. Diving into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Yiming Wu , Ruixiang Li , Zequn Qin , Xinhai Zhao , Xi Li

Bird's Eye View (BEV) representations are tremendously useful for perception-related automated driving tasks. However, generating BEVs from surround-view fisheye camera images is challenging due to the strong distortions introduced by such…

Computer Vision and Pattern Recognition · Computer Science 2023-08-03 Ekta U. Samani , Feng Tao , Harshavardhan R. Dasari , Sihao Ding , Ashis G. Banerjee

Many tasks performed by autonomous vehicles such as road marking detection, object tracking, and path planning are simpler in bird's-eye view. Hence, Inverse Perspective Mapping (IPM) is often applied to remove the perspective effect from a…

Computer Vision and Pattern Recognition · Computer Science 2019-05-03 Tom Bruls , Horia Porav , Lars Kunze , Paul Newman

Environmental perception with the multi-modal fusion of radar and camera is crucial in autonomous driving to increase accuracy, completeness, and robustness. This paper focuses on utilizing millimeter-wave (MMW) radar and camera sensor…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Taohua Zhou , Yining Shi , Junjie Chen , Kun Jiang , Mengmeng Yang , Diange Yang

We tackle a new problem of multi-view camera and subject registration in the bird's eye view (BEV) without pre-given camera calibration. This is a very challenging problem since its only input is several RGB images from different…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Zekun Qian , Ruize Han , Wei Feng , Feifan Wang , Song Wang

Integrating LiDAR and camera information into Bird's-Eye-View (BEV) representation has emerged as a crucial aspect of 3D object detection in autonomous driving. However, existing methods are susceptible to the inaccurate calibration…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ziying Song , Lei Yang , Shaoqing Xu , Lin Liu , Dongyang Xu , Caiyan Jia , Feiyang Jia , Li Wang