English
Related papers

Related papers: Radar-Camera BEV Multi-Task Learning with Cross-Ta…

200 papers

Multi-view 3D object detection is becoming popular in autonomous driving due to its high effectiveness and low cost. Most of the current state-of-the-art detectors follow the query-based bird's-eye-view (BEV) paradigm, which benefits from…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Zhangyang Qi , Jiaqi Wang , Xiaoyang Wu , Hengshuang Zhao

Autonomous Vehicles (AVs) use multiple sensors to gather information about their surroundings. By sharing sensor data between Connected Autonomous Vehicles (CAVs), the safety and reliability of these vehicles can be improved through a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Donghao Qiao , Farhana Zulkernine

Bird's-eye view (BEV) object detection has become important for advanced automotive 3D radar-based perception systems. However, the inherently sparse and non-deterministic nature of radar data limits the effectiveness of traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Loveneet Saini , Mirko Meuter , Hasan Tercan , Tobias Meisen

Detecting objects in 3D space using multiple cameras, known as Multi-Camera 3D Object Detection (MC3D-Det), has gained prominence with the advent of bird's-eye view (BEV) approaches. However, these methods often struggle when faced with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hao Lu , Yunpeng Zhang , Qing Lian , Dalong Du , Yingcong Chen

Most automated driving systems comprise a diverse sensor set, including several cameras, Radars, and LiDARs, ensuring a complete 360\deg coverage in near and far regions. Unlike Radar and LiDAR, which measure directly in 3D, cameras capture…

In this paper, we present BEVerse, a unified framework for 3D perception and prediction based on multi-camera systems. Unlike existing studies focusing on the improvement of single-task approaches, BEVerse features in producing…

Computer Vision and Pattern Recognition · Computer Science 2022-05-20 Yunpeng Zhang , Zheng Zhu , Wenzhao Zheng , Junjie Huang , Guan Huang , Jie Zhou , Jiwen Lu

Bird's-eye-view (BEV) grid is a typical representation of the perception of road components, e.g., drivable area, in autonomous driving. Most existing approaches rely on cameras only to perform segmentation in BEV space, which is…

Computer Vision and Pattern Recognition · Computer Science 2023-06-07 Shubhankar Borse , Senthil Yogamani , Marvin Klingner , Varun Ravi , Hong Cai , Abdulaziz Almuzairee , Fatih Porikli

Radars and cameras belong to the most frequently used sensors for advanced driver assistance systems and automated driving research. However, there has been surprisingly little research on radar-camera fusion with neural networks. One of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-29 Lukas Stäcker , Shashank Mishra , Philipp Heidenreich , Jason Rambach , Didier Stricker

Recently, the pure camera-based Bird's-Eye-View (BEV) perception provides a feasible solution for economical autonomous driving. However, the existing BEV-based multi-view 3D detectors generally transform all image features into BEV…

Computer Vision and Pattern Recognition · Computer Science 2023-07-24 Jinqing Zhang , Yanan Zhang , Qingjie Liu , Yunhong Wang

Perceiving the surrounding environment is a fundamental task in autonomous driving. To obtain highly accurate perception results, modern autonomous driving systems typically employ multi-modal sensors to collect comprehensive environmental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhiwei Lin , Zhe Liu , Yongtao Wang , Le Zhang , Ce Zhu

Semantic segmentation in bird's eye view (BEV) plays a crucial role in autonomous driving. Previous methods usually follow an end-to-end pipeline, directly predicting the BEV segmentation map from monocular RGB inputs. However, the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Tianhao Zhao , Yongcan Chen , Yu Wu , Tianyang Liu , Bo Du , Peilun Xiao , Shi Qiu , Hongda Yang , Guozhen Li , Yi Yang , Yutian Lin

3D object detection from LiDAR data for autonomous driving has been making remarkable strides in recent years. Among the state-of-the-art methodologies, encoding point clouds into a bird's eye view (BEV) has been demonstrated to be both…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Yantao Lu , Xuetao Hao , Yilan Li , Weiheng Chai , Shiqi Sun , Senem Velipasalar

Bird's-eye-view (BEV) is a powerful and widely adopted representation for road scenes that captures surrounding objects and their spatial locations, along with overall context in the scene. In this work, we focus on bird's eye semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-06-24 Mong H. Ng , Kaahan Radia , Jianfei Chen , Dequan Wang , Ionel Gog , Joseph E. Gonzalez

3D object detection using LiDAR data is an indispensable component for autonomous driving systems. Yet, only a few LiDAR-based 3D object detection methods leverage segmentation information to further guide the detection process. In this…

Computer Vision and Pattern Recognition · Computer Science 2022-03-07 Hamidreza Fazlali , Yixuan Xu , Yuan Ren , Bingbing Liu

Generating a detailed near-field perceptual model of the environment is an important and challenging problem in both self-driving vehicles and autonomous mobile robotics. A Bird Eye View (BEV) map, providing a panoptic representation, is a…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Pramit Dutta , Ganesh Sistu , Senthil Yogamani , Edgar Galván , John McDonald

As bird's-eye-view (BEV) semantic segmentation is simple-to-visualize and easy-to-handle, it has been applied in autonomous driving to provide the surrounding information to downstream tasks. Inferring BEV semantic segmentation conditioned…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Naiyu Fang , Lemiao Qiu , Shuyou Zhang , Zili Wang , Kerui Hu , Kang Wang

Pairwise point cloud registration is a critical task for many applications, which heavily depends on finding correct correspondences from the two point clouds. However, the low overlap between input point clouds causes the registration to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Lin Li , Wendong Ding , Yongkun Wen , Yufei Liang , Yong Liu , Guowei Wan

4D radar has received significant attention in autonomous driving thanks to its robustness under adverse weathers. Due to the sparse points and noisy measurements of the 4D radar, most of the research finish the 3D object detection task by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hanzhi Zhong , Zhiyu Xiang , Ruoyu Xu , Jingyun Fu , Peng Xu , Shaohong Wang , Zhihao Yang , Tianyu Pu , Eryun Liu

3D visual perception tasks, such as 3D detection from multi-camera images, are essential components of autonomous driving and assistance systems. However, designing computationally efficient methods remains a significant challenge. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Hongyu Ke , Jack Morris , Kentaro Oguchi , Xiaofei Cao , Yongkang Liu , Haoxin Wang , Yi Ding

3D perception based on the representations learned from multi-camera bird's-eye-view (BEV) is trending as cameras are cost-effective for mass production in autonomous driving industry. However, there exists a distinct performance gap…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Zeyu Wang , Dingwen Li , Chenxu Luo , Cihang Xie , Xiaodong Yang