English
Related papers

Related papers: Multi-Camera Calibration Free BEV Representation f…

200 papers

In this paper, we present DAT, a Depth-Aware Transformer framework designed for camera-based 3D detection. Our model is based on observing two major issues in existing methods: large depth translation errors and duplicate predictions along…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Hao Zhang , Hongyang Li , Ailing Zeng , Feng Li , Shilong Liu , Xingyu Liao , Lei Zhang

Camera-based bird-eye-view (BEV) perception paradigm has made significant progress in the autonomous driving field. Under such a paradigm, accurate BEV representation construction relies on reliable depth estimation for multi-camera images.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Yang Jiao , Zequn Jie , Shaoxiang Chen , Lechao Cheng , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Although multi-view 3D object detection based on the Bird's-Eye-View (BEV) paradigm has garnered widespread attention as an economical and deployment-friendly perception solution for autonomous driving, there is still a performance gap…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zheng Jiang , Jinqing Zhang , Yanan Zhang , Qingjie Liu , Zhenghui Hu , Baohui Wang , Yunhong Wang

Vision-centric Bird's Eye View (BEV) perception holds considerable promise for autonomous driving. Recent studies have prioritized efficiency or accuracy enhancements, yet the issue of domain shift has been overlooked, leading to…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Rongyu Zhang , Jiaming Liu , Xiaoqi Li , Xiaowei Chi , Dan Wang , Li Du , Yuan Du , Shanghang Zhang

Critical research about camera-and-LiDAR-based semantic object segmentation for autonomous driving significantly benefited from the recent development of deep learning. Specifically, the vision transformer is the novel ground-breaker that…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Junyi Gu , Mauro Bellone , Tomáš Pivoňka , Raivo Sell

Integrating LiDAR and camera information in the bird's eye view (BEV) representation has demonstrated its effectiveness in 3D object detection. However, because of the fundamental disparity in geometric accuracy between these sensors,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Guowen Zhang , Chenhang He , Liyi Chen , Lei Zhang

Detecting objects in 3D space using multiple cameras, known as Multi-Camera 3D Object Detection (MC3D-Det), has gained prominence with the advent of bird's-eye view (BEV) approaches. However, these methods often struggle when faced with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hao Lu , Yunpeng Zhang , Qing Lian , Dalong Du , Yingcong Chen

In this paper, we propose M$^2$BEV, a unified framework that jointly performs 3D object detection and map segmentation in the Birds Eye View~(BEV) space with multi-camera image inputs. Unlike the majority of previous works which separately…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Enze Xie , Zhiding Yu , Daquan Zhou , Jonah Philion , Anima Anandkumar , Sanja Fidler , Ping Luo , Jose M. Alvarez

We present Contrastive Feature Masking Vision Transformer (CFM-ViT) - an image-text pretraining methodology that achieves simultaneous learning of image- and region-level representation for open-vocabulary object detection (OVD). Our…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Dahun Kim , Anelia Angelova , Weicheng Kuo

Bird's-Eye-View (BEV) representation has emerged as a mainstream paradigm for multi-view 3D object detection, demonstrating impressive perceptual capabilities. However, existing methods overlook the geometric quality of BEV representation,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Jinqing Zhang , Yanan Zhang , Yunlong Qi , Zehua Fu , Qingjie Liu , Yunhong Wang

4D millimeter-wave radar has emerged as a promising sensing modality for autonomous driving due to its robustness and affordability. However, its sparse and weak geometric cues make reliable instance activation difficult, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Xiaokai Bai , Lianqing Zheng , Si-Yuan Cao , Xiaohan Zhang , Zhe Wu , Beinan Yu , Fang Wang , Jie Bai , Hui-Liang Shen

The advancement of vision-only Bird's-Eye-View (BEV) perception, a core paradigm for cost-effective autonomous driving, is hindered by the long-standing fundamental trade-off between perception accuracy and on-device deployment efficiency.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Yuanpeng Chen , Hui Song , Sheng Yang , Wei Tao , Shanhui Mo , Shuang Zhang , Xiao Hua , Tiankun Zhao

Although multiview fusion has demonstrated potential in LiDAR segmentation, its dependence on computationally intensive point-based interactions, arising from the lack of fixed correspondences between views such as range view and Bird's-Eye…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Shoumeng Qiu , Xinrun Li , XiangYang Xue , Jian Pu

Accurately detecting lane lines in 3D space is crucial for autonomous driving. Existing methods usually first transform image-view features into bird-eye-view (BEV) by aid of inverse perspective mapping (IPM), and then detect lane lines…

Computer Vision and Pattern Recognition · Computer Science 2023-06-09 Ziye Chen , Kate Smith-Miles , Bo Du , Guoqi Qian , Mingming Gong

Three-dimensional object detection is one of the key tasks in autonomous driving. To reduce costs in practice, low-cost multi-view cameras for 3D object detection are proposed to replace the expansive LiDAR sensors. However, relying solely…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zhiwei Lin , Zhe Liu , Zhongyu Xia , Xinhao Wang , Yongtao Wang , Shengxiang Qi , Yang Dong , Nan Dong , Le Zhang , Ce Zhu

Bird's-Eye-View (BEV) maps have emerged as one of the most powerful representations for scene understanding due to their ability to provide rich spatial context while being easy to interpret and process. Such maps have found use in many…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Nikhil Gosala , Abhinav Valada

In the field of autonomous driving and mobile robotics, there has been a significant shift in the methods used to create Bird's Eye View (BEV) representations. This shift is characterised by using transformers and learning to fuse…

Robotics · Computer Science 2024-10-29 Mehdi Hosseinzadeh , Ian Reid

3D object detection from multiple image views is a fundamental and challenging task for visual scene understanding. Owing to its low cost and high efficiency, multi-view 3D object detection has demonstrated promising application prospects.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Zehui Chen , Zhenyu Li , Shiquan Zhang , Liangji Fang , Qinhong Jiang , Feng Zhao

In autonomous driving, accurate 3D lane detection using monocular cameras is important for downstream tasks. Recent CNN and Transformer approaches usually apply a two-stage model design. The first stage transforms the image feature from a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yifeng Bai , Zhirong Chen , Pengpeng Liang , Bo Song , Erkang Cheng

The transformation of features from 2D perspective space to 3D space is essential to multi-view 3D object detection. Recent approaches mainly focus on the design of view transformation, either pixel-wisely lifting perspective view features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yuqi Wang , Yuntao Chen , Zhaoxiang Zhang