English

DualBEV: Unifying Dual View Transformation with Probabilistic Correspondences

Computer Vision and Pattern Recognition 2024-09-16 v2

Abstract

Camera-based Bird's-Eye-View (BEV) perception often struggles between adopting 3D-to-2D or 2D-to-3D view transformation (VT). The 3D-to-2D VT typically employs resource-intensive Transformer to establish robust correspondences between 3D and 2D features, while the 2D-to-3D VT utilizes the Lift-Splat-Shoot (LSS) pipeline for real-time application, potentially missing distant information. To address these limitations, we propose DualBEV, a unified framework that utilizes a shared feature transformation incorporating three probabilistic measurements for both strategies. By considering dual-view correspondences in one stage, DualBEV effectively bridges the gap between these strategies, harnessing their individual strengths. Our method achieves state-of-the-art performance without Transformer, delivering comparable efficiency to the LSS approach, with 55.2% mAP and 63.4% NDS on the nuScenes test set. Code is available at \url{https://github.com/PeidongLi/DualBEV}

Keywords

Cite

@article{arxiv.2403.05402,
  title  = {DualBEV: Unifying Dual View Transformation with Probabilistic Correspondences},
  author = {Peidong Li and Wancheng Shen and Qihao Huang and Dixiao Cui},
  journal= {arXiv preprint arXiv:2403.05402},
  year   = {2024}
}

Comments

Accepted by ECCV 2024

R2 v1 2026-06-28T15:13:44.533Z