English
Related papers

Related papers: RayD3D: Distilling Depth Knowledge Along the Ray f…

200 papers

Real-time monocular 3D object detection remains challenging due to severe depth ambiguity, viewpoint shifts, and the high computational cost of 3D reasoning. Existing approaches either rely on LiDAR or geometric priors to compensate for…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Johannes Meier , Jonathan Michel , Oussema Dhaouadi , Yung-Hsu Yang , Christoph Reich , Zuria Bauer , Stefan Roth , Marc Pollefeys , Jacques Kaiser , Daniel Cremers

Multi-view 3D detection based on BEV (bird-eye-view) has recently achieved significant improvements. However, the huge memory consumption of state-of-the-art models makes it hard to deploy them on vehicles, and the non-trivial latency will…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Yifan Zhang , Zhen Dong , Huanrui Yang , Ming Lu , Cheng-Ching Tseng , Yuan Du , Kurt Keutzer , Li Du , Shanghang Zhang

Three-dimensional object detection is one of the key tasks in autonomous driving. To reduce costs in practice, low-cost multi-view cameras for 3D object detection are proposed to replace the expansive LiDAR sensors. However, relying solely…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Zhiwei Lin , Zhe Liu , Zhongyu Xia , Xinhao Wang , Yongtao Wang , Shengxiang Qi , Yang Dong , Nan Dong , Le Zhang , Ce Zhu

In the field of 3D object detection for autonomous driving, LiDAR-Camera (LC) fusion is the top-performing sensor configuration. Still, LiDAR is relatively high cost, which hinders adoption of this technology for consumer automobiles.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-29 Lingjun Zhao , Jingyu Song , Katherine A. Skinner

Recent advances in 3D object detection (3DOD) have obtained remarkably strong results for LiDAR-based models. In contrast, surround-view 3DOD models based on multiple camera images underperform due to the necessary view transformation of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Marvin Klingner , Shubhankar Borse , Varun Ravi Kumar , Behnaz Rezaei , Venkatraman Narayanan , Senthil Yogamani , Fatih Porikli

Accurate estimation of wheat spike volume is important for yield component analysis and stress resilience assessment, yet field-based measurement remains challenging. Active 3D sensing methods such as Light Detection and Ranging (LiDAR) or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Olivia Zumsteg , Jannis Widmer , Yann Bourdé , Norbert Kirchgessner , Andreas Hund , Lukas Roth , Paraskevi Nousi

Visual bird's eye view (BEV) perception, due to its excellent perceptual capabilities, is progressively replacing costly LiDAR-based perception systems, especially in the realm of urban intelligent driving. However, this type of perception…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Lei He , Qiaoyi Wang , Honglin Sun , Qing Xu , Bolin Gao , Shengbo Eben Li , Jianqiang Wang , Keqiang Li

3D Lane detection plays an important role in autonomous driving. Recent advances primarily build Birds-Eye-View (BEV) feature from front-view (FV) images to perceive 3D information of Lane more effectively. However, constructing accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Yehao Liu , Xiaosu Xu , Zijian Wang , Yiqing Yao

High-performance Radar-Camera 3D object detection can be achieved by leveraging knowledge distillation without using LiDAR at inference time. However, existing distillation methods typically transfer modality-specific features directly to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Shashank Mishra , Karan Patil , Didier Stricker , Jason Rambach

On-board 3D object detection in autonomous vehicles often relies on geometry information captured by LiDAR devices. Albeit image features are typically preferred for detection, numerous approaches take only spatial data as input. Exploiting…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Alejandro Barrera , Carlos Guindel , Jorge Beltrán , Fernando García

Recently, radar-camera fusion algorithms have gained significant attention as radar sensors provide geometric information that complements the limitations of cameras. However, most existing radar-camera depth estimation algorithms focus…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Huawei Sun , Nastassia Vysotskaya , Tobias Sukianto , Hao Feng , Julius Ott , Xiangyuan Peng , Lorenzo Servadei , Robert Wille

The Bird-Eye-View (BEV) is one of the most widely-used scene representations for visual perception in Autonomous Vehicles (AVs) due to its well suited compatibility to downstream tasks. For the enhanced safety of AVs, modeling perception…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Asen Nachkov , Martin Danelljan , Danda Pani Paudel , Luc Van Gool

3D object detection from LiDAR data for autonomous driving has been making remarkable strides in recent years. Among the state-of-the-art methodologies, encoding point clouds into a bird's eye view (BEV) has been demonstrated to be both…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Yantao Lu , Xuetao Hao , Yilan Li , Weiheng Chai , Shiqi Sun , Senem Velipasalar

Multi-modal 3D object detection with bird's eye view (BEV) has achieved desired advances on benchmarks. Nonetheless, the accuracy may drop significantly in the real world due to data corruption such as sensor configurations for LiDAR and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Rui Ding , Zhaonian Kuang , Yuzhe Ji , Meng Yang , Xinhu Zheng , Gang Hua

Striking a balance between precision and efficiency presents a prominent challenge in the bird's-eye-view (BEV) 3D object detection. Although previous camera-based BEV methods achieved remarkable performance by incorporating long-term…

Computer Vision and Pattern Recognition · Computer Science 2024-01-09 Haowen Zheng , Dong Cao , Jintao Xu , Rui Ai , Weihao Gu , Yang Yang , Yanyan Liang

3D object detection is a fundamental and challenging task for 3D scene understanding, and the monocular-based methods can serve as an economical alternative to the stereo-based or LiDAR-based methods. However, accurately detecting objects…

Computer Vision and Pattern Recognition · Computer Science 2022-01-27 Zhiyu Chong , Xinzhu Ma , Hong Zhang , Yuxin Yue , Haojie Li , Zhihui Wang , Wanli Ouyang

Online high-definition (HD) map construction is an important and challenging task in autonomous driving. Recently, there has been a growing interest in cost-effective multi-view camera-based methods without relying on other sensors like…

Computer Vision and Pattern Recognition · Computer Science 2024-07-17 Xiaoshuai Hao , Ruikai Li , Hui Zhang , Dingzhe Li , Rong Yin , Sangil Jung , Seung-In Park , ByungIn Yoo , Haimei Zhao , Jing Zhang

Integrating LiDAR and Camera information into Bird's-Eye-View (BEV) has become an essential topic for 3D object detection in autonomous driving. Existing methods mostly adopt an independent dual-branch framework to generate LiDAR and camera…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Hongxiang Cai , Zeyuan Zhang , Zhenyu Zhou , Ziyin Li , Wenbo Ding , Jiuhua Zhao

More and more research works fuse the LiDAR and camera information to improve the 3D object detection of the autonomous driving system. Recently, a simple yet effective fusion framework has achieved an excellent detection performance,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Yun Zhao , Zhan Gong , Peiru Zheng , Hong Zhu , Shaohua Wu

Detecting objects in 3D space using multiple cameras, known as Multi-Camera 3D Object Detection (MC3D-Det), has gained prominence with the advent of bird's-eye view (BEV) approaches. However, these methods often struggle when faced with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hao Lu , Yunpeng Zhang , Qing Lian , Dalong Du , Yingcong Chen