English
Related papers

Related papers: Co-Fix3D: Enhancing 3D Object Detection with Colla…

200 papers

Camera-LiDAR fusion is widely used in autonomous driving to enable accurate 3D object detection. However, bird's-eye view (BEV) fusion detectors can degrade significantly under domain shift and sensor failures, limiting reliability in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Trung Tien Dong , Dev Thakkar , Arman Sargolzaei , Xiaomin Lin

Collaborative perception plays a crucial role in enhancing environmental understanding by expanding the perceptual range and improving robustness against sensor failures, which primarily involves collaborative 3D detection and tracking…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Xunjie He , Christina Dao Wen Lee , Meiling Wang , Chengran Yuan , Zefan Huang , Yufeng Yue , Marcelo H. Ang

State-of-the-art LiDAR-camera 3D object detectors usually focus on feature fusion. However, they neglect the factor of depth while designing the fusion strategy. In this work, we are the first to observe that different modalities play…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Mingqian Ji , Jian Yang , Shanshan Zhang

3D object detection is an essential perception task in autonomous driving to understand the environments. The Bird's-Eye-View (BEV) representations have significantly improved the performance of 3D detectors with camera inputs on popular…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Zijian Zhu , Yichi Zhang , Hai Chen , Yinpeng Dong , Shu Zhao , Wenbo Ding , Jiachen Zhong , Shibao Zheng

Perceiving the surrounding environment is a fundamental task in autonomous driving. To obtain highly accurate perception results, modern autonomous driving systems typically employ multi-modal sensors to collect comprehensive environmental…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Zhiwei Lin , Zhe Liu , Yongtao Wang , Le Zhang , Ce Zhu

3D visual perception tasks based on multi-camera images are essential for autonomous driving systems. Latest work in this field performs 3D object detection by leveraging multi-view images as an input and iteratively enhancing object…

Computer Vision and Pattern Recognition · Computer Science 2023-07-31 Jongwoo Park , Apoorv Singh , Varun Bankiti

We present an end-to-end method for object detection and trajectory prediction utilizing multi-view representations of LiDAR returns and camera images. In this work, we recognize the strengths and weaknesses of different view…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Sudeep Fadadu , Shreyash Pandey , Darshan Hegde , Yi Shi , Fang-Chieh Chou , Nemanja Djuric , Carlos Vallespi-Gonzalez

This paper aims at high-accuracy 3D object detection in autonomous driving scenario. We propose Multi-View 3D networks (MV3D), a sensory-fusion framework that takes both LIDAR point cloud and RGB images as input and predicts oriented 3D…

Computer Vision and Pattern Recognition · Computer Science 2017-06-23 Xiaozhi Chen , Huimin Ma , Ji Wan , Bo Li , Tian Xia

Safe autonomous agents and mobile robots need fast real time 3D perception, especially for vulnerable road users (VRUs) such as pedestrians. We introduce a new bird's eye view (BEV) encoding, which maps the full 3D LiDAR point cloud into a…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Mohammad Khoshkdahan , Alexey Vinel

In autonomous driving, 3D object detection is essential for accurately identifying and tracking objects. Despite the continuous development of various technologies for this task, a significant drawback is observed in most of them-they…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Hsin-Cheng Lu , Chung-Yi Lin , Winston H. Hsu

Accurately localizing 3D objects like pedestrians, cyclists, and other vehicles is essential in Autonomous Driving. To ensure high detection performance, Autonomous Vehicles complement RGB cameras with LiDAR sensors, but effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Carlo Sgaravatti , Riccardo Pieroni , Matteo Corno , Sergio M. Savaresi , Luca Magri , Giacomo Boracchi

Point cloud data from 3D LiDAR sensors are one of the most crucial sensor modalities for versatile safety-critical applications such as self-driving vehicles. Since the annotations of point cloud data is an expensive and time-consuming…

Computer Vision and Pattern Recognition · Computer Science 2019-05-23 Khaled Saleh , Ahmed Abobakr , Mohammed Attia , Julie Iskander , Darius Nahavandi , Mohammed Hossny

Recent camera-based 3D object detection methods have introduced sequential frames to improve the detection performance hoping that multiple frames would mitigate the large depth estimation error. Despite improved detection performance,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Sanmin Kim , Youngseok Kim , In-Jae Lee , Dongsuk Kum

3D object detection from LiDAR data for autonomous driving has been making remarkable strides in recent years. Among the state-of-the-art methodologies, encoding point clouds into a bird's eye view (BEV) has been demonstrated to be both…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Yantao Lu , Xuetao Hao , Yilan Li , Weiheng Chai , Shiqi Sun , Senem Velipasalar

Multi-sensor fusion is essential for an accurate and reliable autonomous driving system. Recent approaches are based on point-level fusion: augmenting the LiDAR point cloud with camera features. However, the camera-to-LiDAR projection…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhijian Liu , Haotian Tang , Alexander Amini , Xinyu Yang , Huizi Mao , Daniela Rus , Song Han

Multi-camera 3D object detection (MC3D) has attracted increasing attention with the growing deployment of multi-sensor physical agents, such as robots and autonomous vehicles. However, MC3D models still struggle to generalize to unseen…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Zhaonian Kuang , Rui Ding , Haotian Wang , Xinhu Zheng , Meng Yang , Gang Hua

Cooperative perception allows connected vehicles and roadside infrastructure to share sensor observations, creating a fused scene representation beyond the capability of any single platform. However, most cooperative 3D object detectors use…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Blessing Agyei Kyem , Joshua Kofi Asamoah , Armstrong Aboah

Estimating and understanding the surroundings of the vehicle precisely forms the basic and crucial step for the autonomous vehicle. The perception system plays a significant role in providing an accurate interpretation of a vehicle's…

Computer Vision and Pattern Recognition · Computer Science 2022-03-16 Sreenivasa Hikkal Venugopala

3D object detection serves as the core basis of the perception tasks in autonomous driving. Recent years have seen the rapid progress of multi-modal fusion strategies for more robust and accurate 3D object detection. However, current…

Computer Vision and Pattern Recognition · Computer Science 2023-10-12 Bingqi Shen , Shuwei Dai , Yuyin Chen , Rong Xiong , Yue Wang , Yanmei Jiao

Integrating LiDAR and camera information in the bird's eye view (BEV) representation has demonstrated its effectiveness in 3D object detection. However, because of the fundamental disparity in geometric accuracy between these sensors,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Guowen Zhang , Chenhang He , Liyi Chen , Lei Zhang