English
Related papers

Related papers: Look Before You Fuse: 2D-Guided Cross-Modal Alignm…

200 papers

3D object detection is crucial for autonomous driving, leveraging both LiDAR point clouds for precise depth information and camera images for rich semantic information. Therefore, the multi-modal methods that combine both modalities offer…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Kaidong Li , Tianxiao Zhang , Kuan-Chuan Peng , Guanghui Wang

Accurate 3D object detection is essential for automated vehicles to navigate safely in complex real-world environments. Bird's Eye View (BEV) representations, which project multi-sensor data into a top-down spatial format, have emerged as a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Sanjay Kumar , Tim Brophy , Eoin Martino Grua , Ganesh Sistu , Valentina Donzella , Ciaran Eising

Existing LiDAR-based 3D object detectors typically rely on manually annotated labels for training to achieve good performance. However, obtaining high-quality 3D labels is time-consuming and labor-intensive. To address this issue, recent…

Computer Vision and Pattern Recognition · Computer Science 2025-08-29 Mingqian Ji , Jian Yang , Shanshan Zhang

Developing reliable UAV navigation systems requires robust air-to-air object detectors capable of distinguishing between objects seen during training and previously unseen objects. While many methods address closed-set detection and achieve…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Spyridon Loukovitis , Vasileios Karampinis , Athanasios Voulodimos

In this work, a deep learning approach has been developed to carry out road detection by fusing LIDAR point clouds and camera images. An unstructured and sparse point cloud is first projected onto the camera image plane and then upsampled…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Luca Caltagirone , Mauro Bellone , Lennart Svensson , Mattias Wahde

The success of re-localisation has crucial implications for the practical deployment of robots operating within a prior map or relative to one another in real-world scenarios. Using single-modality, place recognition and localisation can be…

Robotics · Computer Science 2023-07-27 Milad Ramezani , Ethan Griffiths , Maryam Haghighat , Alex Pitt , Peyman Moghadam

Unsupervised domain adaptation for LiDAR-based 3D object detection (3D UDA) based on the teacher-student architecture with pseudo labels has achieved notable improvements in recent years. Although it is quite popular to collect point clouds…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Shenao Zhao , Pengpeng Liang , Zhoufan Yang

Multi-agent systems, e.g., automobiles and UAVs (Unmanned Ariel Vehicles), rely on the precision of onboard sensors to accurately perceive their environment, which in turn depends on the precision of onboard sensors and reliable in-field…

Signal Processing · Electrical Eng. & Systems 2026-04-23 Bichi Zhang , Holger Caesar , Raj Thilak Rajan

LiDAR-camera fusion is one of the core processes for the perception system of current automated driving systems. The typical sensor fusion process includes a list of coordinate transformation operations following system calibration.…

Robotics · Computer Science 2023-11-09 Dan Shen , Zhengming Zhang , Renran Tian , Yaobin Chen , Rini Sherony

Multi-sensor object detection is an active research topic in automated driving, but the robustness of such detection models against missing sensor input (modality missing), e.g., due to a sudden sensor failure, is a critical problem which…

Computer Vision and Pattern Recognition · Computer Science 2024-05-09 Shiming Wang , Holger Caesar , Liangliang Nan , Julian F. P. Kooij

Pre-training is crucial in 3D-related fields such as autonomous driving where point cloud annotation is costly and challenging. Many recent studies on point cloud pre-training, however, have overlooked the issue of incompleteness, where…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Hao Yang , Haiyang Wang , Di Dai , Liwei Wang

Multi-sensor fusion (MSF) is widely used in autonomous vehicles (AVs) for perception, particularly for 3D object detection with camera and LiDAR sensors. The purpose of fusion is to capitalize on the advantages of each modality while…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Zhiyuan Cheng , Hongjun Choi , James Liang , Shiwei Feng , Guanhong Tao , Dongfang Liu , Michael Zuzak , Xiangyu Zhang

LiDAR sensors are widely used for 3D object detection in various mobile robotics applications. LiDAR sensors continuously generate point cloud data in real-time. Conventional 3D object detectors detect objects using a set of points acquired…

Computer Vision and Pattern Recognition · Computer Science 2022-10-04 Junhyung Lee , Junho Koh , Youngwoo Lee , Jun Won Choi

Precise LiDAR-camera calibration is crucial for integrating these two sensors into robotic systems to achieve robust perception. In applications like autonomous driving, online targetless calibration enables a prompt sensor misalignment…

Robotics · Computer Science 2025-08-12 Shu Han , Xubo Zhu , Ji Wu , Ximeng Cai , Wen Yang , Huai Yu , Gui-Song Xia

Multi-modal 3D object detection with bird's eye view (BEV) has achieved desired advances on benchmarks. Nonetheless, the accuracy may drop significantly in the real world due to data corruption such as sensor configurations for LiDAR and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Rui Ding , Zhaonian Kuang , Yuzhe Ji , Meng Yang , Xinhu Zheng , Gang Hua

Detecting objects in 3D space using multiple cameras, known as Multi-Camera 3D Object Detection (MC3D-Det), has gained prominence with the advent of bird's-eye view (BEV) approaches. However, these methods often struggle when faced with…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Hao Lu , Yunpeng Zhang , Qing Lian , Dalong Du , Yingcong Chen

3D object detection is fundamental for safe and robust intelligent transportation systems. Current multi-modal 3D object detectors often rely on complex architectures and training strategies to achieve higher detection accuracy. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-24 Xiangxuan Ren , Zhongdao Wang , Pin Tang , Guoqing Wang , Jilai Zheng , Chao Ma

There has been significant progress made in the field of autonomous vehicles. Object detection and tracking are the primary tasks for any autonomous vehicle. The task of object detection in autonomous vehicles relies on a variety of sensors…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Gaurav Raut , Advait Patole

Accurate 3D lane estimation is crucial for ensuring safety in autonomous driving. However, prevailing monocular techniques suffer from depth loss and lighting variations, hampering accurate 3D lane detection. In contrast, LiDAR points offer…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Yueru Luo , Shuguang Cui , Zhen Li

3D visual grounding allows an embodied agent to understand visual information in real-world 3D environments based on human instructions, which is crucial for embodied intelligence. Existing 3D visual grounding methods typically rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-05 Fan Li , Zanyi Wang , Zeyi Huang , Guang Dai , Jingdong Wang , Mengmeng Wang