English
Related papers

Related papers: CrossFusion: Interleaving Cross-modal Complementat…

200 papers

Reliable autonomous driving systems require accurate detection of traffic participants. To this end, multi-modal fusion has emerged as an effective strategy. In particular, 4D radar and LiDAR fusion methods based on multi-frame radar point…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Xiangyuan Peng , Yu Wang , Miao Tang , Bierzynski Kay , Lorenzo Servadei , Robert Wille

Promising complementarity exists between the texture features of color images and the geometric information of LiDAR point clouds. However, there still present many challenges for efficient and robust feature fusion in the field of 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-09-16 Chaokang Jiang , Guangming Wang , Jinxing Wu , Yanzi Miao , Hesheng Wang

In recent years, the field of autonomous driving has witnessed remarkable advancements, driven by the integration of a multitude of sensors, including cameras and LiDAR systems, in different prototypes. However, with the proliferation of…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Irene Cortés , Jorge Beltrán , Arturo de la Escalera , Fernando García

LiDAR-based 3D object detection presents significant challenges due to the inherent sparsity of LiDAR points. A common solution involves long-term temporal LiDAR data to densify the inputs. However, efficiently leveraging spatial-temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Chaoqun Wang , Xiaobin Hong , Wenzhong Li , Ruimao Zhang

Cameras and LiDARs are both important sensors for autonomous driving, playing critical roles in 3D object detection. Camera-LiDAR Fusion has been a prevalent solution for robust and accurate driving perception. In contrast to the vast…

Robotics · Computer Science 2024-03-05 Ye Li , Hanjiang Hu , Zuxin Liu , Xiaohao Xu , Xiaonan Huang , Ding Zhao

LiDAR and cameras are two complementary sensors for 3D perception in autonomous driving. LiDAR point clouds have accurate spatial and geometry information, while RGB images provide textural and color data for context reasoning. To exploit…

Computer Vision and Pattern Recognition · Computer Science 2022-09-27 Rui Wan , Shuangjie Xu , Wei Wu , Xiaoyi Zou , Tongyi Cao

Object detection in camera images, using deep learning has been proven successfully in recent years. Rising detection rates and computationally efficient network structures are pushing this technique towards application in production…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Felix Nobis , Maximilian Geisslinger , Markus Weber , Johannes Betz , Markus Lienkamp

Accurate 3D object detection is vital for automated driving. While lidar sensors are well suited for this task, they are expensive and have limitations in adverse weather conditions. 3+1D imaging radar sensors offer a cost-effective, robust…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Patrick Palmer , Martin Krüger , Stefan Schütte , Richard Altendorfer , Ganesh Adam , Torsten Bertram

The fusion of multimodal sensor streams, such as camera, lidar, and radar measurements, plays a critical role in object detection for autonomous vehicles, which base their decision making on these inputs. While existing methods exploit…

Computer Vision and Pattern Recognition · Computer Science 2020-07-01 Mario Bijelic , Tobias Gruber , Fahim Mannan , Florian Kraus , Werner Ritter , Klaus Dietmayer , Felix Heide

LiDAR and 4D radar are widely used in autonomous driving and robotics. While LiDAR provides rich spatial information, 4D radar offers velocity measurement and remains robust under adverse conditions. As a result, increasing studies have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Xiangyuan Peng , Miao Tang , Huawei Sun , Bierzynski Kay , Lorenzo Servadei , Robert Wille

A significant challenge in object detection is accurate identification of an object's position in image space, whereas one algorithm with one set of parameters is usually not enough, and the fusion of multiple algorithms and/or parameters…

Computer Vision and Pattern Recognition · Computer Science 2018-03-20 Pan Wei , John E. Ball , Derek T. Anderson

Multi-modal 3D object detection has exhibited significant progress in recent years. However, most existing methods can hardly scale to long-range scenarios due to their reliance on dense 3D features, which substantially escalate…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Yiheng Li , Hongyang Li , Zehao Huang , Hong Chang , Naiyan Wang

Multi-object tracking (MOT) with camera-LiDAR fusion demands accurate results of object detection, affinity computation and data association in real time. This paper presents an efficient multi-modal MOT framework with online joint…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Kemiao Huang , Qi Hao

3D object detection is crucial for autonomous driving, leveraging both LiDAR point clouds for precise depth information and camera images for rich semantic information. Therefore, the multi-modal methods that combine both modalities offer…

Computer Vision and Pattern Recognition · Computer Science 2025-04-07 Kaidong Li , Tianxiao Zhang , Kuan-Chuan Peng , Guanghui Wang

Vehicle object detection benefits from both LiDAR and camera data, with LiDAR offering superior performance in many scenarios. Fusion of these modalities further enhances accuracy, but existing methods often introduce complexity or…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Vanshika Vats , Marzia Binta Nizam , James Davis

Estimating dense 2D optical flow and 3D scene flow is essential for dynamic scene understanding. Recent work combines images, LiDAR, and event data to jointly predict 2D and 3D motion, yet most approaches operate in separate heterogeneous…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Ruishan Guo , Ciyu Ruan , Haoyang Wang , Zihang Gong , Jingao Xu , Xinlei Chen

Point-pixel registration between LiDAR point clouds and camera images is a fundamental yet challenging task in autonomous driving and robotic perception. A key difficulty lies in the modality gap between unstructured point clouds and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yu Han , Zhiwei Huang , Yanting Zhang , Fangjun Ding , Shen Cai , Rui Fan

Although fusing multiple sensor modalities can enhance object detection performance, existing fusion approaches often overlook subtle variations in environmental conditions and sensor inputs. As a result, they struggle to adaptively weight…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Aditya Taparia , Noel Ngu , Mario Leiva , Joshua Shay Kricheli , John Corcoran , Nathaniel D. Bastian , Gerardo Simari , Paulo Shakarian , Ransalu Senanayake

Point cloud segmentation is a fundamental task in 3D scene understanding. Its progress is constrained by the high cost and time required for dense 3D annotations, making labeled samples difficult to obtain. Beyond annotation scarcity,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Thenukan Pathmanathan , Kanchan Keisham , Thangarajah Akilan

LiDAR datasets for autonomous driving exhibit biases in properties such as point cloud density, range, and object dimensions. As a result, object detection networks trained and evaluated in different environments often experience…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Deepti Hegde , Suhas Lohit , Kuan-Chuan Peng , Michael J. Jones , Vishal M. Patel