English
Related papers

Related papers: Multimodal 3D Object Detection on Unseen Domains

200 papers

Accurate and robust LiDAR 3D object detection is essential for comprehensive scene understanding in autonomous driving. Despite its importance, LiDAR detection performance is limited by inherent constraints of point cloud data, particularly…

Computer Vision and Pattern Recognition · Computer Science 2024-09-09 Rui Yu , Runkai Zhao , Cong Nie , Heng Wang , HuaiCheng Yan , Meng Wang

Deep learning has achieved notable success in 3D object detection with the advent of large-scale point cloud datasets. However, severe performance degradation in the past trained classes, i.e., catastrophic forgetting, still remains a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-06 Ziyuan Zhao , Mingxi Xu , Peisheng Qian , Ramanpreet Singh Pahwa , Richard Chang

The rise of autonomous vehicles has significantly increased the demand for robust 3D object detection systems. While cameras and LiDAR sensors each offer unique advantages--cameras provide rich texture information and LiDAR offers precise…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Zitian Wang , Zehao Huang , Yulu Gao , Naiyan Wang , Si Liu

The challenge of 3D multi-object tracking is achieving robustness in real-world applications, for example under adverse conditions and maintaining consistency as distance increases. To overcome these challenges, sensor fusion approaches…

Computer Vision and Pattern Recognition · Computer Science 2026-04-22 Bingxue Xu , Emil Hedemalm , Ajinkya Khoche , Patric Jensfelt

Zero-shot 3D object classification is crucial for real-world applications like autonomous driving, however it is often hindered by a significant domain gap between the synthetic data used for training and the sparse, noisy LiDAR scans…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Ajinkya Khoche , Gergő László Nagy , Maciej Wozniak , Thomas Gustafsson , Patric Jensfelt

We present a new way to detect 3D objects from multimodal inputs, leveraging both LiDAR and RGB cameras in a hybrid late-cascade scheme, that combines an RGB detection network and a 3D LiDAR detector. We exploit late fusion principles to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Carlo Sgaravatti , Roberto Basla , Riccardo Pieroni , Matteo Corno , Sergio M. Savaresi , Luca Magri , Giacomo Boracchi

Multi-sensor fusion is crucial for accurate 3D object detection in autonomous driving, with cameras and LiDAR being the most commonly used sensors. However, existing methods perform sensor fusion in a single view by projecting features from…

Computer Vision and Pattern Recognition · Computer Science 2024-12-11 Rohit Mohan , Daniele Cattaneo , Florian Drews , Abhinav Valada

In this paper, we study the problem of unsupervised object detection from 3D point clouds in self-driving scenes. We present a simple yet effective method that exploits (i) point clustering in near-range areas where the point clouds are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-06 Lunjun Zhang , Anqi Joyce Yang , Yuwen Xiong , Sergio Casas , Bin Yang , Mengye Ren , Raquel Urtasun

Effective tracking of surrounding traffic participants allows for an accurate state estimation as a necessary ingredient for prediction of future behavior and therefore adequate planning of the ego vehicle trajectory. One approach for…

Robotics · Computer Science 2024-06-04 Patrick Palmer , Martin Krüger , Richard Altendorfer , Torsten Bertram

Object detection from 3D point clouds remains a challenging task, though recent studies pushed the envelope with the deep learning techniques. Owing to the severe spatial occlusion and inherent variance of point density with the distance to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Liang Du , Xiaoqing Ye , Xiao Tan , Jianfeng Feng , Zhenbo Xu , Errui Ding , Shilei Wen

Conventional camera-based 3D object detectors in autonomous driving are limited to recognizing a predefined set of objects, which poses a safety risk when encountering novel or unseen objects in real-world scenarios. To address this…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Zhuolin He , Xinrun Li , Jiacheng Tang , Shoumeng Qiu , Wenfu Wang , Xiangyang Xue , Jian Pu

Multi-modal fusion has emerged as a promising paradigm for accurate 3D object detection. However, performance degrades substantially when deployed in target domains different from training. In this work, focusing on dual-branch…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Yuchen Wu , Kun Wang , Yining Pan , Na Zhao

Object detection is a critical problem for the safe interaction between autonomous vehicles and road users. Deep-learning methodologies allowed the development of object detection approaches with better performance. However, there is still…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Andrés Gómez , Thomas Genevois , Jerome Lussereau , Christian Laugier

LiDAR and camera, as two different sensors, supply geometric (point clouds) and semantic (RGB images) information of 3D scenes. However, it is still challenging for existing methods to fuse data from the two cross sensors, making them…

Computer Vision and Pattern Recognition · Computer Science 2022-11-18 Yiyang Shen , Rongwei Yu , Peng Wu , Haoran Xie , Lina Gong , Jing Qin , Mingqiang Wei

3D object detection networks tend to be biased towards the data they are trained on. Evaluation on datasets captured in different locations, conditions or sensors than that of the training (source) data results in a drop in model…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Deepti Hegde , Vishal M. Patel

The current trend in computer vision is to utilize one universal model to address all various tasks. Achieving such a universal model inevitably requires incorporating multi-domain data for joint training to learn across multiple problem…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Zhenyu Wang , Yali Li , Hengshuang Zhao , Shengjin Wang

In this paper, we propose the LiDAR Distillation to bridge the domain gap induced by different LiDAR beams for 3D object detection. In many real-world applications, the LiDAR points used by mass-produced robots and vehicles usually have…

Computer Vision and Pattern Recognition · Computer Science 2022-08-16 Yi Wei , Zibu Wei , Yongming Rao , Jiaxin Li , Jie Zhou , Jiwen Lu

LiDAR-based 3D object detectors have been largely utilized in various applications, including autonomous vehicles or mobile robots. However, LiDAR-based detectors often fail to adapt well to target domains with different sensor…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Jiyun Jang , Mincheol Chang , Jongwon Park , Jinkyu Kim

As a critical task in autonomous driving perception systems, 3D object detection is used to identify and track key objects, such as vehicles and pedestrians. However, detecting distant, small, or occluded objects (hard instances) remains a…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Feiyang Jia , Caiyan Jia , Ailin Liu , Shaoqing Xu , Qiming Xia , Lin Liu , Lei Yang , Yan Gong , Ziying Song

Perception for automated driving is largely based on onboard environmental sensors, such as cameras and radar, which are cost-effective but limited by line-of-sight and field-of-view constraints. These inherent limitations may cause onboard…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Lukas Ostendorf , Lennart Reiher , Onn Haran , Lutz Eckstein