English
Related papers

Related papers: MOS: Model Synergy for Test-Time Adaptation on LiD…

200 papers

Lidars and cameras are critical sensors that provide complementary information for 3D detection in autonomous driving. While prevalent multi-modal methods simply decorate raw lidar point clouds with camera features and feed them directly to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-17 Yingwei Li , Adams Wei Yu , Tianjian Meng , Ben Caine , Jiquan Ngiam , Daiyi Peng , Junyang Shen , Bo Wu , Yifeng Lu , Denny Zhou , Quoc V. Le , Alan Yuille , Mingxing Tan

Classical autonomous driving systems connect perception and prediction modules via hand-crafted bounding-box interfaces, limiting information flow and propagating errors to downstream tasks. Recent research aims to develop end-to-end models…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Mohammed Amine Bencheikh Lehocine , Julian Schmidt , Frank Moosmann , Dikshant Gupta , Fabian Flohr

Automated vehicles require an accurate perception of their surroundings for safe and efficient driving. Lidar-based object detection is a widely used method for environment perception, but its performance is significantly affected by…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Raphael van Kempen , Tim Rehbronn , Abin Jose , Johannes Stegmaier , Bastian Lampe , Timo Woopen , Lutz Eckstein

Moving object segmentation (MOS) using a 3D light detection and ranging (LiDAR) sensor is crucial for scene understanding and identification of moving objects. Despite the availability of various types of 3D LiDAR sensors in the market, MOS…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Hyungtae Lim , Seoyeon Jang , Benedikt Mersch , Jens Behley , Hyun Myung , Cyrill Stachniss

We propose DeepFusion, a modular multi-modal architecture to fuse lidars, cameras and radars in different combinations for 3D object detection. Specialized feature extractors take advantage of each modality and can be exchanged easily,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Florian Drews , Di Feng , Florian Faion , Lars Rosenbaum , Michael Ulrich , Claudius Gläser

Lidar-based object detectors are critical parts of the 3D perception pipeline in autonomous navigation systems such as self-driving cars. However, they are known to be sensitive to adverse weather conditions such as rain, snow and fog due…

Computer Vision and Pattern Recognition · Computer Science 2021-07-16 Velat Kilic , Deepti Hegde , Vishwanath Sindagi , A. Brinton Cooper , Mark A. Foster , Vishal M. Patel

3D object detectors are fundamental components of perception systems in autonomous vehicles. While these detectors achieve remarkable performance on standard autonomous driving benchmarks, they often struggle to generalize across different…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Bartłomiej Olber , Jakub Winter , Paweł Wawrzyński , Andrii Gamalii , Daniel Górniak , Marcin Łojek , Robert Nowak , Krystian Radlak

We introduce Multi-Source 3D (MS3D), a new self-training pipeline for unsupervised domain adaptation in 3D object detection. Despite the remarkable accuracy of 3D detectors, they often overfit to specific domain biases, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-10 Darren Tsai , Julie Stephany Berrio , Mao Shan , Eduardo Nebot , Stewart Worrall

LiDAR-based 3D object detection is an indispensable task in advanced autonomous driving systems. Though impressive detection results have been achieved by superior 3D detectors, they suffer from significant performance degeneration when…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Yan Wang , Junbo Yin , Wei Li , Pascal Frossard , Ruigang Yang , Jianbing Shen

LiDAR sensors can be used to obtain a wide range of measurement signals other than a simple 3D point cloud, and those signals can be leveraged to improve perception tasks like 3D object detection. A single laser pulse can be partially…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Yunze Man , Xinshuo Weng , Prasanna Kumar Sivakuma , Matthew O'Toole , Kris Kitani

3D object detection is an important task in autonomous driving to perceive the surroundings. Despite the excellent performance, the existing 3D detectors lack the robustness to real-world corruptions caused by adverse weathers, sensor…

Computer Vision and Pattern Recognition · Computer Science 2023-03-21 Yinpeng Dong , Caixin Kang , Jinlai Zhang , Zijian Zhu , Yikai Wang , Xiao Yang , Hang Su , Xingxing Wei , Jun Zhu

Data fusion algorithms that employ LiDAR measurements, such as Visual-LiDAR, LiDAR-Inertial, or Multiple LiDAR Odometry and simultaneous localization and mapping (SLAM) rely on precise timestamping schemes that grant synchronicity to data…

Robotics · Computer Science 2022-09-14 Marsel Faizullin , Anastasiia Kornilova , Gonzalo Ferrer

Autonomous driving has achieved rapid development over the last few decades, including the machine perception as an important issue of it. Although object detection based on conventional cameras has achieved remarkable results in 2D/3D,…

Robotics · Computer Science 2021-07-20 Rui Yang , Zhi Yan , Tao Yang , Yassine Ruichek

In this work, we propose a new approach that combines data from multiple sensors for reliable obstacle avoidance. The sensors include two depth cameras and a LiDAR arranged so that they can capture the whole 3D area in front of the robot…

Robotics · Computer Science 2022-12-27 Thanh Nguyen Canh , Truong Son Nguyen , Cong Hoang Quach , Xiem HoangVan , Manh Duong Phung

We present a new way to detect 3D objects from multimodal inputs, leveraging both LiDAR and RGB cameras in a hybrid late-cascade scheme, that combines an RGB detection network and a 3D LiDAR detector. We exploit late fusion principles to…

Computer Vision and Pattern Recognition · Computer Science 2026-01-15 Carlo Sgaravatti , Roberto Basla , Riccardo Pieroni , Matteo Corno , Sergio M. Savaresi , Luca Magri , Giacomo Boracchi

Human detection and tracking is an essential task for service robots, where the combined use of multiple sensors has potential advantages that are yet to be exploited. In this paper, we introduce a framework allowing a robot to learn a new…

Robotics · Computer Science 2018-08-01 Zhi Yan , Li Sun , Tom Duckett , Nicola Bellotto

Lidar has become an essential sensor for autonomous driving as it provides reliable depth estimation. Lidar is also the primary sensor used in building 3D maps which can be used even in the case of low-cost systems which do not use Lidar.…

Computer Vision and Pattern Recognition · Computer Science 2019-07-08 B Ravi Kiran , Luis Roldão , Benat Irastorza , Renzo Verastegui , Sebastian Suss , Senthil Yogamani , Victor Talpaert , Alexandre Lepoutre , Guillaume Trehard

It is a well-known fact that the performance of deep learning models deteriorates when they encounter a distribution shift at test time. Test-time adaptation (TTA) algorithms have been proposed to adapt the model online while inferring test…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Jayeon Yoo , Dongkwan Lee , Inseop Chung , Donghyun Kim , Nojun Kwak

This article presents an innovative study in exploring, evaluating, and implementing deep learning architectures for the calibration of multi-modal sensor systems. The focus behind this is to leverage the use of sensor fusion to achieve…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Venkat Karramreddy , Liam Mitchell

Existing LiDAR-Camera fusion methods have achieved strong results in 3D object detection. To address the sparsity of point clouds, previous approaches typically construct spatial pseudo point clouds via depth completion as auxiliary input…

Computer Vision and Pattern Recognition · Computer Science 2025-08-28 Jijun Wang , Yan Wu , Yujian Mo , Junqiao Zhao , Jun Yan , Yinghao Hu