English
Related papers

Related papers: MSC-Bench: Benchmarking and Analyzing Multi-Sensor…

200 papers

Road surface classification (RSC) is a key enabler for environment-aware predictive maintenance systems. However, existing RSC techniques often fail to generalize beyond narrow operational conditions due to limited sensing modalities and…

Autonomous vehicles may make wrong decisions due to inaccurate detection and recognition. Therefore, an intelligent vehicle can combine its own data with that of other vehicles to enhance perceptive ability, and thus improve detection…

Computer Vision and Pattern Recognition · Computer Science 2019-05-15 Qi Chen , Sihai Tang , Qing Yang , Song Fu

Autonomous driving technology has drawn a lot of attention due to its fast development and extremely high commercial values. The recent technological leap of autonomous driving can be primarily attributed to the progress in the environment…

Computer Vision and Pattern Recognition · Computer Science 2022-04-13 Jindi Zhang

How should representations from complementary sensors be integrated for autonomous driving? Geometry-based sensor fusion has shown great promise for perception tasks such as object detection and motion forecasting. However, for the actual…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Aditya Prakash , Kashyap Chitta , Andreas Geiger

Wear and tear detection in fleet and shared vehicle systems is a critical challenge, particularly in rental and car-sharing services, where minor damage, such as dents, scratches, and underbody impacts, often goes unnoticed or is detected…

Machine Learning · Computer Science 2025-10-21 Sara Khan , Mehmed Yüksel , Frank Kirchner

3D object detection is a key perception component in autonomous driving. Most recent approaches are based on Lidar sensors only or fused with cameras. Maps (e.g., High Definition Maps), a basic infrastructure for intelligent vehicles,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-11 Jin Fang , Dingfu Zhou , Xibin Song , Liangjun Zhang

Perception systems of autonomous vehicles are susceptible to occlusion, especially when examined from a vehicle-centric perspective. Such occlusion can lead to overlooked object detections, e.g., larger vehicles such as trucks or buses may…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Xiaofei Zhang , Yining Li , Jinping Wang , Xiangyi Qin , Ying Shen , Zhengping Fan , Xiaojun Tan

An automated vehicle operating in an urban environment must be able to perceive and recognise object/obstacles in a three-dimensional world while navigating in a constantly changing environment. In order to plan and execute accurate…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Julie Stephany Berrio , Mao Shan , Stewart Worrall , Eduardo Nebot

LiDAR-camera fusion enhances 3D panoptic segmentation by leveraging camera images to complement sparse LiDAR scans, but it also introduces a critical failure mode. Under adverse conditions, degradation or failure of the camera sensor can…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Rohit Mohan , Florian Drews , Yakov Miron , Daniele Cattaneo , Abhinav Valada

Fusing the camera and LiDAR information has become a de-facto standard for 3D object detection tasks. Current methods rely on point clouds from the LiDAR sensor as queries to leverage the feature from the image space. However, people…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Tingting Liang , Hongwei Xie , Kaicheng Yu , Zhongyu Xia , Zhiwei Lin , Yongtao Wang , Tao Tang , Bing Wang , Zhi Tang

In this paper, we present a parallel architecture for a sensor fusion detection system that combines a camera and 1D light detection and ranging (lidar) sensor for object detection. The system contains two object detection methods, one…

Computer Vision and Pattern Recognition · Computer Science 2022-01-25 I-Hsi Kao , Ya-Zhu Yian , Jian-An Su , Yi-Horng Lai , Jau-Woei Perng , Tung-Li Hsieh , Yi-Shueh Tsai , Min-Shiu Hsieh

Multi-sensor frameworks provide opportunities for ensemble learning and sensor fusion to make use of redundancy and supplemental information, helpful in real-world safety applications such as continuous driver state monitoring which…

Machine Learning · Computer Science 2023-10-02 Ross Greer , Mohan Trivedi

LiDAR and camera fusion techniques are promising for achieving 3D object detection in autonomous driving. Most multi-modal 3D object detection frameworks integrate semantic knowledge from 2D images into 3D LiDAR point clouds to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shaoqing Xu , Fang Li , Ziying Song , Jin Fang , Sifen Wang , Zhi-Xin Yang

In this paper, a multi-modal 360$^{\circ}$ framework for 3D object detection and tracking for autonomous vehicles is presented. The process is divided into four main stages. First, images are fed into a CNN network to obtain instance…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Jorge Beltrán , Carlos Guindel , Irene Cortés , Alejandro Barrera , Armando Astudillo , Jesús Urdiales , Mario Álvarez , Farid Bekka , Vicente Milanés , Fernando García

In this paper, we propose a novel approach to address the problem of camera and radar sensor fusion for 3D object detection in autonomous vehicle perception systems. Our approach builds on recent advances in deep learning and leverages the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Daniel Dworak , Mateusz Komorkiewicz , Paweł Skruch , Jerzy Baranowski

Robustness is a critical requirement for deploying autonomous driving systems in the real world. Existing robustness benchmarks for autonomous driving have made important progress in studying the effects of image-level corruptions, such as…

Lidar-based sensing drives current autonomous vehicles. Despite rapid progress, current Lidar sensors still lag two decades behind traditional color cameras in terms of resolution and cost. For autonomous driving, this means that large…

Computer Vision and Pattern Recognition · Computer Science 2021-11-15 Tianwei Yin , Xingyi Zhou , Philipp Krähenbühl

Achieving level-5 driving automation in autonomous vehicles necessitates a robust semantic visual perception system capable of parsing data from different sensors across diverse conditions. However, existing semantic perception datasets…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Tim Brödermann , David Bruggemann , Christos Sakaridis , Kevin Ta , Odysseas Liagouris , Jason Corkill , Luc Van Gool

Multi-sensor fusion is essential for autonomous vehicle localization, as it is capable of integrating data from various sources for enhanced accuracy and reliability. The accuracy of the integrated location and orientation depends on the…

Robotics · Computer Science 2025-03-10 Changhong Lin , Jiarong Lin , Zhiqiang Sui , XiaoZhi Qu , Rui Wang , Kehua Sheng , Bo Zhang

Accurate 3D semantic occupancy perception is essential for autonomous driving in complex environments with diverse and irregular objects. While vision-centric methods suffer from geometric inaccuracies, LiDAR-based approaches often lack…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Zhiqiang Wei , Lianqing Zheng , Jianan Liu , Tao Huang , Qing-Long Han , Wenwen Zhang , Fengdeng Zhang