English
Related papers

Related papers: YOdar: Uncertainty-based Sensor Fusion for Vehicle…

200 papers

In the recent literature, on the one hand, many 3D multi-object tracking (MOT) works have focused on tracking accuracy and neglected computation speed, commonly by designing rather complex cost functions and feature extractors. On the other…

Computer Vision and Pattern Recognition · Computer Science 2022-08-29 Xiyang Wang , Chunyun Fu , Zhankun Li , Ying Lai , Jiawei He

In this work, we introduce a novel Deep Learning-based method to perceive the environment of a vehicle based on radar scans while accounting for uncertainties in its predictions. The environment of the host vehicle is segmented into equally…

Machine Learning · Computer Science 2023-06-06 Marco Braun , Moritz Luszek , Jan Siegemund , Kevin Kollek , Anton Kummert

Accurate and robust 3D object detection is essential for autonomous driving, where fusing data from sensors like LiDAR and camera enhances detection accuracy. However, sensor malfunctions such as corruption or disconnection can degrade…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Reza Sadeghian , Niloofar Hooshyaripour , Chris Joslin , WonSook Lee

Camera-radar fusion offers a robust and cost-effective alternative to LiDAR-based autonomous driving systems by combining complementary sensing capabilities: cameras provide rich semantic cues but unreliable depth, while radar delivers…

For high resolution scene mapping and object recognition, optical technologies such as cameras and LiDAR are the sensors of choice. However, for robust future vehicle autonomy and driver assistance in adverse weather conditions,…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Marcel Sheeny , Andrew Wallace , Sen Wang

To assist human drivers and autonomous vehicles in assessing crash risks, driving scene analysis using dash cameras on vehicles and deep learning algorithms is of paramount importance. Although these technologies are increasingly available,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Muhammad Monjurul Karim , Yu Li , Ruwen Qin , Zhaozheng Yin

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

To accurately estimate locations and velocities of surrounding targets (cars) is crucial for advanced driver assistance systems based on radar sensors. In this paper we derive methods for fusing data from multiple radar sensors in order to…

Signal Processing · Electrical Eng. & Systems 2019-08-08 Bin Zhu , Augusto Ferrante , Johan Karlsson , Mattia Zorzi

Multi-sensor fusion is widely used in the environment perception system of the autonomous vehicle. It solves the interference caused by environmental changes and makes the whole driving system safer and more reliable. In this paper, a novel…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Guanyu Zhang , Beichen Sun , Yuehan Qi , Yang Liu

Sensor fusion has become a popular topic in robotics. However, conventional fusion methods encounter many difficulties, such as data representation differences, sensor variations, and extrinsic calibration. For example, the calibration…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Shuyi Zhou , Shuxiang Xie , Ryoichi Ishikawa , Ken Sakurada , Masaki Onishi , Takeshi Oishi

State-of-the-art LiDAR-camera 3D object detectors usually focus on feature fusion. However, they neglect the factor of depth while designing the fusion strategy. In this work, we are the first to observe that different modalities play…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Mingqian Ji , Jian Yang , Shanshan Zhang

More and more research works fuse the LiDAR and camera information to improve the 3D object detection of the autonomous driving system. Recently, a simple yet effective fusion framework has achieved an excellent detection performance,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-11 Yun Zhao , Zhan Gong , Peiru Zheng , Hong Zhu , Shaohua Wu

Predicting the motion of a driver's vehicle is crucial for advanced driving systems, enabling detection of potential risks towards shared control between the driver and automation systems. In this paper, we propose a variational neural…

Robotics · Computer Science 2019-03-07 Xin Huang , Stephen McGill , Brian C. Williams , Luke Fletcher , Guy Rosman

This paper presents novel hybrid architectures that combine grid- and point-based processing to improve the detection performance and orientation estimation of radar-based object detection networks. Purely grid-based detection models…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Michael Ulrich , Sascha Braun , Daniel Köhler , Daniel Niederlöhner , Florian Faion , Claudius Gläser , Holger Blume

We propose a new method for fusing a LIDAR point cloud and camera-captured images in the deep convolutional neural network (CNN). The proposed method constructs a new layer called non-homogeneous pooling layer to transform features between…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Zining Wang , Wei Zhan , Masayoshi Tomizuka

Reliable obstacle detection and classification in rough and unstructured terrain such as agricultural fields or orchards remains a challenging problem. These environments involve large variations in both geometry and appearance, challenging…

Robotics · Computer Science 2019-03-14 Mikkel Kragh , James Underwood

Service mobile robots are often required to avoid dynamic objects while performing their tasks, but they usually have only limited computational resources. To further advance the practical application of service robots in complex dynamic…

Robotics · Computer Science 2026-02-25 Yushen He , Lei Zhao , Tianchen Deng , Zipeng Fang , Weidong Chen

Optical and Synthetic Aperture Radar (SAR) fusion-based object detection has attracted significant research interest in remote sensing, as these modalities provide complementary information for all-weather monitoring. However, practical…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Zhicheng Zhao , Yuancheng Xu , Andong Lu , Chenglong Li , Jin Tang

Autonomous racing has rapidly gained research attention. Traditionally, racing cars rely on 2D LiDAR as their primary visual system. In this work, we explore the integration of an event camera with the existing system to provide enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Zhuyun Zhou , Zongwei Wu , Florian Bolli , Rémi Boutteau , Fan Yang , Radu Timofte , Dominique Ginhac , Tobi Delbruck

Reliable 3D object perception is essential in autonomous driving. Owing to its sensing capabilities in all weather conditions, 4D radar has recently received much attention. However, compared to LiDAR, 4D radar provides much sparser point…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Sheng Yang , Tong Zhan , Shichen Qiao , Jicheng Gong , Qing Yang , Jian Wang , Yanfeng Lu