English
Related papers

Related papers: Deep Learning for Image and Point Cloud Fusion in …

200 papers

One of the main paths towards the reduction of traffic accidents is the increase in vehicle safety through driver assistance systems or even systems with a complete level of autonomy. In these types of systems, tasks such as obstacle…

Computer Vision and Pattern Recognition · Computer Science 2023-03-09 Felipe Manfio Barbosa , Fernando Santos Osório

Object detection and tracking are vital and fundamental tasks for autonomous driving, aiming at identifying and locating objects from those predefined categories in a scene. 3D point cloud learning has been attracting more and more…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Yang Peng

This research aims to explore the application of deep learning in autonomous driving computer vision technology and its impact on improving system performance. By using advanced technologies such as convolutional neural networks (CNN),…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jingyu Zhang , Jin Cao , Jinghao Chang , Xinjin Li , Houze Liu , Zhenglin Li

In recent years, the fusion of camera data with LiDAR measurements has emerged as a powerful approach to enhance spatial understanding. This study introduces a novel, hardware-agnostic methodology that generates colourised point clouds from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Pasindu Ranasinghe , Dibyayan Patra , Bikram Banerjee , Simit Raval

Ensuring safe transition of control in automated vehicles requires an accurate and timely assessment of driver readiness. This paper introduces Driver-Net, a novel deep learning framework that fuses multi-camera inputs to estimate driver…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Mahdi Rezaei , Mohsen Azarmi

Multi-sensor fusion plays a critical role in enhancing perception for autonomous driving, overcoming individual sensor limitations, and enabling comprehensive environmental understanding. This paper first formalizes multi-sensor fusion…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Chuheng Wei , Ziye Qin , Ziyan Zhang , Guoyuan Wu , Matthew J. Barth

Designing a controller for autonomous vehicles capable of providing adequate performance in all driving scenarios is challenging due to the highly complex environment and inability to test the system in the wide variety of scenarios which…

Machine Learning · Computer Science 2019-12-24 Sampo Kuutti , Richard Bowden , Yaochu Jin , Phil Barber , Saber Fallah

LiDAR sensors are an integral part of modern autonomous vehicles as they provide an accurate, high-resolution 3D representation of the vehicle's surroundings. However, it is computationally difficult to make use of the ever-increasing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Marc Uecker , Tobias Fleck , Marcel Pflugfelder , J. Marius Zöllner

With the rapid development of intelligent vehicles and Advanced Driving Assistance Systems (ADAS), a mixed level of human driver engagements is involved in the transportation system. Visual guidance for drivers is essential under this…

Computer Vision and Pattern Recognition · Computer Science 2020-07-10 Yongkang Liu , Ziran Wang , Kyungtae Han , Zhenyu Shou , Prashant Tiwari , John H. L. Hansen

The integration of data from diverse sensor modalities (e.g., camera and LiDAR) constitutes a prevalent methodology within the ambit of autonomous driving scenarios. Recent advancements in efficient point cloud transformers have underscored…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Yutao Zhu , Xiaosong Jia , Xinyu Yang , Junchi Yan

Autonomous driving demands accurate perception and safe decision-making. To achieve this, automated vehicles are now equipped with multiple sensors (e.g., camera, Lidar, etc.), enabling them to exploit complementary environmental context by…

Computer Vision and Pattern Recognition · Computer Science 2022-02-24 Xiaoming Zeng , Zhendong Wang , Yang Hu

We propose a new method for fusing a LIDAR point cloud and camera-captured images in the deep convolutional neural network (CNN). The proposed method constructs a new layer called non-homogeneous pooling layer to transform features between…

Computer Vision and Pattern Recognition · Computer Science 2018-02-15 Zining Wang , Wei Zhan , Masayoshi Tomizuka

Object detection in camera images, using deep learning has been proven successfully in recent years. Rising detection rates and computationally efficient network structures are pushing this technique towards application in production…

Computer Vision and Pattern Recognition · Computer Science 2020-05-18 Felix Nobis , Maximilian Geisslinger , Markus Weber , Johannes Betz , Markus Lienkamp

In autonomous driving, perception systems are piv otal as they interpret sensory data to understand the envi ronment, which is essential for decision-making and planning. Ensuring the safety of these perception systems is fundamental for…

Robotics · Computer Science 2024-11-19 Urvishkumar Bharti , Vikram Shahapur

Radars, due to their robustness to adverse weather conditions and ability to measure object motions, have served in autonomous driving and intelligent agents for years. However, Radar-based perception suffers from its unintuitive sensing…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Liu Liu , Shuaifeng Zhi , Zhenhua Du , Li Liu , Xinyu Zhang , Kai Huo , Weidong Jiang

Camera and lidar are important sensor modalities for robotics in general and self-driving cars in particular. The sensors provide complementary information offering an opportunity for tight sensor-fusion. Surprisingly, lidar-only methods…

Computer Vision and Pattern Recognition · Computer Science 2020-05-07 Sourabh Vora , Alex H. Lang , Bassam Helou , Oscar Beijbom

In recent years, point cloud representation has become one of the research hotspots in the field of computer vision, and has been widely used in many fields, such as autonomous driving, virtual reality, robotics, etc. Although deep learning…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Huang Zhang , Changshuo Wang , Shengwei Tian , Baoli Lu , Liping Zhang , Xin Ning , Xiao Bai

It is a crucial step to achieve effective semantic segmentation of lane marking during the construction of the lane level high-precision map. In recent years, many image semantic segmentation methods have been proposed. These methods mainly…

Computer Vision and Pattern Recognition · Computer Science 2020-03-11 Ruochen Yin , Biao Yu , Huapeng Wu , Yutao Song , Runxin Niu

Our study assesses the adversarial robustness of LiDAR-camera fusion models in 3D object detection. We introduce an attack technique that, by simply adding a limited number of physically constrained adversarial points above a car, can make…

Robotics · Computer Science 2024-01-10 Bo Yang , Xiaoyu Ji , Zizhi Jin , Yushi Cheng , Wenyuan Xu

Thanks to the complementary nature of millimeter wave radar and camera, deep learning-based radar-camera 3D object detection methods may reliably produce accurate detections even in low-visibility conditions. This makes them preferable to…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Irfan Tito Kurniawan , Bambang Riyanto Trilaksono