English
Related papers

Related papers: Semantic sensor fusion: from camera to sparse lida…

200 papers

3D semantic segmentation is a fundamental building block for several scene understanding applications such as autonomous driving, robotics and AR/VR. Several state-of-the-art semantic segmentation models suffer from the part…

Computer Vision and Pattern Recognition · Computer Science 2021-11-17 Anirud Thyagharajan , Benjamin Ummenhofer , Prashant Laddha , Om J Omer , Sreenivas Subramoney

Recent advancements in perception for autonomous driving are driven by deep learning. In order to achieve robust and accurate scene understanding, autonomous vehicles are usually equipped with different sensors (e.g. cameras, LiDARs,…

Imaging across both the full transverse spatial and temporal dimensions of a scene with high precision in all three coordinates is key to applications ranging from LIDAR to fluorescence lifetime imaging. However, compromises that sacrifice,…

Image and Video Processing · Electrical Eng. & Systems 2021-01-12 C. Callenberg , A. Lyons , D. den Brok , A. Fatima , A. Turpin , V. Zickus , L. Machesky , J. Whitelaw , D. Faccio , M. B. Hullin

In recent years, the fusion of camera data with LiDAR measurements has emerged as a powerful approach to enhance spatial understanding. This study introduces a novel, hardware-agnostic methodology that generates colourised point clouds from…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Pasindu Ranasinghe , Dibyayan Patra , Bikram Banerjee , Simit Raval

Panoptic segmentation, which combines instance and semantic segmentation, has gained a lot of attention in autonomous vehicles, due to its comprehensive representation of the scene. This task can be applied for cameras and LiDAR sensors,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Fardin Ayar , Ehsan Javanmardi , Manabu Tsukada , Mahdi Javanmardi , Mohammad Rahmati

Reliable and accurate localization and mapping are key components of most autonomous systems. Besides geometric information about the mapped environment, the semantics plays an important role to enable intelligent navigation behaviors. In…

Monocular camera sensors are vital to intelligent vehicle operation and automated driving assistance and are also heavily employed in traffic control infrastructure. Calibrating the monocular camera, though, is time-consuming and often…

Computer Vision and Pattern Recognition · Computer Science 2022-08-09 Alexander Tsaregorodtsev , Johannes Müller , Jan Strohbeck , Martin Herrmann , Michael Buchholz , Vasileios Belagiannis

Place recognition is a challenging task in computer vision, crucial for enabling autonomous vehicles and robots to navigate previously visited environments. While significant progress has been made in learnable multimodal methods that…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Alexander Melekhin , Dmitry Yudin , Ilia Petryashin , Vitaly Bezuglyj

Reliable curb detection is critical for safe autonomous driving in urban contexts. Curb detection and tracking are also useful in vehicle localization and path planning. Past work utilized a 3D LiDAR sensor to determine accurate distance…

Computer Vision and Pattern Recognition · Computer Science 2020-10-14 Iljoo Baek , Tzu-Chieh Tai , Manoj Bhat , Karun Ellango , Tarang Shah , Kamal Fuseini , Ragunathan , Rajkumar

LiDAR and camera fusion techniques are promising for achieving 3D object detection in autonomous driving. Most multi-modal 3D object detection frameworks integrate semantic knowledge from 2D images into 3D LiDAR point clouds to enhance…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Shaoqing Xu , Fang Li , Ziying Song , Jin Fang , Sifen Wang , Zhi-Xin Yang

Lidar sensors are widely used in various applications, ranging from scientific fields over industrial use to integration in consumer products. With an ever growing number of different driver assistance systems, they have been introduced to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Frederik Hasecke , Lukas Hahn , Anton Kummert

In recent years, computer vision has transformed fields such as medical imaging, object recognition, and geospatial analytics. One of the fundamental tasks in computer vision is semantic image segmentation, which is vital for precise object…

Computer Vision and Pattern Recognition · Computer Science 2023-11-09 Dinar Sharafutdinov , Stanislav Kuskov , Saian Protasov , Alexey Voropaev

Computer vision techniques play a central role in the perception stack of autonomous vehicles. Such methods are employed to perceive the vehicle surroundings given sensor data. 3D LiDAR sensors are commonly used to collect sparse 3D point…

Computer Vision and Pattern Recognition · Computer Science 2024-03-21 Lucas Nunes , Rodrigo Marcuzzi , Benedikt Mersch , Jens Behley , Cyrill Stachniss

- Both Lidars and Radars are sensors for obstacle detection. While Lidars are very accurate on obstacles positions and less accurate on their velocities, Radars are more precise on obstacles velocities and less precise on their positions.…

Robotics · Computer Science 2019-07-02 Hatem Hajri , Mohamed-Cherif Rahal

In this work, we present a simple yet effective framework to address the domain translation problem between different sensor modalities with unique data formats. By relying only on the semantics of the scene, our modular generative…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Tiago Cortinhal , Fatih Kurnaz , Eren Aksoy

Semantic Scene Completion (SSC) is pivotal in autonomous driving perception, frequently confronted with the complexities of weather and illumination changes. The long-term strategy involves fusing multi-modal information to bolster the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Yukai Ma , Jianbiao Mei , Xuemeng Yang , Licheng Wen , Weihua Xu , Jiangning Zhang , Botian Shi , Yong Liu , Xingxing Zuo

Intersection scenarios provide the most complex traffic situations in Autonomous Driving and Driving Assistance Systems. Knowing where to stop in advance in an intersection is an essential parameter in controlling the longitudinal velocity…

Computer Vision and Pattern Recognition · Computer Science 2021-05-13 Runsheng Xu , Faezeh Tafazzoli , Li Zhang , Timo Rehfeld , Gunther Krehl , Arunava Seal

In this paper, we present a framework to control a self-driving car by fusing raw information from RGB images and depth maps. A deep neural network architecture is used for mapping the vision and depth information, respectively, to steering…

Machine Learning · Computer Science 2019-02-13 Qadeer Khan , Torsten Schön , Patrick Wenzel

Collaborative perception in automated vehicles leverages the exchange of information between agents, aiming to elevate perception results. Previous camera-based collaborative 3D perception methods typically employ 3D bounding boxes or…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Rui Song , Chenwei Liang , Hu Cao , Zhiran Yan , Walter Zimmer , Markus Gross , Andreas Festag , Alois Knoll

Semantic segmentation of LiDAR point clouds is an important task in autonomous driving. However, training deep models via conventional supervised methods requires large datasets which are costly to label. It is critical to have…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Minghua Liu , Yin Zhou , Charles R. Qi , Boqing Gong , Hao Su , Dragomir Anguelov