English
Related papers

Related papers: Road Segmentation with Image-LiDAR Data Fusion

200 papers

For real-time semantic segmentation, how to increase the speed while maintaining high resolution is a problem that has been discussed and solved. Backbone design and fusion design have always been two essential parts of real-time semantic…

Computer Vision and Pattern Recognition · Computer Science 2021-06-21 Tan Sixiang

Balancing cost and performance is crucial when choosing high- versus low-resolution point-cloud roadside sensors. For example, LiDAR delivers dense point cloud, while 4D millimeter-wave radar, though spatially sparser, embeds velocity cues…

Robotics · Computer Science 2025-05-06 Shaozu Ding , Yihong Tang , Marco De Vincenzi , Dajiang Suo

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

This paper introduces a novel deep learning-based multimodal fusion architecture aimed at enhancing the perception capabilities of autonomous navigation robots in complex environments. By utilizing innovative feature extraction modules,…

Machine Learning · Computer Science 2025-04-29 Delun Lai , Yeyubei Zhang , Yunchong Liu , Chaojie Li , Huadong Mo

This study aims to improve the performance and generalization capability of end-to-end autonomous driving with scene understanding leveraging deep learning and multimodal sensor fusion techniques. The designed end-to-end deep neural network…

Robotics · Computer Science 2020-08-04 Zhiyu Huang , Chen Lv , Yang Xing , Jingda Wu

Semantic image segmentation is an essential component of modern autonomous driving systems, as an accurate understanding of the surrounding scene is crucial to navigation and action planning. Current state-of-the-art approaches in semantic…

Computer Vision and Pattern Recognition · Computer Science 2016-12-07 Tobias Pohlen , Alexander Hermans , Markus Mathias , Bastian Leibe

In Transport Mode Detection, a great diversity of methodologies exist according to the choice made on sensors, preprocessing, model used, etc. In this domain, the comparisons between each option are not always complete. Experiments on a…

Machine Learning · Computer Science 2021-07-07 Hugues Moreau , Andréa Vassilev , Liming Chen

This paper presents a novel pothole detection approach based on single-modal semantic segmentation. It first extracts visual features from input images using a convolutional neural network. A channel attention module then reweighs the…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Jiahe Fan , Mohammud J. Bocus , Brett Hosking , Rigen Wu , Yanan Liu , Sergey Vityazev , Rui Fan

LiDAR semantic segmentation plays a crucial role in enabling autonomous driving and robots to understand their surroundings accurately and robustly. A multitude of methods exist within this domain, including point-based, range-image-based,…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Rong Li , ShiJie Li , Xieyuanli Chen , Teli Ma , Juergen Gall , Junwei Liang

Pedestrian detection is a critical problem in computer vision with significant impact on safety in urban autonomous driving. In this work, we explore how semantic segmentation can be used to boost pedestrian detection accuracy while having…

Computer Vision and Pattern Recognition · Computer Science 2017-06-28 Garrick Brazil , Xi Yin , Xiaoming Liu

4D radar has received significant attention in autonomous driving thanks to its robustness under adverse weathers. Due to the sparse points and noisy measurements of the 4D radar, most of the research finish the 3D object detection task by…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Hanzhi Zhong , Zhiyu Xiang , Ruoyu Xu , Jingyun Fu , Peng Xu , Shaohong Wang , Zhihao Yang , Tianyu Pu , Eryun Liu

With the ability of providing direct and accurate enough range measurements, light detection and ranging (LiDAR) is playing an essential role in localization and detection for autonomous vehicles. Since single LiDAR suffers from hardware…

Robotics · Computer Science 2022-01-14 Yusheng Wang , Yidong Lou , Weiwei Song , Huan Yu , Zhiyong Tu

We propose DeepFusion, a modular multi-modal architecture to fuse lidars, cameras and radars in different combinations for 3D object detection. Specialized feature extractors take advantage of each modality and can be exchanged easily,…

Computer Vision and Pattern Recognition · Computer Science 2022-09-28 Florian Drews , Di Feng , Florian Faion , Lars Rosenbaum , Michael Ulrich , Claudius Gläser

In this paper we present a novel radar-camera sensor fusion framework for accurate object detection and distance estimation in autonomous driving scenarios. The proposed architecture uses a middle-fusion approach to fuse the radar point…

Computer Vision and Pattern Recognition · Computer Science 2020-09-18 Ramin Nabati , Hairong Qi

How should we integrate representations from complementary sensors for autonomous driving? Geometry-based fusion has shown promise for perception (e.g. object detection, motion forecasting). However, in the context of end-to-end driving, we…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Kashyap Chitta , Aditya Prakash , Bernhard Jaeger , Zehao Yu , Katrin Renz , Andreas Geiger

Fast and efficient semantic segmentation of large-scale LiDAR point clouds is a fundamental problem in autonomous driving. To achieve this goal, the existing point-based methods mainly choose to adopt Random Sampling strategy to process…

Computer Vision and Pattern Recognition · Computer Science 2024-03-07 XianFeng Han , Huixian Cheng , Hang Jiang , Dehong He , Guoqiang Xiao

LiDAR sensors are an integral part of modern autonomous vehicles as they provide an accurate, high-resolution 3D representation of the vehicle's surroundings. However, it is computationally difficult to make use of the ever-increasing…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Marc Uecker , Tobias Fleck , Marcel Pflugfelder , J. Marius Zöllner

In autonomous driving, 3D object detection based on multi-modal data has become an indispensable approach when facing complex environments around the vehicle. During multi-modal detection, LiDAR and camera are simultaneously applied for…

Computer Vision and Pattern Recognition · Computer Science 2023-01-19 Rui Wan , Tianyun Zhao , Wei Zhao

Large-scale LiDAR-based point cloud semantic segmentation is a critical task in autonomous driving perception. Almost all of the previous state-of-the-art LiDAR semantic segmentation methods are variants of sparse 3D convolution. Although…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Chuanyu Luo , Nuo Cheng , Sikun Ma , Han Li , Xiaohan Li , Shengguang Lei , Pu Li

LiDAR sensors are often considered essential for autonomous driving, but high-resolution sensors remain expensive while affordable low-resolution sensors produce sparse point clouds that miss critical details. LiDAR super-resolution…

Computer Vision and Pattern Recognition · Computer Science 2026-02-19 June Moh Goo , Zichao Zeng , Jan Boehm