English
Related papers

Related papers: Multi-Modal Multi-Task (3MT) Road Segmentation

200 papers

Fusing LiDAR and camera information is essential for achieving accurate and reliable 3D object detection in autonomous driving systems. This is challenging due to the difficulty of combining multi-granularity geometric and semantic features…

Computer Vision and Pattern Recognition · Computer Science 2023-03-06 Yang Jiao , Zequn Jie , Shaoxiang Chen , Jingjing Chen , Lin Ma , Yu-Gang Jiang

Real-time semantic segmentation of LiDAR data is crucial for autonomously driving vehicles, which are usually equipped with an embedded platform and have limited computational resources. Approaches that operate directly on the point cloud…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Shijie Li , Xieyuanli Chen , Yun Liu , Dengxin Dai , Cyrill Stachniss , Juergen Gall

We present a robust and precise localization system that achieves centimeter-level localization accuracy in disparate city scenes. Our system adaptively uses information from complementary sensors such as GNSS, LiDAR, and IMU to achieve…

Computer Vision and Pattern Recognition · Computer Science 2020-03-09 Guowei Wan , Xiaolong Yang , Renlan Cai , Hao Li , Hao Wang , Shiyu Song

Autonomous vehicles need to have a semantic understanding of the three-dimensional world around them in order to reason about their environment. State of the art methods use deep neural networks to predict semantic classes for each point in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-27 Larissa T. Triess , David Peter , Christoph B. Rist , J. Marius Zöllner

Integrating multiple LiDAR sensors can significantly enhance a robot's perception of the environment, enabling it to capture adequate measurements for simultaneous localization and mapping (SLAM). Indeed, solid-state LiDARs can bring in…

Robotics · Computer Science 2023-03-07 Li Qingqing , Yu Xianjia , Jorge Peña Queralta , Tomi Westerlund

With the rapid proliferation of autonomous driving, there has been a heightened focus on the research of lidar-based 3D semantic segmentation and object detection methodologies, aiming to ensure the safety of traffic participants. In recent…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Jiahua Xu , Si Zuo , Chenfeng Wei , Wei Zhou

Robust semantic perception for autonomous vehicles relies on effectively combining multiple sensors with complementary strengths and weaknesses. State-of-the-art sensor fusion approaches to semantic perception often treat sensor data…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Tim Broedermannn , Christos Sakaridis , Luigi Piccinelli , Wim Abbeloos , Luc Van Gool

Identifying moving objects is a crucial capability for autonomous navigation, consistent map generation, and future trajectory prediction of objects. In this paper, we propose a novel network that addresses the challenge of segmenting…

Computer Vision and Pattern Recognition · Computer Science 2023-03-08 Neng Wang , Chenghao Shi , Ruibin Guo , Huimin Lu , Zhiqiang Zheng , Xieyuanli Chen

Object detection and segmentation are two core modules of an autonomous vehicle perception system. They should have high efficiency and low latency while reducing computational complexity. Currently, the most commonly used algorithms are…

Computer Vision and Pattern Recognition · Computer Science 2023-11-14 Maciej Baczmanski , Robert Synoczek , Mateusz Wasala , Tomasz Kryjak

Recent success of semantic segmentation approaches on demanding road driving datasets has spurred interest in many related application fields. Many of these applications involve real-time prediction on mobile platforms such as cars, drones…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Marin Oršić , Ivan Krešo , Petra Bevandić , Siniša Šegvić

Multi-object tracking (MOT) with camera-LiDAR fusion demands accurate results of object detection, affinity computation and data association in real time. This paper presents an efficient multi-modal MOT framework with online joint…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Kemiao Huang , Qi Hao

Road surface classification (RSC) is a key enabler for environment-aware predictive maintenance systems. However, existing RSC techniques often fail to generalize beyond narrow operational conditions due to limited sensing modalities and…

In recent studies, numerous previous works emphasize the importance of semantic segmentation of LiDAR data as a critical component to the development of driver-assistance systems and autonomous vehicles. However, many state-of-the-art…

At the heart of all automated driving systems is the ability to sense the surroundings, e.g., through semantic segmentation of LiDAR sequences, which experienced a remarkable progress due to the release of large datasets such as…

Computer Vision and Pattern Recognition · Computer Science 2022-01-21 Kunyu Peng , Juncong Fei , Kailun Yang , Alina Roitberg , Jiaming Zhang , Frank Bieder , Philipp Heidenreich , Christoph Stiller , Rainer Stiefelhagen

Infrastructure-based sensing and real-time trajectory generation show promise for improving safety in high-risk roadway segments such as work zones, yet practical deployments are hindered by perspective distortion, complex geometry,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Suhala Rabab Saba , Sakib Khan , Minhaj Uddin Ahmad , Jiahe Cao , Mizanur Rahman , Li Zhao , Nathan Huynh , Eren Erman Ozguven

In this paper, a novel multi-modal intelligent vehicular channel model is proposed by scatterer recognition from light detection and ranging (LiDAR) point clouds via Synesthesia of Machines (SoM). The proposed model can support the design…

Signal Processing · Electrical Eng. & Systems 2024-10-10 Ziwei Huang , Lu Bai , Zengrui Han , Xiang Cheng

LiDAR and camera are two modalities available for 3D semantic segmentation in autonomous driving. The popular LiDAR-only methods severely suffer from inferior segmentation on small and distant objects due to insufficient laser points, while…

Computer Vision and Pattern Recognition · Computer Science 2023-03-16 Jiale Li , Hang Dai , Hao Han , Yong Ding

We propose a novel multi-task learning system that combines appearance and motion cues for a better semantic reasoning of the environment. A unified architecture for joint vehicle detection and motion segmentation is introduced. In this…

Computer Vision and Pattern Recognition · Computer Science 2018-10-19 Mennatullah Siam , Heba Mahgoub , Mohamed Zahran , Senthil Yogamani , Martin Jagersand , Ahmad El-Sallab

High-definition (HD) map construction methods are crucial for providing precise and comprehensive static environmental information, which is essential for autonomous driving systems. While Camera-LiDAR fusion techniques have shown promising…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Xiaoshuai Hao , Yuting Zhao , Yuheng Ji , Luanyuan Dai , Peng Hao , Dingzhe Li , Shuai Cheng , Rong Yin

LiDAR point clouds have become the most common data source in autonomous driving. However, due to the sparsity of point clouds, accurate and reliable detection cannot be achieved in specific scenarios. Because of their complementarity with…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Leichao Cui , Xiuxian Li , Min Meng , Xiaoyu Mo