English
Related papers

Related papers: Revisiting Multi-modal 3D Semantic Segmentation in…

200 papers

The autonomous car must recognize the driving environment quickly for safe driving. As the Light Detection And Range (LiDAR) sensor is widely used in the autonomous car, fast semantic segmentation of LiDAR point cloud, which is the…

Computer Vision and Pattern Recognition · Computer Science 2022-02-22 Jaehyun Park , Chansoo Kim , Kichun Jo

Accurate automatic medical image segmentation relies on high-quality, dense annotations, which are costly and time-consuming. Weakly supervised learning provides a more efficient alternative by leveraging sparse and coarse annotations…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Dongdong Meng , Sheng Li , Hao Wu , Suqing Tian , Wenjun Ma , Guoping Wang , Xueqing Yan

Multi-modal systems enhance performance in autonomous driving but face inefficiencies due to indiscriminate processing within each modality. Additionally, the independent feature learning of each modality lacks interaction, which results in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-24 Guoliang You , Xiaomeng Chu , Yifan Duan , Xingchen Li , Sha Zhang , Jianmin Ji , Yanyong Zhang

Scene understanding based on LiDAR point cloud is an essential task for autonomous cars to drive safely, which often employs spherical projection to map 3D point cloud into multi-channel 2D images for semantic segmentation. Most existing…

Computer Vision and Pattern Recognition · Computer Science 2021-07-19 Aoran Xiao , Xiaofei Yang , Shijian Lu , Dayan Guan , Jiaxing Huang

There are two critical sensors for 3D perception in autonomous driving, the camera and the LiDAR. The camera provides rich semantic information such as color, texture, and the LiDAR reflects the 3D shape and locations of surrounding…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Kaicheng Yu , Tang Tao , Hongwei Xie , Zhiwei Lin , Zhongwei Wu , Zhongyu Xia , Tingting Liang , Haiyang Sun , Jiong Deng , Dayang Hao , Yongtao Wang , Xiaodan Liang , Bing Wang

LiDAR panoptic segmentation facilitates an autonomous vehicle to comprehensively understand the surrounding objects and scenes and is required to run in real time. The recent proposal-free methods accelerate the algorithm, but their…

Computer Vision and Pattern Recognition · Computer Science 2023-11-17 Xiaoyan Li , Gang Zhang , Boyue Wang , Yongli Hu , Baocai Yin

Road segmentation is a fundamental perception task for autonomous driving and intelligent robotic systems, requiring both high accuracy and real-time inference, especially for deployment on resource-constrained edge devices. Existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Daojie Peng , Bingtao Wang , Fulong Ma , Liang Zhang , Jun Ma

Exploiting multiple modalities for semantic scene parsing has been shown to improve accuracy over the singlemodality scenario. However multimodal datasets often suffer from problems such as data misalignment and label inconsistencies, where…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Sarah Taghavi Namin , Mohammad Najafi , Mathieu Salzmann , Lars Petersson

Multimodal information processing has become increasingly important for enhancing image classification performance. However, the intricate and implicit dependencies across different modalities often hinder conventional methods from…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yang Qiao , Xiaoyu Zhong , Xiaofeng Gu , Zhiguo Yu

Accurately localizing 3D objects like pedestrians, cyclists, and other vehicles is essential in Autonomous Driving. To ensure high detection performance, Autonomous Vehicles complement RGB cameras with LiDAR sensors, but effectively…

Computer Vision and Pattern Recognition · Computer Science 2026-01-16 Carlo Sgaravatti , Riccardo Pieroni , Matteo Corno , Sergio M. Savaresi , Luca Magri , Giacomo Boracchi

Within a perception framework for autonomous mobile and robotic systems, semantic analysis of 3D point clouds typically generated by LiDARs is key to numerous applications, such as object detection and recognition, and scene reconstruction.…

Robotics · Computer Science 2024-10-14 Samir Abou Haidar , Alexandre Chariot , Mehdi Darouich , Cyril Joly , Jean-Emmanuel Deschaud

Mobile robots and autonomous vehicles rely on multi-modal sensor setups to perceive and understand their surroundings. Aside from cameras, LiDAR sensors represent a central component of state-of-the-art perception systems. In addition to…

Computer Vision and Pattern Recognition · Computer Science 2018-04-27 Florian Piewak , Peter Pinggera , Manuel Schäfer , David Peter , Beate Schwarz , Nick Schneider , David Pfeiffer , Markus Enzweiler , Marius Zöllner

In this work, a deep learning approach has been developed to carry out road detection by fusing LIDAR point clouds and camera images. An unstructured and sparse point cloud is first projected onto the camera image plane and then upsampled…

Computer Vision and Pattern Recognition · Computer Science 2018-09-24 Luca Caltagirone , Mauro Bellone , Lennart Svensson , Mattias Wahde

4D LiDAR semantic segmentation, also referred to as multi-scan semantic segmentation, plays a crucial role in enhancing the environmental understanding capabilities of autonomous vehicles or robots. It classifies the semantic category of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Neng Wang , Ruibin Guo , Chenghao Shi , Ziyue Wang , Hui Zhang , Huimin Lu , Zhiqiang Zheng , Xieyuanli Chen

Robust road segmentation is a key challenge in self-driving research. Though many image-based methods have been studied and high performances in dataset evaluations have been reported, developing robust and reliable road segmentation is…

Computer Vision and Pattern Recognition · Computer Science 2019-05-29 Huafeng Liu , Yazhou Yao , Zeren Sun , Xiangrui Li , Ke Jia , Zhenmin Tang

Efficient data utilization is crucial for advancing 3D scene understanding in autonomous driving, where reliance on heavily human-annotated LiDAR point clouds challenges fully supervised methods. Addressing this, our study extends into…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Lingdong Kong , Xiang Xu , Jiawei Ren , Wenwei Zhang , Liang Pan , Kai Chen , Wei Tsang Ooi , Ziwei Liu

As an essential procedure of data fusion, LiDAR-camera calibration is critical for autonomous vehicles and robot navigation. Most calibration methods rely on hand-crafted features and require significant amounts of extracted features or…

Robotics · Computer Science 2021-04-27 Xudong Lv , Boya Wang , Ziwen Dou , Dong Ye , Shuo Wang

A unified and versatile LiDAR segmentation model with strong robustness and generalizability is desirable for safe autonomous driving perception. This work presents M3Net, a one-of-a-kind framework for fulfilling multi-task, multi-dataset,…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Youquan Liu , Lingdong Kong , Xiaoyang Wu , Runnan Chen , Xin Li , Liang Pan , Ziwei Liu , Yuexin Ma

High-resolution LiDAR data plays a critical role in 3D semantic segmentation for autonomous driving, but the high cost of advanced sensors limits large-scale deployment. In contrast, low-cost sensors such as 16-channel LiDAR produce sparse…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Alexandros Gkillas , Nikos Piperigkos , Aris S. Lalos

This paper presents Camera-LiDAR Fusion Transformer (CLFT) models for traffic object segmentation, which leverage the fusion of camera and LiDAR data using vision transformers. Building on the methodology of visual transformers that exploit…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Toomas Tahves , Junyi Gu , Mauro Bellone , Raivo Sell