English
Related papers

Related papers: JSIS3D: Joint Semantic-Instance Segmentation of 3D…

200 papers

Temporal semantic scene understanding is critical for self-driving cars or robots operating in dynamic environments. In this paper, we propose 4D panoptic LiDAR segmentation to assign a semantic class and a temporally-consistent instance ID…

Computer Vision and Pattern Recognition · Computer Science 2021-04-08 Mehmet Aygün , Aljoša Ošep , Mark Weber , Maxim Maximov , Cyrill Stachniss , Jens Behley , Laura Leal-Taixé

We introduce a novel superpoint-based transformer architecture for efficient semantic segmentation of large-scale 3D scenes. Our method incorporates a fast algorithm to partition point clouds into a hierarchical superpoint structure, which…

Computer Vision and Pattern Recognition · Computer Science 2023-08-15 Damien Robert , Hugo Raguet , Loic Landrieu

Semantic instance segmentation remains a challenging task. In this work we propose to tackle the problem with a discriminative loss function, operating at the pixel level, that encourages a convolutional network to produce a representation…

Computer Vision and Pattern Recognition · Computer Science 2017-08-10 Bert De Brabandere , Davy Neven , Luc Van Gool

Rapid progress in 3D semantic segmentation is inseparable from the advances of deep network models, which highly rely on large-scale annotated data for training. To address the high cost and challenges of 3D point-level labeling, we present…

Computer Vision and Pattern Recognition · Computer Science 2021-10-18 Li Jiang , Shaoshuai Shi , Zhuotao Tian , Xin Lai , Shu Liu , Chi-Wing Fu , Jiaya Jia

Recently, progress in acquisition equipment such as LiDAR sensors has enabled sensing increasingly spacious outdoor 3D environments. Making sense of such 3D acquisitions requires fine-grained scene understanding, such as constructing…

Computer Vision and Pattern Recognition · Computer Science 2024-08-30 Cedric Perauer , Laurenz Adrian Heidrich , Haifan Zhang , Matthias Nießner , Anastasiia Kornilova , Alexey Artemov

Weakly supervised 3D instance segmentation is essential for 3D scene understanding, especially as the growing scale of data and high annotation costs associated with fully supervised approaches. Existing methods primarily rely on two forms…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Xuexun Liu , Xiaoxu Xu , Qiudan Zhang , Lin Ma , Xu Wang

To autonomously navigate and plan interactions in real-world environments, robots require the ability to robustly perceive and map complex, unstructured surrounding scenes. Besides building an internal representation of the observed scene…

Comprehensive scene understanding is a critical enabler of robot autonomy. Semantic segmentation is one of the key scene understanding tasks which is pivotal for several robotics applications including autonomous driving, domestic service…

Robotics · Computer Science 2024-01-17 Juana Valeria Hurtado , Abhinav Valada

Understanding 3D point cloud models for learning purposes has become an imperative challenge for real-world identification such as autonomous driving systems. A wide variety of solutions using deep learning have been proposed for point…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Farid Ghareh Mohammadi , Cheng Chen , Farzan Shenavarmasouleh , M. Hadi Amini , Beshoy Morkos , Hamid R. Arabnia

This study analyzes semantic segmentation performance across heterogeneously labeled point-cloud datasets relevant to public safety applications, including pre-incident planning systems derived from lidar scans. Using NIST's Point Cloud…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Alexander Nikitas Dimopoulos , Joseph Grasso

Dense 3D visual mapping estimates as many as possible pixel depths, for each image. This results in very dense point clouds that often contain redundant and noisy information, especially for surfaces that are roughly planar, for instance,…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Luca Morreale , Andrea Romanoni , Matteo Matteucci

We propose a novel approach for automatic extraction (instance segmentation) of fibers from low resolution 3D X-ray computed tomography scans of short glass fiber reinforced polymers. We have designed a 3D instance segmentation architecture…

Computer Vision and Pattern Recognition · Computer Science 2019-01-07 Tomasz Konopczyński , Thorben Kröger , Lei Zheng , Jürgen Hesser

Instance segmentation in 3D is a challenging task due to the lack of large-scale annotated datasets. In this paper, we show that this task can be addressed effectively by leveraging instead 2D pre-trained models for instance segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-05 Yash Bhalgat , Iro Laina , João F. Henriques , Andrew Zisserman , Andrea Vedaldi

3D point cloud segmentation has a wide range of applications in areas such as autonomous driving, augmented reality, virtual reality and digital twins. The point cloud data collected in real scenes often contain small objects and categories…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Chade Li , Pengju Zhang , Jiaming Zhang , Yihong Wu

While massively scaling both data and models have become central in NLP and 2D vision, their benefits for 3D point cloud understanding remain limited. We study the initial step of scaling 3D point cloud understanding under a realistic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xuweiyi Chen , Wentao Zhou , Aruni RoyChowdhury , Zezhou Cheng

Semantic segmentation of point clouds usually requires exhausting efforts of human annotations, hence it attracts wide attention to the challenging topic of learning from unlabeled or weaker forms of annotations. In this paper, we take the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-03 Zisheng Chen , Hongbin Xu , Weitao Chen , Zhipeng Zhou , Haihong Xiao , Baigui Sun , Xuansong Xie , Wenxiong Kang

In this article we describe a new convolutional neural network (CNN) to classify 3D point clouds of urban or indoor scenes. Solutions are given to the problems encountered working on scene point clouds, and a network is described that…

Computer Vision and Pattern Recognition · Computer Science 2018-04-11 Xavier Roynard , Jean-Emmanuel Deschaud , François Goulette

In this paper, we present the PS^2-Net -- a locally and globally aware deep learning framework for semantic segmentation on 3D scene-level point clouds. In order to deeply incorporate local structures and global context to support 3D scene…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Na Zhao , Tat-Seng Chua , Gim Hee Lee

This paper introduces a new definition of multiscale neighborhoods in 3D point clouds. This definition, based on spherical neighborhoods and proportional subsampling, allows the computation of features with a consistent geometrical meaning,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Hugues Thomas , Jean-Emmanuel Deschaud , Beatriz Marcotegui , François Goulette , Yann Le Gall

3D instance segmentation is crucial for obtaining an understanding of a point cloud scene. This paper presents a novel neural network architecture for performing instance segmentation on 3D point clouds. We propose to jointly learn…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Remco Royen , Leon Denis , Adrian Munteanu