English
Related papers

Related papers: Towards Foundation Models for 3D Scene Understandi…

200 papers

Point clouds provide a compact and efficient representation of 3D shapes. While deep neural networks have achieved impressive results on point cloud learning tasks, they require massive amounts of manually labeled data, which can be costly…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Omid Poursaeed , Tianxing Jiang , Han Qiao , Nayun Xu , Vladimir G. Kim

Recognizing 3D part instances from a 3D point cloud is crucial for 3D structure and scene understanding. Several learning-based approaches use semantic segmentation and instance center prediction as training tasks and fail to further…

Computer Vision and Pattern Recognition · Computer Science 2022-08-10 Chunyu Sun , Xin Tong , Yang Liu

Instance segmentation is an important task for scene understanding. Compared to the fully-developed 2D, 3D instance segmentation for point clouds have much room to improve. In this paper, we present PointGroup, a new end-to-end bottom-up…

Computer Vision and Pattern Recognition · Computer Science 2020-04-06 Li Jiang , Hengshuang Zhao , Shaoshuai Shi , Shu Liu , Chi-Wing Fu , Jiaya Jia

The current state-of-the-art methods in 3D instance segmentation typically involve a clustering step, despite the tendency towards heuristics, greedy algorithms, and a lack of robustness to the changes in data statistics. In contrast, we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Tong He , Wei Yin , Chunhua Shen , Anton van den Hengel

3D instance segmentation is crucial for obtaining an understanding of a point cloud scene. This paper presents a novel neural network architecture for performing instance segmentation on 3D point clouds. We propose to jointly learn…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Remco Royen , Leon Denis , Adrian Munteanu

We propose an approach to instance segmentation from 3D point clouds based on dynamic convolution. This enables it to adapt, at inference, to varying feature and object scales. Doing so avoids some pitfalls of bottom up approaches,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Tong He , Chunhua Shen , Anton van den Hengel

Reconstructing dynamic driving scenes from dashcam videos has attracted increasing attention due to its significance in autonomous driving and scene understanding. While recent advances have made impressive progress, most methods still…

Computer Vision and Pattern Recognition · Computer Science 2025-10-30 Hongyuan Liu , Haochen Yu , Bochao Zou , Jianfei Jiang , Qiankun Liu , Jiansheng Chen , Huimin Ma

Instance segmentation of point clouds is a crucial task in 3D field with numerous applications that involve localizing and segmenting objects in a scene. However, achieving satisfactory results requires a large number of manual annotations,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zhikai Zhang , Jian Ding , Li Jiang , Dengxin Dai , Gui-Song Xia

Exploring contextual information in the local region is important for shape understanding and analysis. Existing studies often employ hand-crafted or explicit ways to encode contextual information of local regions. However, it is hard to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Xinhai Liu , Zhizhong Han , Yu-Shen Liu , Matthias Zwicker

Learning without supervision how to predict 3D scene flows from point clouds is essential to many perception systems. We propose a novel learning framework for this task which improves the necessary regularization. Relying on the assumption…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Patrik Vacek , David Hurych , Karel Zimmermann , Patrick Perez , Tomas Svoboda

Contemporary point cloud segmentation approaches largely rely on richly annotated 3D training data. However, it is both time-consuming and challenging to obtain consistently accurate annotations for such 3D scene data. Moreover, there is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-13 Jiaxu Liu , Zhengdi Yu , Toby P. Breckon , Hubert P. H. Shum

Traditionally, algorithms that learn to segment object instances in 2D images have heavily relied on large amounts of human-annotated data. Only recently, novel approaches have emerged tackling this problem in an unsupervised fashion.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Leon Sick , Dominik Engel , Sebastian Hartwig , Pedro Hermosilla , Timo Ropinski

Manual annotation of large-scale point cloud dataset for varying tasks such as 3D object classification, segmentation and detection is often laborious owing to the irregular structure of point clouds. Self-supervised learning, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Mohamed Afham , Isuru Dissanayake , Dinithi Dissanayake , Amaya Dharmasiri , Kanchana Thilakarathna , Ranga Rodrigo

In this paper, we present a novel, scalable approach for constructing open set, instance-level 3D scene representations, advancing open world understanding of 3D environments. Existing methods require pre-constructed 3D scenes and face…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Rafay Mohiuddin , Sai Manoj Prakhya , Fiona Collins , Ziyuan Liu , André Borrmann

As a popular geometric representation, point clouds have attracted much attention in 3D vision, leading to many applications in autonomous driving and robotics. One important yet unsolved issue for learning on point cloud is that point…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yuefan Shen , Yanchao Yang , Mi Yan , He Wang , Youyi Zheng , Leonidas Guibas

Unsupervised point cloud segmentation is critical for embodied artificial intelligence and autonomous driving, as it mitigates the prohibitive cost of dense point-level annotations required by fully supervised methods. While integrating 2D…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yixiao Song , Qingyong Li , Wen Wang , Zhicheng Yan

Compared with the visual grounding on 2D images, the natural-language-guided 3D object localization on point clouds is more challenging. In this paper, we propose a new model, named InstanceRefer, to achieve a superior 3D visual grounding…

Computer Vision and Pattern Recognition · Computer Science 2021-07-30 Zhihao Yuan , Xu Yan , Yinghong Liao , Ruimao Zhang , Sheng Wang , Zhen Li , Shuguang Cui

Most existing methods realize 3D instance segmentation by extending those models used for 3D object detection or 3D semantic segmentation. However, these non-straightforward methods suffer from two drawbacks: 1) Imprecise bounding boxes or…

Computer Vision and Pattern Recognition · Computer Science 2022-11-30 Jiahao Sun , Chunmei Qing , Junpeng Tan , Xiangmin Xu

In this study, we present an analysis of model-based ensemble learning for 3D point-cloud object classification and detection. An ensemble of multiple model instances is known to outperform a single model instance, but there is little study…

Computer Vision and Pattern Recognition · Computer Science 2019-05-24 Daniel Koguciuk , Łukasz Chechliński , Tarek El-Gaaly

The rapid progress in 3D scene understanding has come with growing demand for data; however, collecting and annotating 3D scenes (e.g. point clouds) are notoriously hard. For example, the number of scenes (e.g. indoor rooms) that can be…

Computer Vision and Pattern Recognition · Computer Science 2021-06-29 Ji Hou , Benjamin Graham , Matthias Nießner , Saining Xie