English
Related papers

Related papers: SegPoint: Segment Any Point Cloud via Large Langua…

200 papers

3D point cloud segmentation is an important function that helps robots understand the layout of their surrounding environment and perform tasks such as grasping objects, avoiding obstacles, and finding landmarks. Current segmentation…

Computer Vision and Pattern Recognition · Computer Science 2021-03-17 Jingdao Chen , Zsolt Kira , Yong K. Cho

Instance segmentation of point clouds is a crucial task in 3D field with numerous applications that involve localizing and segmenting objects in a scene. However, achieving satisfactory results requires a large number of manual annotations,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zhikai Zhang , Jian Ding , Li Jiang , Dengxin Dai , Gui-Song Xia

3D referring segmentation is an emerging and challenging vision-language task that aims to segment the object described by a natural language expression in a point cloud scene. The key challenge behind this task is vision-language feature…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Shuting He , Henghui Ding

The unprecedented advancements in Large Language Models (LLMs) have shown a profound impact on natural language processing but are yet to fully embrace the realm of 3D understanding. This paper introduces PointLLM, a preliminary effort to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Runsen Xu , Xiaolong Wang , Tai Wang , Yilun Chen , Jiangmiao Pang , Dahua Lin

Recent advances in point cloud perception have demonstrated remarkable progress in scene understanding through vision-language alignment leveraging large language models (LLMs). However, existing methods may still encounter challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Zhenhua Ning , Zhuotao Tian , Shaoshuai Shi , Guangming Lu , Daojing He , Wenjie Pei , Li Jiang

Semantic, instance, and panoptic segmentation of 3D point clouds have been addressed using task-specific models of distinct design. Thereby, the similarity of all segmentation tasks and the implicit relationship between them have not been…

Computer Vision and Pattern Recognition · Computer Science 2023-11-27 Maxim Kolodiazhnyi , Anna Vorontsova , Anton Konushin , Danila Rukhovich

3D point cloud semantic segmentation aims to group all points into different semantic categories, which benefits important applications such as point cloud scene reconstruction and understanding. Existing supervised point cloud semantic…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Canyu Zhang , Zhenyao Wu , Xinyi Wu , Ziyu Zhao , Song Wang

In this paper, we propose PASS3D to achieve point-wise semantic segmentation for 3D point cloud. Our framework combines the efficiency of traditional geometric methods with robustness of deep learning methods, consisting of two stages: At…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Xin Kong , Guangyao Zhai , Baoquan Zhong , Yong Liu

This paper presents a new 3D point cloud classification benchmark data set with over four billion manually labelled points, meant as input for data-hungry (deep) learning methods. We also discuss first submissions to the benchmark that use…

Computer Vision and Pattern Recognition · Computer Science 2017-04-13 Timo Hackel , Nikolay Savinov , Lubor Ladicky , Jan D. Wegner , Konrad Schindler , Marc Pollefeys

Referring 3D Segmentation is a visual-language task that segments all points of the specified object from a 3D point cloud described by a sentence of query. Previous works perform a two-stage paradigm, first conducting language-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Xuexun Liu , Xiaoxu Xu , Jinlong Li , Qiudan Zhang , Xu Wang , Nicu Sebe , Lin Ma

The development of 2D foundation models for image segmentation has been significantly advanced by the Segment Anything Model (SAM). However, achieving similar success in 3D models remains a challenge due to issues such as non-unified data…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Yuchen Zhou , Jiayuan Gu , Tung Yen Chiang , Fanbo Xiang , Hao Su

A 3D point cloud describes the real scene precisely and intuitively.To date how to segment diversified elements in such an informative 3D scene is rarely discussed. In this paper, we first introduce a simple and flexible framework to…

Computer Vision and Pattern Recognition · Computer Science 2019-03-01 Xinlong Wang , Shu Liu , Xiaoyong Shen , Chunhua Shen , Jiaya Jia

We propose an interactive approach for 3D instance segmentation, where users can iteratively collaborate with a deep learning model to segment objects in a 3D point cloud directly. Current methods for 3D instance segmentation are generally…

Computer Vision and Pattern Recognition · Computer Science 2023-01-24 Theodora Kontogianni , Ekin Celikkan , Siyu Tang , Konrad Schindler

Deep learning approaches have made tremendous progress in the field of semantic segmentation over the past few years. However, most current approaches operate in the 2D image space. Direct semantic segmentation of unstructured 3D point…

Computer Vision and Pattern Recognition · Computer Science 2019-12-20 Francis Engelmann , Theodora Kontogianni , Alexander Hermans , Bastian Leibe

While massively scaling both data and models have become central in NLP and 2D vision, their benefits for 3D point cloud understanding remain limited. We study the initial step of scaling 3D point cloud understanding under a realistic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xuweiyi Chen , Wentao Zhou , Aruni RoyChowdhury , Zezhou Cheng

With the rise of large-scale models trained on broad data, in-context learning has become a new learning paradigm that has demonstrated significant potential in natural language processing and computer vision tasks. Meanwhile, in-context…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Zhongbin Fang , Xiangtai Li , Xia Li , Joachim M. Buhmann , Chen Change Loy , Mengyuan Liu

This paper investigates indoor point cloud semantic segmentation under scene-level annotation, which is less explored compared to methods relying on sparse point-level labels. In the absence of precise point-level labels, current methods…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Lunhao Duan , Shanshan Zhao , Xingxing Weng , Jing Zhang , Gui-Song Xia

Large Multimodal Models (LMMs) have achieved significant progress by extending large language models. Building on this progress, the latest developments in LMMs demonstrate the ability to generate dense pixel-wise segmentation through the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-23 Li Zhou , Xu Yuan , Zenghui Sun , Zikun Zhou , Jingsong Lan

The current state-of-the-art methods in 3D instance segmentation typically involve a clustering step, despite the tendency towards heuristics, greedy algorithms, and a lack of robustness to the changes in data statistics. In contrast, we…

Computer Vision and Pattern Recognition · Computer Science 2022-07-14 Tong He , Wei Yin , Chunhua Shen , Anton van den Hengel

3D vehicle detection based on point cloud is a challenging task in real-world applications such as autonomous driving. Despite significant progress has been made, we observe two aspects to be further improved. First, the semantic context…

Computer Vision and Pattern Recognition · Computer Science 2020-02-14 Hongwei Yi , Shaoshuai Shi , Mingyu Ding , Jiankai Sun , Kui Xu , Hui Zhou , Zhe Wang , Sheng Li , Guoping Wang