English
Related papers

Related papers: Unsupervised Learning of 3D Semantic Keypoints wit…

200 papers

Semantic segmentation of 3D meshes is an important problem for 3D scene understanding. In this paper we revisit the classic multiview representation of 3D meshes and study several techniques that make them effective for 3D semantic…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Abhijit Kundu , Xiaoqi Yin , Alireza Fathi , David Ross , Brian Brewington , Thomas Funkhouser , Caroline Pantofaru

With the rise of large-scale models trained on broad data, in-context learning has become a new learning paradigm that has demonstrated significant potential in natural language processing and computer vision tasks. Meanwhile, in-context…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Zhongbin Fang , Xiangtai Li , Xia Li , Joachim M. Buhmann , Chen Change Loy , Mengyuan Liu

We address the problem of unsupervised semantic segmentation of outdoor LiDAR point clouds in diverse traffic scenarios. The key idea is to leverage the spatiotemporal nature of a dynamic point cloud sequence and introduce drastically…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Xiao Li , Pan He , Aotian Wu , Sanjay Ranka , Anand Rangarajan

Keypoint-based representation has proven advantageous in various visual and robotic tasks. However, the existing 2D and 3D methods for detecting keypoints mainly rely on geometric consistency to achieve spatial alignment, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Chengliang Zhong , Yuhang Zheng , Yupeng Zheng , Hao Zhao , Li Yi , Xiaodong Mu , Ling Wang , Pengfei Li , Guyue Zhou , Chao Yang , Xinliang Zhang , Jian Zhao

Open-world 3D scene understanding is a critical challenge that involves recognizing and distinguishing diverse objects and categories from 3D data, such as point clouds, without relying on manual annotations. Traditional methods struggle…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yuru Wang , Pei Liu , Songtao Wang , Zehan Zhang , Xinyan Lu , Changwei Cai , Hao Li , Fu Liu , Peng Jia , Xianpeng Lang

Online semantic 3D segmentation in company with real-time RGB-D reconstruction poses special challenges such as how to perform 3D convolution directly over the progressively fused 3D geometric data, and how to smartly fuse information from…

Graphics · Computer Science 2022-01-14 Jiazhao Zhang , Chenyang Zhu , Lintao Zheng , Kai Xu

Point cloud semantic segmentation plays an essential role in autonomous driving, providing vital information about drivable surfaces and nearby objects that can aid higher level tasks such as path planning and collision avoidance. While…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Ozan Unal , Luc Van Gool , Dengxin Dai

Semantic scene understanding from point clouds is particularly challenging as the points reflect only a sparse set of the underlying 3D geometry. Previous works often convert point cloud into regular grids (e.g. voxels or bird-eye view…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Yinyu Nie , Ji Hou , Xiaoguang Han , Matthias Nießner

As three-dimensional acquisition technologies like LiDAR cameras advance, the need for efficient transmission of 3D point clouds is becoming increasingly important. In this paper, we present a novel semantic communication (SemCom) approach…

Emerging Technologies · Computer Science 2025-05-13 Shangzhuo Xie , Qianqian Yang , Yuyi Sun , Tianxiao Han , Zhaohui Yang , Zhiguo Shi

Pretraining on large labeled datasets is a prerequisite to achieve good performance in many computer vision tasks like 2D object recognition, video classification etc. However, pretraining is not widely used for 3D recognition tasks where…

Computer Vision and Pattern Recognition · Computer Science 2021-01-08 Zaiwei Zhang , Rohit Girdhar , Armand Joulin , Ishan Misra

Being able to learn dense semantic representations of images without supervision is an important problem in computer vision. However, despite its significance, this problem remains rather unexplored, with a few exceptions that considered…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

While massively scaling both data and models have become central in NLP and 2D vision, their benefits for 3D point cloud understanding remain limited. We study the initial step of scaling 3D point cloud understanding under a realistic…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Xuweiyi Chen , Wentao Zhou , Aruni RoyChowdhury , Zezhou Cheng

Masked autoencoding has achieved great success for self-supervised learning in the image and language domains. However, mask based pretraining has yet to show benefits for point cloud understanding, likely due to standard backbones like…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Haotian Liu , Mu Cai , Yong Jae Lee

Point cloud stands as the most widely adopted format for representing 3D shapes and scenes due to its simplicity and geometric fidelity. However, its inherent unordered and irregular nature, exacerbated by sensor noise and occlusions,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Minhas Kamal , Hiranya Garbha Kumar , Balakrishnan Prabhakaran

Open-vocabulary semantic segmentation enables models to recognize and segment objects from arbitrary natural language descriptions, offering the flexibility to handle novel, fine-grained, or functionally defined categories beyond fixed…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Chongyu Wang , Kunlei Jing , Jihua Zhu , Di Wang

We propose a deep autoencoder with graph topology inference and filtering to achieve compact representations of unorganized 3D point clouds in an unsupervised manner. Many previous works discretize 3D points to voxels and then use…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Siheng Chen , Chaojing Duan , Yaoqing Yang , Duanshun Li , Chen Feng , Dong Tian

We present a novel active learning framework for 3D point cloud semantic segmentation that, for the first time, integrates large language models (LLMs) to construct hierarchical label structures and guide uncertainty-based sample selection.…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Chenxi Li , Nuo Chen , Fengyun Tan , Yantong Chen , Bochun Yuan , Tianrui Li , Chongshou Li

The past few years have witnessed the great success and prevalence of self-supervised representation learning within the language and 2D vision communities. However, such advancements have not been fully migrated to the field of 3D point…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Qijian Zhang , Junhui Hou

3D point cloud analysis has drawn a lot of research attention due to its wide applications. However, collecting massive labelled 3D point cloud data is both time-consuming and labor-intensive. This calls for data-efficient learning methods.…

Computer Vision and Pattern Recognition · Computer Science 2023-01-23 Fayao Liu , Guosheng Lin , Chuan-Sheng Foo , Chaitanya K. Joshi , Jie Lin

Learning dense point-wise semantics from unstructured 3D point clouds with fewer labels, although a realistic problem, has been under-explored in literature. While existing weakly supervised methods can effectively learn semantics with only…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Yan Liu , Qingyong Hu , Yinjie Lei , Kai Xu , Jonathan Li , Yulan Guo