English
Related papers

Related papers: Point2Vec for Self-Supervised Representation Learn…

200 papers

The irregularity and permutation invariance of point cloud data pose challenges for effective learning. Conventional methods for addressing this issue involve converting raw point clouds to intermediate representations such as 3D voxel…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Athrva Atul Pandhare

Point cloud is a principal data structure adopted for 3D geometric information encoding. Unlike other conventional visual data, such as images and videos, these irregular points describe the complex shape features of 3D objects, which makes…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Chaoyi Zhang , Yang Song , Lina Yao , Weidong Cai

Object classification using LiDAR 3D point cloud data is critical for modern applications such as autonomous driving. However, labeling point cloud data is labor-intensive as it requires human annotators to visualize and inspect the 3D data…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Ziwei Wang , Reza Arablouei , Jiajun Liu , Paulo Borges , Greg Bishop-Hurley , Nicholas Heaney

Self-supervised representation learning has shown significant improvement in Natural Language Processing and 2D Computer Vision. However, existing methods face difficulties in representing 3D data because of its unordered and uneven…

Computer Vision and Pattern Recognition · Computer Science 2025-12-10 Pengbo Li , Yiding Sun , Haozhe Cheng

Point cloud patterns are hard to learn because of the implicit local geometry features among the orderless points. In recent years, point cloud representation in 2D space has attracted increasing research interest since it exposes the local…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Yecheng Lyu , Xinming Huang , Ziming Zhang

Self-supervised learning has emerged as a promising approach for acquiring transferable 3D representations from unlabeled 3D point clouds. Unlike 2D images, which are widely accessible, acquiring 3D assets requires specialized expertise or…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xuweiyi Chen , Zezhou Cheng

Recently Transformer-based models have advanced point cloud understanding by leveraging self-attention mechanisms, however, these methods often overlook latent information in less prominent regions, leading to increased sensitivity to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Yi Wang , Jiaze Wang , Ziyu Guo , Renrui Zhang , Donghao Zhou , Guangyong Chen , Anfeng Liu , Pheng-Ann Heng

We propose a unified point cloud video self-supervised learning framework for object-centric and scene-centric data. Previous methods commonly conduct representation learning at the clip or frame level and cannot well capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao , Longguang Wang , Yulan Guo , Hehe Fan

Among 2D convolutional networks on point clouds, point-based approaches consume point clouds of fixed size directly. By analysis of PointNet, a pioneer in introducing deep learning into point sets, we reveal that current point-based methods…

Computer Vision and Pattern Recognition · Computer Science 2021-08-11 Zhenpeng Chen , Yuan li

Masked Autoencoders (MAE) have shown great potentials in self-supervised pre-training for language and 2D image transformers. However, it still remains an open question on how to exploit masked autoencoding for learning 3D representations…

Computer Vision and Pattern Recognition · Computer Science 2022-10-17 Renrui Zhang , Ziyu Guo , Rongyao Fang , Bin Zhao , Dong Wang , Yu Qiao , Hongsheng Li , Peng Gao

Recent work on 4D point cloud sequences has attracted a lot of attention. However, obtaining exhaustively labeled 4D datasets is often very expensive and laborious, so it is especially important to investigate how to utilize raw unlabeled…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Zhuoyang Zhang , Yuhao Dong , Yunze Liu , Li Yi

The success of supervised learning requires large-scale ground truth labels which are very expensive, time-consuming, or may need special skills to annotate. To address this issue, many self- or un-supervised methods are developed. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2020-04-14 Longlong Jing , Yucheng Chen , Ling Zhang , Mingyi He , Yingli Tian

3D point cloud interpretation is a challenging task due to the randomness and sparsity of the component points. Many of the recently proposed methods like PointNet and PointCNN have been focusing on learning shape descriptions from point…

Computer Vision and Pattern Recognition · Computer Science 2021-07-28 Zhaoyu Su , Pin Siang Tan , Junkang Chow , Jimmy Wu , Yehur Cheong , Yu-Hsing Wang

In this work, we propose to learn local descriptors for point clouds in a self-supervised manner. In each iteration of the training, the input of the network is merely one unlabeled point cloud. On top of our previous work, that directly…

Robotics · Computer Science 2020-03-12 Yijun Yuan , Jiawei Hou , Andreas Nüchter , Sören Schwertfeger

Representation learning has overcome the often arduous and manual featurization of networks through (unsupervised) feature learning as it results in embeddings that can apply to a variety of downstream learning tasks. The focus of…

Machine Learning · Computer Science 2021-01-01 Piotr Bielak , Tomasz Kajdanowicz , Nitesh V. Chawla

Diffusion-based models, widely used in text-to-image generation, have proven effective in 2D representation learning. Recently, this framework has been extended to 3D self-supervised learning by constructing a conditional point generator…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Yiyang Chen , Shanshan Zhao , Lunhao Duan , Changxing Ding , Dacheng Tao

Point cloud understanding aims to acquire robust and general feature representations from unlabeled data. Masked point modeling-based methods have recently shown significant performance across various downstream tasks. These pre-training…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Yixin Zha , Chuxin Wang , Wenfei Yang , Tianzhu Zhang

The manual annotation for large-scale point clouds is still tedious and unavailable for many harsh real-world tasks. Self-supervised learning, which is used on raw and unlabeled data to pre-train deep neural networks, is a promising…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Junsheng Zhou , Xin Wen , Baorui Ma , Yu-Shen Liu , Yue Gao , Yi Fang , Zhizhong Han

Although unsupervised feature learning has demonstrated its advantages to reducing the workload of data labeling and network design in many fields, existing unsupervised 3D learning methods still cannot offer a generic network for various…

Computer Vision and Pattern Recognition · Computer Science 2021-03-15 Peng-Shuai Wang , Yu-Qi Yang , Qian-Fang Zou , Zhirong Wu , Yang Liu , Xin Tong

We propose a novel approach to self-supervised learning of point cloud representations by differentiable neural rendering. Motivated by the fact that informative point cloud features should be able to encode rich geometry and appearance…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Di Huang , Sida Peng , Tong He , Honghui Yang , Xiaowei Zhou , Wanli Ouyang