English
Related papers

Related papers: Masked Autoencoders for Point Cloud Self-supervise…

200 papers

Pre-training by numerous image data has become de-facto for robust 2D representations. In contrast, due to the expensive data acquisition and annotation, a paucity of large-scale 3D datasets severely hinders the learning for high-quality 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Renrui Zhang , Liuhui Wang , Yu Qiao , Peng Gao , Hongsheng Li

Point cloud analysis (such as 3D segmentation and detection) is a challenging task, because of not only the irregular geometries of many millions of unordered points, but also the great variations caused by depth, viewpoint, occlusion, etc.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-28 Tuo Feng , Wenguan Wang , Xiaohan Wang , Yi Yang , Qinghua Zheng

Self-supervised learning can extract representations of good quality from solely unlabeled data, which is appealing for point cloud videos due to their high labelling cost. In this paper, we propose a contrastive mask prediction (PointCMP)…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Zhiqiang Shen , Xiaoxiao Sheng , Longguang Wang , Yulan Guo , Qiong Liu , Xi Zhou

Recent advances in self-supervised learning (SSL) for point clouds have substantially improved 3D scene understanding without human annotations. Existing approaches emphasize semantic awareness by enforcing feature consistency across…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Bin Yang , Mohamed Abdelsamad , Miao Zhang , Alexandru Paul Condurache

In this work, we propose to learn local descriptors for point clouds in a self-supervised manner. In each iteration of the training, the input of the network is merely one unlabeled point cloud. On top of our previous work, that directly…

Robotics · Computer Science 2020-03-12 Yijun Yuan , Jiawei Hou , Andreas Nüchter , Sören Schwertfeger

We present a novel approach to learning a point-wise, meaningful embedding for point-clouds in an unsupervised manner, through the use of neural-networks. The domain of point-cloud processing via neural-networks is rapidly evolving, with…

Graphics · Computer Science 2019-03-12 Matan Shoef , Sharon Fogel , Daniel Cohen-Or

The matching of 3D shapes has been extensively studied for shapes represented as surface meshes, as well as for shapes represented as point clouds. While point clouds are a common representation of raw real-world 3D data (e.g. from laser…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongliang Cao , Florian Bernard

We present LBS-AE; a self-supervised autoencoding algorithm for fitting articulated mesh models to point clouds. As input, we take a sequence of point clouds to be registered as well as an artist-rigged mesh, i.e. a template mesh equipped…

Computer Vision and Pattern Recognition · Computer Science 2019-04-24 Chun-Liang Li , Tomas Simon , Jason Saragih , Barnabás Póczos , Yaser Sheikh

Recently Transformer-based models have advanced point cloud understanding by leveraging self-attention mechanisms, however, these methods often overlook latent information in less prominent regions, leading to increased sensitivity to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Yi Wang , Jiaze Wang , Ziyu Guo , Renrui Zhang , Donghao Zhou , Guangyong Chen , Anfeng Liu , Pheng-Ann Heng

Contrastive learning (CL) for Vision Transformers (ViTs) in image domains has achieved performance comparable to CL for traditional convolutional backbones. However, in 3D point cloud pretraining with ViTs, masked autoencoder (MAE) modeling…

Computer Vision and Pattern Recognition · Computer Science 2024-07-09 Bin Ren , Guofeng Mei , Danda Pani Paudel , Weijie Wang , Yawei Li , Mengyuan Liu , Rita Cucchiara , Luc Van Gool , Nicu Sebe

There have been recent efforts to learn more meaningful representations via fixed length codewords from mesh data, since a mesh serves as a complete model of underlying 3D shape compared to a point cloud. However, the mesh connectivity…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Eric Lei , Muhammad Asad Lodhi , Jiahao Pang , Junghyun Ahn , Dong Tian

Self-supervised learning has not been fully explored for point cloud analysis. Current frameworks are mainly based on point cloud reconstruction. Given only 3D coordinates, such approaches tend to learn local geometric structures and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Mingye Xu , Yali Wang , Zhipeng Zhou , Hongbin Xu , Yu Qiao

Masked autoencoding and generative pretraining have achieved remarkable success in computer vision and natural language processing, and more recently, they have been extended to the point cloud domain. Nevertheless, existing point cloud…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 Zhe Li , Xiying Wang , Jinglin Zhao , Zheng Wang , Debin Liu , Laurence T. Yang

This paper advocates the use of implicit surface representation in autoencoder-based self-supervised 3D representation learning. The most popular and accessible 3D representation, i.e., point clouds, involves discrete samples of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-29 Siming Yan , Zhenpei Yang , Haoxiang Li , Chen Song , Li Guan , Hao Kang , Gang Hua , Qixing Huang

3D point clouds are often perturbed by noise due to the inherent limitation of acquisition equipments, which obstructs downstream tasks such as surface reconstruction, rendering and so on. Previous works mostly infer the displacement of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Shitong Luo , Wei Hu

Masked autoencoder has demonstrated its effectiveness in self-supervised point cloud learning. Considering that masking is a kind of corruption, in this work we explore a more general denoising autoencoder for point cloud learning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Yabin Zhang , Jiehong Lin , Ruihuang Li , Kui Jia , Lei Zhang

When navigating in urban environments, many of the objects that need to be tracked and avoided are heavily occluded. Planning and tracking using these partial scans can be challenging. The aim of this work is to learn to complete these…

Computer Vision and Pattern Recognition · Computer Science 2021-11-23 Himangi Mittal , Brian Okorn , Arpit Jangid , David Held

No-reference point cloud quality assessment (NR-PCQA) aims to automatically predict the perceptual quality of point clouds without reference, which has achieved remarkable performance due to the utilization of deep learning-based models.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-18 Ziyu Shan , Yujie Zhang , Qi Yang , Haichen Yang , Yiling Xu , Shan Liu

Point clouds have grown in importance in the way computers perceive the world. From LIDAR sensors in autonomous cars and drones to the time of flight and stereo vision systems in our phones, point clouds are everywhere. Despite their…

Computer Vision and Pattern Recognition · Computer Science 2020-10-20 Vinit Sarode , Animesh Dhagat , Rangaprasad Arun Srivatsan , Nicolas Zevallos , Simon Lucey , Howie Choset

Self-supervised learning on point clouds has gained a lot of attention recently, since it addresses the label-efficiency and domain-gap problems on point cloud tasks. In this paper, we propose a novel self-supervised framework to learn…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Meng-Shiun Tsai , Pei-Ze Chiang , Yi-Hsuan Tsai , Wei-Chen Chiu