English
Related papers

Related papers: Masked Autoencoders for Point Cloud Self-supervise…

200 papers

Most algorithms that rely on deep learning-based approaches to generate 3D point sets can only produce clouds containing fixed number of points. Furthermore, they typically require large networks parameterized by many weights, which makes…

Computer Vision and Pattern Recognition · Computer Science 2019-01-29 Edoardo Remelli , Pierre Baque , Pascal Fua

We introduce an unsupervised multi-task model to jointly learn point and shape features on point clouds. We define three unsupervised tasks including clustering, reconstruction, and self-supervised classification to train a multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Kaveh Hassani , Mike Haley

In recent years, zero-shot learning has attracted the focus of many researchers, due to its flexibility and generality. Many approaches have been proposed to achieve the zero-shot classification of the point clouds for 3D object…

Computer Vision and Pattern Recognition · Computer Science 2024-05-01 Jiayi Han , Zidi Cao , Weibo Zheng , Xiangguo Zhou , Xiangjian He , Yuanfang Zhang , Daisen Wei

Masked Autoencoders (MAE) have shown promising performance in self-supervised learning for both 2D and 3D computer vision. However, existing MAE-style methods can only learn from the data of a single modality, i.e., either images or point…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzhi Li , Pheng-Ann Heng

The task of point cloud upsampling aims to acquire dense and uniform point sets from sparse and irregular point sets. Although significant progress has been made with deep learning models, state-of-the-art methods require ground-truth dense…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Xinhai Liu , Xinchen Liu , Yu-Shen Liu , Zhizhong Han

In this paper, we present an end-to-end unsupervised anomaly detection framework for 3D point clouds. To the best of our knowledge, this is the first work to tackle the anomaly detection task on a general object represented by a 3D point…

Computer Vision and Pattern Recognition · Computer Science 2023-04-10 Mana Masuda , Ryo Hachiuma , Ryo Fujii , Hideo Saito , Yusuke Sekikawa

We describe a simple pre-training approach for point clouds. It works in three steps: 1. Mask all points occluded in a camera view; 2. Learn an encoder-decoder model to reconstruct the occluded points; 3. Use the encoder weights as…

Computer Vision and Pattern Recognition · Computer Science 2021-10-15 Hanchen Wang , Qi Liu , Xiangyu Yue , Joan Lasenby , Matthew J. Kusner

Recently, anomaly detection and localization in multimedia data have received significant attention among the machine learning community. In real-world applications such as medical diagnosis and industrial defect detection, anomalies only…

Computer Vision and Pattern Recognition · Computer Science 2022-05-16 Chaoqin Huang , Qinwei Xu , Yanfeng Wang , Yu Wang , Ya Zhang

Point cloud processing methods leverage local and global point features %at the feature level to cater to downstream tasks, yet they often overlook the task-level context inherent in point clouds during the encoding stage. We argue that…

Computer Vision and Pattern Recognition · Computer Science 2026-01-30 Yong He , Hongshan Yu , Chaoxu Mu , Mingtao Feng , Tongjia Chen , Zechuan Li , Anwaar Ulhaq , Ajmal Mian

Point cloud data has been extensively studied due to its compact form and flexibility in representing complex 3D structures. The ability of point cloud data to accurately capture and represent intricate 3D geometry makes it an ideal choice…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Ben Fei , Weidong Yang , Liwen Liu , Tianyue Luo , Rui Zhang , Yixuan Li , Ying He

Manual annotation of large-scale point cloud dataset for varying tasks such as 3D object classification, segmentation and detection is often laborious owing to the irregular structure of point clouds. Self-supervised learning, which…

Computer Vision and Pattern Recognition · Computer Science 2022-03-25 Mohamed Afham , Isuru Dissanayake , Dinithi Dissanayake , Amaya Dharmasiri , Kanchana Thilakarathna , Ranga Rodrigo

We propose a deep autoencoder with graph topology inference and filtering to achieve compact representations of unorganized 3D point clouds in an unsupervised manner. Many previous works discretize 3D points to voxels and then use…

Computer Vision and Pattern Recognition · Computer Science 2020-02-19 Siheng Chen , Chaojing Duan , Yaoqing Yang , Duanshun Li , Chen Feng , Dong Tian

Existing 3D mask learning methods encounter performance bottlenecks under limited data, and our objective is to overcome this limitation. In this paper, we introduce a triple point masking scheme, named TPM, which serves as a scalable…

Computer Vision and Pattern Recognition · Computer Science 2024-10-16 Jiaming Liu , Linghe Kong , Yue Wu , Maoguo Gong , Hao Li , Qiguang Miao , Wenping Ma , Can Qin

This paper shows that masked autoencoders (MAE) are scalable self-supervised learners for computer vision. Our MAE approach is simple: we mask random patches of the input image and reconstruct the missing pixels. It is based on two core…

Computer Vision and Pattern Recognition · Computer Science 2021-12-21 Kaiming He , Xinlei Chen , Saining Xie , Yanghao Li , Piotr Dollár , Ross Girshick

The pre-training architectures of large language models encompass various types, including autoencoding models, autoregressive models, and encoder-decoder models. We posit that any modality can potentially benefit from a large language…

Machine Learning · Computer Science 2023-10-27 Zhe Li , Zhangyang Gao , Cheng Tan , Stan Z. Li , Laurence T. Yang

We propose a novel approach to self-supervised learning of point cloud representations by differentiable neural rendering. Motivated by the fact that informative point cloud features should be able to encode rich geometry and appearance…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Di Huang , Sida Peng , Tong He , Honghui Yang , Xiaowei Zhou , Wanli Ouyang

Vision transformers (ViTs) have recently been widely applied to 3D point cloud understanding, with masked autoencoding as the predominant pre-training paradigm. However, the challenge of learning dense and informative semantic features from…

Computer Vision and Pattern Recognition · Computer Science 2025-08-13 Bin Ren , Xiaoshui Huang , Mengyuan Liu , Hong Liu , Fabio Poiesi , Nicu Sebe , Guofeng Mei

LiDAR and photogrammetry are active and passive remote sensing techniques for point cloud acquisition, respectively, offering complementary advantages and heterogeneous. Due to the fundamental differences in sensing mechanisms, spatial…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Chen Wang , Yanfeng Gu , Xian Li

Point cloud filtering is a fundamental problem in geometry modeling and processing. Despite of significant advancement in recent years, the existing methods still suffer from two issues: 1) they are either designed without preserving sharp…

Graphics · Computer Science 2020-09-29 Dongbo Zhang , Xuequan Lu , Hong Qin , Ying He

Point clouds upsampling is a challenging issue to generate dense and uniform point clouds from the given sparse input. Most existing methods either take the end-to-end supervised learning based manner, where large amounts of pairs of sparse…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Wenbo Zhao , Xianming Liu , Zhiwei Zhong , Junjun Jiang , Wei Gao , Ge Li , Xiangyang Ji