English
Related papers

Related papers: Towards More Diverse and Challenging Pre-training …

200 papers

Self-supervised learning has not been fully explored for point cloud analysis. Current frameworks are mainly based on point cloud reconstruction. Given only 3D coordinates, such approaches tend to learn local geometric structures and…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Mingye Xu , Yali Wang , Zhipeng Zhou , Hongbin Xu , Yu Qiao

Self-supervised pre-training has achieved remarkable success in NLP and 2D vision. However, these advances have yet to translate to 3D data. Techniques like masked reconstruction face inherent challenges on unstructured point clouds, while…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Vencia Herzog , Stefan Suwelack

Masked Autoencoders (MAE) have shown promising performance in self-supervised learning for both 2D and 3D computer vision. However, existing MAE-style methods can only learn from the data of a single modality, i.e., either images or point…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzhi Li , Pheng-Ann Heng

In this paper, we propose an effective point cloud generation method, which can generate multi-resolution point clouds of the same shape from a latent vector. Specifically, we develop a novel progressive deconvolution network with the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-13 Le Hui , Rui Xu , Jin Xie , Jianjun Qian , Jian Yang

A promising direction for pre-training 3D point clouds is to leverage the massive amount of data in 2D, whereas the domain gap between 2D and 3D creates a fundamental challenge. This paper proposes a novel approach to point-cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Siming Yan , Chen Song , Youkang Kong , Qixing Huang

With the rapid progress of multimodal foundation models and predictive pre-training, an important open question is how to equip 3D point clouds with a pre-training paradigm that is better aligned with next-token and next-embedding learning.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yumeng Yao , Jingzhi Dong , Haowen Gu , Tao Chen , Zonghan Wu , Xiaoshui Huang , Yazhou Yao

Contrastive learning is an essential method in self-supervised learning. It primarily employs a multi-branch strategy to compare latent representations obtained from different branches and train the encoder. In the case of multi-modal…

Computer Vision and Pattern Recognition · Computer Science 2025-06-02 Chengzhi Wu , Qianliang Huang , Kun Jin , Julius Pfrommer , Jürgen Beyerer

We propose a novel approach to self-supervised learning of point cloud representations by differentiable neural rendering. Motivated by the fact that informative point cloud features should be able to encode rich geometry and appearance…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Di Huang , Sida Peng , Tong He , Honghui Yang , Xiaowei Zhou , Wanli Ouyang

Though a number of point cloud learning methods have been proposed to handle unordered points, most of them are supervised and require labels for training. By contrast, unsupervised learning of point cloud data has received much less…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Jincen Jiang , Xuequan Lu , Wanli Ouyang , Meili Wang

We propose a unified point cloud video self-supervised learning framework for object-centric and scene-centric data. Previous methods commonly conduct representation learning at the clip or frame level and cannot well capture fine-grained…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Xiaoxiao Sheng , Zhiqiang Shen , Gang Xiao , Longguang Wang , Yulan Guo , Hehe Fan

The increased availability of massive point clouds coupled with their utility in a wide variety of applications such as robotics, shape synthesis, and self-driving cars has attracted increased attention from both industry and academia.…

Machine Learning · Computer Science 2020-09-30 Charu Sharma , Manohar Kaul

In computer-aided design (CAD) community, the point cloud data is pervasively applied in reverse engineering, where the point cloud analysis plays an important role. While a large number of supervised learning methods have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Cheng Zhang , Jian Shi , Xuan Deng , Zizhao Wu

Pre-training by numerous image data has become de-facto for robust 2D representations. In contrast, due to the expensive data acquisition and annotation, a paucity of large-scale 3D datasets severely hinders the learning for high-quality 3D…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Renrui Zhang , Liuhui Wang , Yu Qiao , Peng Gao , Hongsheng Li

Although recent point cloud analysis achieves impressive progress, the paradigm of representation learning from a single modality gradually meets its bottleneck. In this work, we take a step towards more discriminative 3D point cloud…

Computer Vision and Pattern Recognition · Computer Science 2022-10-11 Xu Yan , Heshen Zhan , Chaoda Zheng , Jiantao Gao , Ruimao Zhang , Shuguang Cui , Zhen Li

Compared to 2D data, the scale of point cloud data in different domains available for training, is quite limited. Researchers have been trying to combine these data of different domains for masked autoencoder (MAE) pre-training to leverage…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Ziqi Gao , Qiufu Li , Linlin Shen

Advances in self-supervised learning are essential for enhancing feature extraction and understanding in point cloud processing. This paper introduces PMT-MAE (Point MLP-Transformer Masked Autoencoder), a novel self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2024-09-17 Qiang Zheng , Chao Zhang , Jian Sun

Annotating large-scale point clouds is highly time-consuming and often infeasible for many complex real-world tasks. Point cloud pre-training has therefore become a promising strategy for learning discriminative representations without…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Guofeng Mei , Xiaoshui Huang , Juan Liu , Jian Zhang , Qiang Wu

The task of point cloud upsampling aims to acquire dense and uniform point sets from sparse and irregular point sets. Although significant progress has been made with deep learning models, state-of-the-art methods require ground-truth dense…

Computer Vision and Pattern Recognition · Computer Science 2022-06-14 Xinhai Liu , Xinchen Liu , Yu-Shen Liu , Zhizhong Han

This paper tackles the problem of parts-aware point cloud generation. Unlike existing works which require the point cloud to be segmented into parts a priori, our parts-aware editing and generation are performed in an unsupervised manner.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Shidi Li , Miaomiao Liu , Christian Walder

Perceiving the environment via cameras is crucial for Reinforcement Learning (RL) in robotics. While images are a convenient form of representation, they often complicate extracting important geometric details, especially with varying…

Machine Learning · Computer Science 2024-10-25 Balázs Gyenes , Nikolai Franke , Philipp Becker , Gerhard Neumann