English
Related papers

Related papers: Implicit Autoencoder for Point-Cloud Self-Supervis…

200 papers

Masked point modeling methods have recently achieved great success in self-supervised learning for point cloud data. However, these methods are sensitive to rotations and often exhibit sharp performance drops when encountering rotational…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Kunming Su , Qiuxia Wu , Panpan Cai , Xiaogang Zhu , Xuequan Lu , Zhiyong Wang , Kun Hu

Masked Autoencoders (MAE) have shown promising performance in self-supervised learning for both 2D and 3D computer vision. However, existing MAE-style methods can only learn from the data of a single modality, i.e., either images or point…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Ziyu Guo , Renrui Zhang , Longtian Qiu , Xianzhi Li , Pheng-Ann Heng

This paper tries to address a fundamental question in point cloud self-supervised learning: what is a good signal we should leverage to learn features from point clouds without annotations? To answer that, we introduce a point cloud…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Xiaoyu Tian , Haoxi Ran , Yue Wang , Hang Zhao

Automatic synthesis of high quality 3D shapes is an ongoing and challenging area of research. While several data-driven methods have been proposed that make use of neural networks to generate 3D shapes, none of them reach the level of…

Computer Vision and Pattern Recognition · Computer Science 2019-06-28 Isaak Lim , Moritz Ibing , Leif Kobbelt

We introduce a pioneering approach to self-supervised learning for point clouds, employing a geometrically informed mask selection strategy called GeoMask3D (GM3D) to boost the efficiency of Masked Auto Encoders (MAE). Unlike the…

Discretization invariant learning aims at learning in the infinite-dimensional function spaces with the capacity to process heterogeneous discrete representations of functions as inputs and/or outputs of a learning model. This paper…

Machine Learning · Computer Science 2022-09-07 Yong Zheng Ong , Zuowei Shen , Haizhao Yang

Masked Autoencoders learn strong visual representations and achieve state-of-the-art results in several independent modalities, yet very few works have addressed their capabilities in multi-modality settings. In this work, we focus on point…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Anthony Chen , Kevin Zhang , Renrui Zhang , Zihan Wang , Yuheng Lu , Yandong Guo , Shanghang Zhang

We propose a canonical point autoencoder (CPAE) that predicts dense correspondences between 3D shapes of the same category. The autoencoder performs two key functions: (a) encoding an arbitrarily ordered point cloud to a canonical…

Computer Vision and Pattern Recognition · Computer Science 2021-07-13 An-Chieh Cheng , Xueting Li , Min Sun , Ming-Hsuan Yang , Sifei Liu

In this paper, we describe the "implicit autoencoder" (IAE), a generative autoencoder in which both the generative path and the recognition path are parametrized by implicit distributions. We use two generative adversarial networks to…

Machine Learning · Computer Science 2019-02-08 Alireza Makhzani

Masked Autoencoder (MAE) is a self-supervised approach for representation learning, widely applicable to a variety of downstream tasks in computer vision. In spite of its success, it is still not fully uncovered what and how MAE exactly…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Jeongwoo Shin , Inseo Lee , Junho Lee , Joonseok Lee

The interest in matching non-rigidly deformed shapes represented as raw point clouds is rising due to the proliferation of low-cost 3D sensors. Yet, the task is challenging since point clouds are irregular and there is a lack of intrinsic…

Computer Vision and Pattern Recognition · Computer Science 2025-01-10 Huajian Zeng , Maolin Gao , Daniel Cremers

Recently, deep learning becomes the main focus of machine learning research and has greatly impacted many important fields. However, deep learning is criticized for lack of interpretability. As a successful unsupervised model in deep…

Machine Learning · Computer Science 2021-01-06 Fenglei Fan , Mengzhou Li , Yueyang Teng , Ge Wang

In computer-aided design (CAD) community, the point cloud data is pervasively applied in reverse engineering, where the point cloud analysis plays an important role. While a large number of supervised learning methods have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Cheng Zhang , Jian Shi , Xuan Deng , Zizhao Wu

This paper tackles the problem of parts-aware point cloud generation. Unlike existing works which require the point cloud to be segmented into parts a priori, our parts-aware editing and generation are performed in an unsupervised manner.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Shidi Li , Miaomiao Liu , Christian Walder

Neural implicit representations have become a popular choice for modeling surfaces due to their adaptability in resolution and support for complex topology. While previous works have achieved impressive reconstruction quality by training on…

Computer Vision and Pattern Recognition · Computer Science 2024-08-12 Lu Sang , Abhishek Saroha , Maolin Gao , Daniel Cremers

Generalizable 3D object reconstruction from single-view RGB-D images remains a challenging task, particularly with real-world data. Current state-of-the-art methods develop Transformer-based implicit field learning, necessitating an…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Yushuang Wu , Luyue Shi , Junhao Cai , Weihao Yuan , Lingteng Qiu , Zilong Dong , Liefeng Bo , Shuguang Cui , Xiaoguang Han

Self-supervised representation learning for point cloud videos remains a challenging problem with two key limitations: (1) existing methods rely on explicit knowledge to learn motion, resulting in suboptimal representations; (2) prior…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Zhi Zuo , Chenyi Zhuang , Pan Gao , Jie Qin , Hao Feng , Nicu Sebe

This paper explores Masked Autoencoders (MAE) with Gaussian Splatting. While reconstructive self-supervised learning frameworks such as MAE learns good semantic abstractions, it is not trained for explicit spatial awareness. Our approach,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jathushan Rajasegaran , Xinlei Chen , Rulilong Li , Christoph Feichtenhofer , Jitendra Malik , Shiry Ginosar

Constructing a compressed latent space through a variational autoencoder (VAE) is the key for efficient 3D diffusion models. This paper introduces COD-VAE that encodes 3D shapes into a COmpact set of 1D latent vectors without sacrificing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 In Cho , Youngbeom Yoo , Subin Jeon , Seon Joo Kim

Masked autoencoder has demonstrated its effectiveness in self-supervised point cloud learning. Considering that masking is a kind of corruption, in this work we explore a more general denoising autoencoder for point cloud learning…

Computer Vision and Pattern Recognition · Computer Science 2025-05-02 Yabin Zhang , Jiehong Lin , Ruihuang Li , Kui Jia , Lei Zhang