English
Related papers

Related papers: Self-Supervised Learning for Multimodal Non-Rigid …

200 papers

Point cloud completion aims to reconstruct complete shapes from partial observations. Although current methods have achieved remarkable performance, they still have some limitations: Supervised methods heavily rely on ground truth, which…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Jingjing Lu , Huilong Pi , Yunchuan Qin , Zhuo Tang , Ruihui Li

We introduce a novel learning-based method for encoding and manipulating 3D surface meshes. Our method is specifically designed to create an interpretable embedding space for deformable shape collections. Unlike previous 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Sara Hahner , Souhaib Attaiki , Jochen Garcke , Maks Ovsjanikov

Masked autoencoding has achieved great success for self-supervised learning in the image and language domains. However, mask based pretraining has yet to show benefits for point cloud understanding, likely due to standard backbones like…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Haotian Liu , Mu Cai , Yong Jae Lee

Exploring contextual information in the local region is important for shape understanding and analysis. Existing studies often employ hand-crafted or explicit ways to encode contextual information of local regions. However, it is hard to…

Computer Vision and Pattern Recognition · Computer Science 2018-11-16 Xinhai Liu , Zhizhong Han , Yu-Shen Liu , Matthias Zwicker

Shape-Text matching is an important task of high-level shape understanding. Current methods mainly represent a 3D shape as multiple 2D rendered views, which obviously can not be understood well due to the structural ambiguity caused by…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Chuan Tang , Xi Yang , Bojian Wu , Zhizhong Han , Yi Chang

We present an unsupervised data-driven approach for non-rigid shape matching. Shape matching identifies correspondences between two shapes and is a fundamental step in many computer vision and graphics applications. Our approach is designed…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Aymen Merrouche , Joao Regateiro , Stefanie Wuhrer , Edmond Boyer

Semantic 3D keypoints are category-level semantic consistent points on 3D objects. Detecting 3D semantic keypoints is a foundation for a number of 3D vision tasks but remains challenging, due to the ambiguity of semantic information,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Haocheng Yuan , Chen Zhao , Shichao Fan , Jiaxi Jiang , Jiaqi Yang

Geometry and topology constitute complementary descriptors of three-dimensional shape, yet existing benchmark datasets primarily capture geometric information while neglecting topological structure. This work addresses this limitation by…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Prachi Kudeshia , Jiju Poovvancheri

Self-supervised learning approaches leverage unlabeled samples to acquire generic knowledge about different concepts, hence allowing for annotation-efficient downstream task learning. In this paper, we propose a novel self-supervised method…

Computer Vision and Pattern Recognition · Computer Science 2020-10-27 Aiham Taleb , Christoph Lippert , Tassilo Klein , Moin Nabi

We introduce an unsupervised multi-task model to jointly learn point and shape features on point clouds. We define three unsupervised tasks including clustering, reconstruction, and self-supervised classification to train a multi-scale…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Kaveh Hassani , Mike Haley

Unsupervised learning on 3D point clouds has undergone a rapid evolution, especially thanks to data augmentation-based contrastive methods. However, data augmentation is not ideal as it requires a careful selection of the type of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Guofeng Mei , Cristiano Saltori , Fabio Poiesi , Jian Zhang , Elisa Ricci , Nicu Sebe , Qiang Wu

Point clouds, as a primary representation of 3D data, can be categorized into scene domain point clouds and object domain point clouds. Point cloud self-supervised learning (SSL) has become a mainstream paradigm for learning 3D…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yaohua Zha , Tao Dai , Hang Guo , Yanzi Wang , Bin Chen , Ke Chen , Shu-Tao Xia

As a promising scheme of self-supervised learning, masked autoencoding has significantly advanced natural language processing and computer vision. Inspired by this, we propose a neat scheme of masked autoencoders for point cloud…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yatian Pang , Wenxiao Wang , Francis E. H. Tay , Wei Liu , Yonghong Tian , Li Yuan

3D pose transfer is a challenging generation task that aims to transfer the pose of a source geometry onto a target geometry with the target identity preserved. Many prior methods require keypoint annotations to find correspondence between…

Computer Vision and Pattern Recognition · Computer Science 2023-10-13 Jiaze Sun , Zhixiang Chen , Tae-Kyun Kim

Self-supervised learning of point cloud aims to leverage unlabeled 3D data to learn meaningful representations without reliance on manual annotations. However, current approaches face challenges such as limited data diversity and inadequate…

Computer Vision and Pattern Recognition · Computer Science 2024-09-10 Keyi Liu , Yeqi Luo , Weidong Yang , Jingyi Xu , Zhijun Li , Wen-Ming Chen , Ben Fei

We tackle the problem of object-centric learning on point clouds, which is crucial for high-level relational reasoning and scalable machine intelligence. In particular, we introduce a framework, SPAIR3D, to factorize a 3D point cloud into a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tianyu Wang , Miaomiao Liu , Kee Siong Ng

Recently, great progress has been made in 3D deep learning with the emergence of deep neural networks specifically designed for 3D point clouds. These networks are often trained from scratch or from pre-trained models learned purely from…

Computer Vision and Pattern Recognition · Computer Science 2022-10-31 Bach Tran , Binh-Son Hua , Anh Tuan Tran , Minh Hoai

This paper focuses on the recently popular task of point cloud completion guided by multimodal information. Although existing methods have achieved excellent performance by fusing auxiliary images, there are still some deficiencies,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Wei Song , Jun Zhou , Mingjie Wang , Hongchen Tan , Nannan Li , Xiuping Liu

Although 3D point cloud data has received widespread attentions as a general form of 3D signal expression, applying point clouds to the task of dense correspondence estimation between 3D shapes has not been investigated widely. Furthermore,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-27 Zhiyuan Zhang , Jiadai Sun , Yuchao Dai , Bin Fan , Qi Liu

We address the problem of learning accurate 3D shape and camera pose from a collection of unlabeled category-specific images. We train a convolutional network to predict both the shape and the pose from a single image by minimizing the…

Computer Vision and Pattern Recognition · Computer Science 2018-10-23 Eldar Insafutdinov , Alexey Dosovitskiy