English
Related papers

Related papers: Self-Supervised Learning for Multimodal Non-Rigid …

200 papers

Though a number of point cloud learning methods have been proposed to handle unordered points, most of them are supervised and require labels for training. By contrast, unsupervised learning of point cloud data has received much less…

Computer Vision and Pattern Recognition · Computer Science 2023-01-25 Jincen Jiang , Xuequan Lu , Wanli Ouyang , Meili Wang

In perception, multiple sensory information is integrated to map visual information from 2D views onto 3D objects, which is beneficial for understanding in 3D environments. But in terms of a single 2D view rendered from different angles,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Hai-Tao Yu , Mofei Song

Large and rich data is a prerequisite for effective training of deep neural networks. However, the irregularity of point cloud data makes manual annotation time-consuming and laborious. Self-supervised representation learning, which…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Xin Cao , Xinxin Han , Yifan Wang , Mengna Yang , Kang Li

We introduce OpenShape, a method for learning multi-modal joint representations of text, image, and point clouds. We adopt the commonly used multi-modal contrastive learning framework for representation alignment, but with a specific focus…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Minghua Liu , Ruoxi Shi , Kaiming Kuang , Yinhao Zhu , Xuanlin Li , Shizhong Han , Hong Cai , Fatih Porikli , Hao Su

Point cloud data has been extensively studied due to its compact form and flexibility in representing complex 3D structures. The ability of point cloud data to accurately capture and represent intricate 3D geometry makes it an ideal choice…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Ben Fei , Weidong Yang , Liwen Liu , Tianyue Luo , Rui Zhang , Yixuan Li , Ying He

Recently, the self-supervised learning framework data2vec has shown inspiring performance for various modalities using a masked student-teacher approach. However, it remains open whether such a framework generalizes to the unique challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-23 Karim Knaebel , Jonas Schult , Alexander Hermans , Bastian Leibe

One challenge that remains open in 3D deep learning is how to efficiently represent 3D data to feed deep networks. Recent works have relied on volumetric or point cloud representations, but such approaches suffer from a number of issues…

Computer Vision and Pattern Recognition · Computer Science 2019-01-25 Jhony K. Pontes , Chen Kong , Sridha Sridharan , Simon Lucey , Anders Eriksson , Clinton Fookes

Representing complex 3D objects as simple geometric primitives, known as shape abstraction, is important for geometric modeling, structural analysis, and shape synthesis. In this paper, we propose an unsupervised shape abstraction method to…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Kaizhi Yang , Xuejin Chen

Automatic discovery of category-specific 3D keypoints from a collection of objects of some category is a challenging problem. One reason is that not all objects in a category necessarily have the same semantic parts. The level of difficulty…

Computer Vision and Pattern Recognition · Computer Science 2021-01-07 Clara Fernandez-Labrador , Ajad Chhatkuli , Danda Pani Paudel , Jose J. Guerrero , Cédric Demonceaux , Luc Van Gool

Despite the success of deep functional maps in non-rigid 3D shape matching, there exists no learning framework that models both self-symmetry and shape matching simultaneously. This is despite the fact that errors due to symmetry mismatch…

Computer Vision and Pattern Recognition · Computer Science 2022-04-20 Abhishek Sharma , Maks Ovsjanikov

We propose a novel unsupervised learning approach for non-rigid 3D shape matching. Our approach improves upon recent state-of-the art deep functional map methods and can be applied to a broad range of different challenging scenarios.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongliang Cao , Paul Roetzer , Florian Bernard

In recent years, semi-supervised learning has been widely explored and shows excellent data efficiency for 2D data. There is an emerging need to improve data efficiency for 3D tasks due to the scarcity of labeled 3D data. This paper…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Zhimin Chen , Longlong Jing , Yang Liang , YingLi Tian , Bing Li

This paper presents a novel approach to learn and detect distinctive regions on 3D shapes. Unlike previous works, which require labeled data, our method is unsupervised. We conduct the analysis on point sets sampled from 3D shapes, then…

Graphics · Computer Science 2020-04-22 Xianzhi Li , Lequan Yu , Chi-Wing Fu , Daniel Cohen-Or , Pheng-Ann Heng

We propose a new supervized learning framework for oversegmenting 3D point clouds into superpoints. We cast this problem as learning deep embeddings of the local geometry and radiometry of 3D points, such that the border of objects presents…

Computer Vision and Pattern Recognition · Computer Science 2019-04-04 Loic Landrieu , Mohamed Boussaha

We are interested in reconstructing the mesh representation of object surfaces from point clouds. Surface reconstruction is a prerequisite for downstream applications such as rendering, collision avoidance for planning, animation, etc.…

Computer Vision and Pattern Recognition · Computer Science 2020-10-01 Minghua Liu , Xiaoshuai Zhang , Hao Su

We present a novel approach to learning a point-wise, meaningful embedding for point-clouds in an unsupervised manner, through the use of neural-networks. The domain of point-cloud processing via neural-networks is rapidly evolving, with…

Graphics · Computer Science 2019-03-12 Matan Shoef , Sharon Fogel , Daniel Cohen-Or

This paper tries to address a fundamental question in point cloud self-supervised learning: what is a good signal we should leverage to learn features from point clouds without annotations? To answer that, we introduce a point cloud…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Xiaoyu Tian , Haoxi Ran , Yue Wang , Hang Zhao

We introduce a pioneering approach to self-supervised learning for point clouds, employing a geometrically informed mask selection strategy called GeoMask3D (GM3D) to boost the efficiency of Masked Auto Encoders (MAE). Unlike the…

Self-supervised learning has emerged as a promising approach for acquiring transferable 3D representations from unlabeled 3D point clouds. Unlike 2D images, which are widely accessible, acquiring 3D assets requires specialized expertise or…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Xuweiyi Chen , Zezhou Cheng

Estimating correspondences between pairs of non-rigid deformable 3D shapes remains a significant challenge in computer vision and graphics. While deep functional map methods have become the go-to solution for addressing this problem, they…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Feifan Luo , Hongyang Chen