English
Related papers

Related papers: Self-Supervised Generative-Contrastive Learning of…

200 papers

Unsupervised representation learning has recently received lots of interest due to its powerful generalizability through effectively leveraging large-scale unlabeled data. There are two prevalent approaches for this, contrastive learning…

Machine Learning · Computer Science 2021-06-14 Saehoon Kim , Sungwoong Kim , Juho Lee

We study self-supervised learning on graphs using contrastive methods. A general scheme of prior methods is to optimize two-view representations of input graphs. In many studies, a single graph-level representation is computed as one of the…

Machine Learning · Computer Science 2021-07-22 Xinyi Xu , Cheng Deng , Yaochen Xie , Shuiwang Ji

We propose Graph Contrastive Learning (GraphCL), a general framework for learning node representations in a self supervised manner. GraphCL learns node embeddings by maximizing the similarity between the representations of two randomly…

Machine Learning · Computer Science 2020-07-17 Hakim Hafidi , Mounir Ghogho , Philippe Ciblat , Ananthram Swami

We propose a new representation for encoding 3D shapes as neural fields. The representation is designed to be compatible with the transformer architecture and to benefit both shape reconstruction and shape generation. Existing works on…

Computer Vision and Pattern Recognition · Computer Science 2022-10-19 Biao Zhang , Matthias Nießner , Peter Wonka

Generative modeling of 3D shapes has become an important problem due to its relevance to many applications across Computer Vision, Graphics, and VR. In this paper we build upon recently introduced 3D mesh-convolutional Variational…

Machine Learning · Computer Science 2019-06-11 Jake Levinson , Avneesh Sud , Ameesh Makadia

Graph representation learning nowadays becomes fundamental in analyzing graph-structured data. Inspired by recent success of contrastive methods, in this paper, we propose a novel framework for unsupervised graph representation learning by…

Machine Learning · Computer Science 2020-07-14 Yanqiao Zhu , Yichen Xu , Feng Yu , Qiang Liu , Shu Wu , Liang Wang

Graph representation learning has attracted a surge of interest recently, whose target at learning discriminant embedding for each node in the graph. Most of these representation methods focus on supervised learning and heavily depend on…

Machine Learning · Computer Science 2021-07-07 Pengpeng Shao , Tong Liu , Dawei Zhang , Jianhua Tao , Feihu Che , Guohua Yang

Molecular shape and geometry dictate key biophysical recognition processes, yet many graph neural networks disregard 3D information for molecular property prediction. Here, we propose a new contrastive-learning procedure for graph neural…

Machine Learning · Computer Science 2022-11-07 Austin Atsango , Nathaniel L. Diamant , Ziqing Lu , Tommaso Biancalani , Gabriele Scalia , Kangway V. Chuang

Mainstream 3D representation learning approaches are built upon contrastive or generative modeling pretext tasks, where great improvements in performance on various downstream tasks have been achieved. However, we find these two paradigms…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Zekun Qi , Runpei Dong , Guofan Fan , Zheng Ge , Xiangyu Zhang , Kaisheng Ma , Li Yi

We propose the Variational Shape Learner (VSL), a generative model that learns the underlying structure of voxelized 3D shapes in an unsupervised fashion. Through the use of skip-connections, our model can successfully learn and infer a…

Computer Vision and Pattern Recognition · Computer Science 2018-08-07 Shikun Liu , C. Lee Giles , Alexander G. Ororbia

Representing 3D shape is a fundamental problem in artificial intelligence, which has numerous applications within computer vision and graphics. One avenue that has recently begun to be explored is the use of latent representations of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-20 Tristan Aumentado-Armstrong , Stavros Tsogkas , Allan Jepson , Sven Dickinson

Self-supervised learning (especially contrastive learning) methods on heterogeneous graphs can effectively get rid of the dependence on supervisory data. Meanwhile, most existing representation learning methods embed the heterogeneous…

Machine Learning · Computer Science 2022-06-28 Shichao Zhu , Chuan Zhou , Anfeng Cheng , Shirui Pan , Shuaiqiang Wang , Dawei Yin , Bin Wang

We introduce a novel learning-based method for encoding and manipulating 3D surface meshes. Our method is specifically designed to create an interpretable embedding space for deformable shape collections. Unlike previous 3D mesh…

Computer Vision and Pattern Recognition · Computer Science 2023-10-30 Sara Hahner , Souhaib Attaiki , Jochen Garcke , Maks Ovsjanikov

In this paper, we introduce a self-supervised learning method to enhance the graph-level representations with the help of a set of subgraphs. For this purpose, we propose a universal framework to generate subgraphs in an auto-regressive way…

Machine Learning · Computer Science 2021-05-10 Chenguang Wang , Ziwen Liu

Self-supervised learning of deep neural networks has become a prevalent paradigm for learning representations that transfer to a variety of downstream tasks. Similar to proposed models of the ventral stream of biological vision, it is…

Machine Learning · Computer Science 2023-06-26 Kion Fallah , Alec Helbling , Kyle A. Johnsen , Christopher J. Rozell

Recent self-supervised contrastive learning provides an effective approach for unsupervised person re-identification (ReID) by learning invariance from different views (transformed versions) of an input. In this paper, we incorporate a…

Computer Vision and Pattern Recognition · Computer Science 2021-03-31 Hao Chen , Yaohui Wang , Benoit Lagadec , Antitza Dantcheva , Francois Bremond

Shape priors have long been known to be effective when reconstructing 3D shapes from noisy or incomplete data. When using a deep-learning based shape representation, this often involves learning a latent representation, which can be either…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Patrick M. Jensen , Udaranga Wickramasinghe , Anders B. Dahl , Pascal Fua , Vedrana A. Dahl

This paper addresses the challenges in representation learning of 3D shape features by investigating state-of-the-art backbones paired with both contrastive supervised and self-supervised learning objectives. Computer vision methods…

Computer Vision and Pattern Recognition · Computer Science 2025-10-24 Márcus Vinícius Lobo Costa , Sherlon Almeida da Silva , Bárbara Caroline Benato , Leo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti

In this paper, we present a new cross-architecture contrastive learning (CACL) framework for self-supervised video representation learning. CACL consists of a 3D CNN and a video transformer which are used in parallel to generate diverse…

Computer Vision and Pattern Recognition · Computer Science 2022-05-27 Sheng Guo , Zihua Xiong , Yujie Zhong , Limin Wang , Xiaobo Guo , Bing Han , Weilin Huang

Learning representations of multimodal data that are both informative and robust to missing modalities at test time remains a challenging problem due to the inherent heterogeneity of data obtained from different channels. To address it, we…

Machine Learning · Computer Science 2022-11-21 Petra Poklukar , Miguel Vasco , Hang Yin , Francisco S. Melo , Ana Paiva , Danica Kragic
‹ Prev 1 2 3 10 Next ›