English
Related papers

Related papers: Contrastive Laplacian Eigenmaps

200 papers

Recently, heterogeneous Graph Neural Networks (GNNs) have become a de facto model for analyzing HGs, while most of them rely on a relative large number of labeled data. In this work, we investigate Contrastive Learning (CL), a key component…

Machine Learning · Computer Science 2021-09-01 Yanqiao Zhu , Yichen Xu , Hejie Cui , Carl Yang , Qiang Liu , Shu Wu

Hypergraphs can model higher-order relationships among data objects that are found in applications such as social networks and bioinformatics. However, recent studies on hypergraph learning that extend graph convolutional networks to…

Machine Learning · Computer Science 2024-05-29 Yumeng Song , Yu Gu , Tianyi Li , Jianzhong Qi , Zhenghao Liu , Christian S. Jensen , Ge Yu

Attributed graph clustering, which learns node representation from node attribute and topological graph for clustering, is a fundamental but challenging task for graph analysis. Recently, methods based on graph contrastive learning (GCL)…

Machine Learning · Computer Science 2023-05-15 Wei Xia , Quanxue Gao , Ming Yang , Xinbo Gao

Graph contrastive learning (GCL) has recently achieved substantial advancements. Existing GCL approaches compare two different ``views'' of the same graph in order to learn node/graph representations. The underlying assumption of these…

Machine Learning · Computer Science 2024-01-18 Gehang Zhang , Bowen Yu , Jiangxia Cao , Xinghua Zhang , Jiawei Sheng , Chuan Zhou , Tingwen Liu

Graph Neural Networks achieve remarkable results on problems with structured data but come as black-box predictors. Transferring existing explanation techniques, such as occlusion, fails as even removing a single node or edge can lead to…

Machine Learning · Computer Science 2020-10-27 Lukas Faber , Amin K. Moghaddam , Roger Wattenhofer

Graph Contrastive Learning (GCL) seeks to learn nodal or graph representations that contain maximal consistent information from graph-structured data. While node-level contrasting modes are dominating, some efforts commence to explore…

Machine Learning · Computer Science 2024-09-13 Zhenhao Zhao , Minhong Zhu , Chen Wang , Sijia Wang , Jiqiang Zhang , Li Chen , Weiran Cai

Contrastive learning has proven to be highly efficient and adaptable in shaping representation spaces across diverse modalities by pulling similar samples together and pushing dissimilar ones apart. However, two key limitations persist: (1)…

Machine Learning · Computer Science 2025-12-08 Ziwen Wang , Jiajun Fan , Thao Nguyen , Heng Ji , Ge Liu

Graph Contrastive Learning (GCL) has shown promising performance in graph representation learning (GRL) without the supervision of manual annotations. GCL can generate graph-level embeddings by maximizing the Mutual Information (MI) between…

Machine Learning · Computer Science 2022-05-25 Jiawei Sun , Ruoxin Chen , Jie Li , Chentao Wu , Yue Ding , Junchi Yan

Despite recent success, most contrastive self-supervised learning methods are domain-specific, relying heavily on data augmentation techniques that require knowledge about a particular domain, such as image cropping and rotation. To…

Machine Learning · Computer Science 2021-07-21 Vikas Verma , Minh-Thang Luong , Kenji Kawaguchi , Hieu Pham , Quoc V. Le

Representation learning for graphs enables the application of standard machine learning algorithms and data analysis tools to graph data. Replacing discrete unordered objects such as graph nodes by real-valued vectors is at the heart of…

Machine Learning · Computer Science 2021-02-10 Konstantin Kutzkov

Knowledge graph embedding (KGE) aims at learning powerful representations to benefit various artificial intelligence applications. Meanwhile, contrastive learning has been widely leveraged in graph learning as an effective mechanism to…

Artificial Intelligence · Computer Science 2023-06-14 Ke Liang , Yue Liu , Sihang Zhou , Wenxuan Tu , Yi Wen , Xihong Yang , Xiangjun Dong , Xinwang Liu

Leveraging the diversity and quantity of data provided by various graph-structured data augmentations while preserving intrinsic semantic information is challenging. Additionally, successive layers in graph neural network (GNN) tend to…

Machine Learning · Computer Science 2026-03-19 Jie Chen , Hua Mao , Chuanbin Liu , Zhu Wang , Xi Peng

Contrastive learning has recently emerged as a promising approach for learning data representations that discover and disentangle the explanatory factors of the data. Previous analyses of such approaches have largely focused on individual…

Machine Learning · Computer Science 2023-11-09 Stefan Matthes , Zhiwei Han , Hao Shen

Recent methods utilize graph contrastive Learning within graph-structured user-item interaction data for collaborative filtering and have demonstrated their efficacy in recommendation tasks. However, they ignore that the difference relation…

Information Retrieval · Computer Science 2024-03-25 Jiaheng Yu , Jing Li , Yue He , Kai Zhu , Shuyi Zhang , Wen Hu

Prevailing deep graph learning models often suffer from label sparsity issue. Although many graph few-shot learning (GFL) methods have been developed to avoid performance degradation in face of limited annotated data, they excessively rely…

Machine Learning · Computer Science 2022-10-04 Chunhui Zhang , Hongfu Liu , Jundong Li , Yanfang Ye , Chuxu Zhang

Graph contrastive learning (GCL) has recently emerged as an effective learning paradigm to alleviate the reliance on labelling information for graph representation learning. The core of GCL is to maximise the mutual information between the…

Machine Learning · Computer Science 2022-10-18 Yizhen Zheng , Yu Zheng , Xiaofei Zhou , Chen Gong , Vincent CS Lee , Shirui Pan

We study three intriguing properties of contrastive learning. First, we generalize the standard contrastive loss to a broader family of losses, and we find that various instantiations of the generalized loss perform similarly under the…

Machine Learning · Computer Science 2021-10-26 Ting Chen , Calvin Luo , Lala Li

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

Although self-/un-supervised methods have led to rapid progress in visual representation learning, these methods generally treat objects and scenes using the same lens. In this paper, we focus on learning representations for objects and…

Computer Vision and Pattern Recognition · Computer Science 2022-12-02 Songwei Ge , Shlok Mishra , Simon Kornblith , Chun-Liang Li , David Jacobs

In recent years, deep learning on graphs has achieved remarkable success in various domains. However, the reliance on annotated graph data remains a significant bottleneck due to its prohibitive cost and time-intensive nature. To address…