English
Related papers

Related papers: CORE: Contrastive Masked Feature Reconstruction on…

200 papers

We introduce a self-supervised approach for learning node and graph level representations by contrasting structural views of graphs. We show that unlike visual representation learning, increasing the number of views to more than two or…

Machine Learning · Computer Science 2020-06-11 Kaveh Hassani , Amir Hosein Khasahmadi

Self-supervised learning (especially contrastive learning) methods on heterogeneous graphs can effectively get rid of the dependence on supervisory data. Meanwhile, most existing representation learning methods embed the heterogeneous…

Machine Learning · Computer Science 2022-06-28 Shichao Zhu , Chuan Zhou , Anfeng Cheng , Shirui Pan , Shuaiqiang Wang , Dawei Yin , Bin Wang

Inspired by the impressive success of contrastive learning (CL), a variety of graph augmentation strategies have been employed to learn node representations in a self-supervised manner. Existing methods construct the contrastive samples by…

Machine Learning · Computer Science 2022-12-14 Peiyao Zhao , Yuangang Pan , Xin Li , Xu Chen , Ivor W. Tsang , Lejian Liao

Graph contrastive learning (GCL) aims to align the positive features while differentiating the negative features in the latent space by minimizing a pair-wise contrastive loss. As the embodiment of an outstanding discriminative unsupervised…

Machine Learning · Computer Science 2023-12-27 Jiangmeng Li , Yifan Jin , Hang Gao , Wenwen Qiang , Changwen Zheng , Fuchun Sun

Graph contrastive learning (GCL) has recently achieved substantial advancements. Existing GCL approaches compare two different ``views'' of the same graph in order to learn node/graph representations. The underlying assumption of these…

Machine Learning · Computer Science 2024-01-18 Gehang Zhang , Bowen Yu , Jiangxia Cao , Xinghua Zhang , Jiawei Sheng , Chuan Zhou , Tingwen Liu

Advanced graph neural networks have shown great potentials in graph classification tasks recently. Different from node classification where node embeddings aggregated from local neighbors can be directly used to learn node labels, graph…

Machine Learning · Computer Science 2022-03-16 Hao Jia , Junzhong Ji , Minglong Lei

Generalizable, transferrable, and robust representation learning on graph-structured data remains a challenge for current graph neural networks (GNNs). Unlike what has been developed for convolutional neural networks (CNNs) for image data,…

Machine Learning · Computer Science 2021-04-06 Yuning You , Tianlong Chen , Yongduo Sui , Ting Chen , Zhangyang Wang , Yang Shen

Graph representation learning (GRL) is critical for graph-structured data analysis. However, most of the existing graph neural networks (GNNs) heavily rely on labeling information, which is normally expensive to obtain in the real world.…

Machine Learning · Computer Science 2022-11-22 Yizhen Zheng , Ming Jin , Shirui Pan , Yuan-Fang Li , Hao Peng , Ming Li , Zhao Li

In recent years, graph neural networks (GNN) have achieved significant developments in a variety of graph analytical tasks. Nevertheless, GNN's superior performance will suffer from serious damage when the collected node features or…

Machine Learning · Computer Science 2023-09-07 Sichao Fu , Qinmu Peng , Yang He , Baokun Du , Xinge You

Recent years have seen a rapid growth of utilizing graph neural networks (GNNs) in the biomedical domain for tackling drug-related problems. However, like any other deep architectures, GNNs are data hungry. While requiring labels in real…

Biological Physics · Physics 2022-05-03 Mengying Sun , Jing Xing , Huijun Wang , Bin Chen , Jiayu Zhou

Graph contrastive learning (GCL) has recently emerged as a promising approach for graph representation learning. Some existing methods adopt the 1-vs-K scheme to construct one positive and K negative samples for each graph, but it is…

Machine Learning · Computer Science 2023-09-06 Minjie Chen , Yao Cheng , Ye Wang , Xiang Li , Ming Gao

We introduce a novel masked graph autoencoder (MGAE) framework to perform effective learning on graph structure data. Taking insights from self-supervised learning, we randomly mask a large proportion of edges and try to reconstruct these…

Machine Learning · Computer Science 2022-01-10 Qiaoyu Tan , Ninghao Liu , Xiao Huang , Rui Chen , Soo-Hyun Choi , Xia Hu

Graph Contrastive Learning (GCL) has recently drawn much research interest for learning generalizable node representations in a self-supervised manner. In general, the contrastive learning process in GCL is performed on top of the…

Machine Learning · Computer Science 2022-12-06 Kaize Ding , Yancheng Wang , Yingzhen Yang , Huan Liu

Self-supervised learning (SSL) has been extensively explored in recent years. Particularly, generative SSL has seen emerging success in natural language processing and other AI fields, such as the wide adoption of BERT and GPT. Despite…

Machine Learning · Computer Science 2022-07-14 Zhenyu Hou , Xiao Liu , Yukuo Cen , Yuxiao Dong , Hongxia Yang , Chunjie Wang , Jie Tang

Graph Neural Networks (GNNs) have become popular in Graph Representation Learning (GRL). One fundamental application is few-shot node classification. Most existing methods follow the meta learning paradigm, showing the ability of fast…

Machine Learning · Computer Science 2023-09-20 Hao Liu , Jiarui Feng , Lecheng Kong , Dacheng Tao , Yixin Chen , Muhan Zhang

We consider graph representation learning in a self-supervised manner. Graph neural networks (GNNs) use neighborhood aggregation as a core component that results in feature smoothing among nodes in proximity. While successful in various…

Machine Learning · Computer Science 2021-07-20 Wei Zhuo , Guang Tan

Contrastive Learning (CL) has emerged as a dominant technique for unsupervised representation learning which embeds augmented versions of the anchor close to each other (positive samples) and pushes the embeddings of other samples…

Artificial Intelligence · Computer Science 2022-06-15 Jun Xia , Lirong Wu , Ge Wang , Jintao Chen , Stan Z. Li

Graph contrastive learning (GCL) alleviates the heavy reliance on label information for graph representation learning (GRL) via self-supervised learning schemes. The core idea is to learn by maximising mutual information for similar…

Machine Learning · Computer Science 2022-10-18 Yizhen Zheng , Shirui Pan , Vincent Cs Lee , Yu Zheng , Philip S. Yu

Self-Supervised Contrastive Learning has proven effective in deriving high-quality representations from unlabeled data. However, a major challenge that hinders both unimodal and multimodal contrastive learning is feature suppression, a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jihai Zhang , Xiang Lan , Xiaoye Qu , Yu Cheng , Mengling Feng , Bryan Hooi

This study introduces the Multi-Scale Weight-Based Pairwise Coarsening and Contrastive Learning (MPCCL) model, a novel approach for attributed graph clustering that effectively bridges critical gaps in existing methods, including long-range…

Machine Learning · Computer Science 2025-07-29 Binxiong Li , Yuefei Wang , Binyu Zhao , Heyang Gao , Benhan Yang , Quanzhou Luo , Xue Li , Xu Xiang , Yujie Liu , Huijie Tang