English
Related papers

Related papers: Bootstrap Latents of Nodes and Neighbors for Graph…

200 papers

Graph Neural Networks (GNNs) have been widely used to learn node representations and with outstanding performance on various tasks such as node classification. However, noise, which inevitably exists in real-world graph data, would…

Machine Learning · Computer Science 2022-06-06 Yancheng Wang , Yingzhen Yang

Graph contrastive learning (GCL) has emerged as a pivotal technique in the domain of graph representation learning. A crucial aspect of effective GCL is the caliber of generated positive and negative samples, which is intrinsically dictated…

Machine Learning · Computer Science 2024-02-19 Xinjian Zhao , Liang Zhang , Yang Liu , Ruocheng Guo , Xiangyu Zhao

Graph Contrastive Learning (GCL) excels at managing noise and fluctuations in input data, making it popular in various fields (e.g., social networks, and knowledge graphs). Our study finds that the difference in high-frequency information…

Machine Learning · Computer Science 2024-10-15 Yuntao Shou , Xiangyong Cao , Deyu Meng

Graph Neural Networks (GNNs) have emerged as a powerful tool for representation learning on graphs, but they often suffer from overfitting and label noise issues, especially when the data is scarce or imbalanced. Different from the paradigm…

Machine Learning · Computer Science 2023-12-15 Yifan Li , Zhen Tan , Kai Shu , Zongsheng Cao , Yu Kong , Huan Liu

Graph Contrastive Learning (GCL) has shown promising performance in graph representation learning (GRL) without the supervision of manual annotations. GCL can generate graph-level embeddings by maximizing the Mutual Information (MI) between…

Machine Learning · Computer Science 2022-05-25 Jiawei Sun , Ruoxin Chen , Jie Li , Chentao Wu , Yue Ding , Junchi Yan

Recently, contrastive learning has been shown to be effective in improving pre-trained language models (PLM) to derive high-quality sentence representations. It aims to pull close positive examples to enhance the alignment while push apart…

Computation and Language · Computer Science 2022-05-03 Kun Zhou , Beichen Zhang , Wayne Xin Zhao , Ji-Rong Wen

Self-supervised learning is a machine learning approach that generates implicit labels by learning underlined patterns and extracting discriminative features from unlabeled data without manual labelling. Contrastive learning introduces the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Asifullah Khan , Laiba Asmatullah , Anza Malik , Shahzaib Khan , Hamna Asif

Graphs have become an important modeling tool for web applications, and Graph Neural Networks (GNNs) have achieved great success in graph representation learning. However, the performance of traditional GNNs heavily relies on a large amount…

Machine Learning · Computer Science 2024-06-05 Chenghua Gong , Xiang Li , Jianxiang Yu , Cheng Yao , Jiaqi Tan , Chengcheng Yu

Self-supervised learning has gained popularity because of its ability to avoid the cost of annotating large-scale datasets. It is capable of adopting self-defined pseudo labels as supervision and use the learned representations for several…

Computer Vision and Pattern Recognition · Computer Science 2021-02-09 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Debapriya Banerjee , Fillia Makedon

The rise of self-supervised learning, which operates without the need for labeled data, has garnered significant interest within the graph learning community. This enthusiasm has led to the development of numerous Graph Contrastive Learning…

Machine Learning · Computer Science 2024-02-27 Qian Ma , Hongliang Chi , Hengrui Zhang , Kay Liu , Zhiwei Zhang , Lu Cheng , Suhang Wang , Philip S. Yu , Yao Ma

Graph contrastive learning (GCL) has garnered significant attention recently since it learns complex structural information from graphs through self-supervised learning manner. However, prevalent GCL models may suffer from performance…

Machine Learning · Computer Science 2025-04-28 Xiaofan Wei , Binyan Zhang

Detecting ever-evolving social bots has become increasingly challenging. Advanced bots tend to interact more with humans as a camouflage to evade detection. While graph-based detection methods can exploit various relations in social…

Social and Information Networks · Computer Science 2024-08-29 Qi Wu , Yingguang Yang , Buyun He , Hao Liu , Renyu Yang , Yong Liao

Recent studies show that graph convolutional network (GCN) often performs worse for low-degree nodes, exhibiting the so-called structural unfairness for graphs with long-tailed degree distributions prevalent in the real world. Graph…

Machine Learning · Computer Science 2022-10-07 Ruijia Wang , Xiao Wang , Chuan Shi , Le Song

Graph Contrastive Learning (GCL) aims to learn node representations by aligning positive pairs and separating negative ones. However, few of researchers have focused on the inner law behind specific augmentations used in graph-based…

Machine Learning · Computer Science 2024-12-25 Jingyu Liu , Huayi Tang , Yong Liu

Pre-training Graph Neural Networks (GNN) via self-supervised contrastive learning has recently drawn lots of attention. However, most existing works focus on node-level contrastive learning, which cannot capture global graph structure. The…

Machine Learning · Computer Science 2021-04-19 Shichang Zhang , Ziniu Hu , Arjun Subramonian , Yizhou Sun

By treating users' interactions as a user-item graph, graph learning models have been widely deployed in Collaborative Filtering(CF) based recommendation. Recently, researchers have introduced Graph Contrastive Learning(GCL) techniques into…

Information Retrieval · Computer Science 2023-07-12 Yonghui Yang , Zhengwei Wu , Le Wu , Kun Zhang , Richang Hong , Zhiqiang Zhang , Jun Zhou , Meng Wang

Contrastive learning, especially self-supervised contrastive learning (SSCL), has achieved great success in extracting powerful features from unlabeled data. In this work, we contribute to the theoretical understanding of SSCL and uncover…

Machine Learning · Computer Science 2023-06-05 Tianyang Hu , Zhili Liu , Fengwei Zhou , Wenjia Wang , Weiran Huang

Recent empirical works have successfully used unlabeled data to learn feature representations that are broadly useful in downstream classification tasks. Several of these methods are reminiscent of the well-known word2vec embedding…

Machine Learning · Computer Science 2019-02-26 Sanjeev Arora , Hrishikesh Khandeparkar , Mikhail Khodak , Orestis Plevrakis , Nikunj Saunshi

Learning with noisy labels (LNL) has been extensively studied, with existing approaches typically following a framework that alternates between clean sample selection and semi-supervised learning (SSL). However, this approach has a…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Qing Miao , Xiaohe Wu , Chao Xu , Yanli Ji , Wangmeng Zuo , Yiwen Guo , Zhaopeng Meng

Graph Neural Networks (GNNs) have achieved promising performance in semi-supervised node classification in recent years. However, the problem of insufficient supervision, together with representation collapse, largely limits the performance…

Machine Learning · Computer Science 2025-03-07 Xihong Yang , Yiqi Wang , Yue Liu , Yi Wen , Lingyuan Meng , Sihang Zhou , Xinwang Liu , En Zhu