English
Related papers

Related papers: Uncovering Capabilities of Model Pruning in Graph …

200 papers

Graph contrastive learning has gained significant progress recently. However, existing works have rarely explored non-aligned node-node contrasting. In this paper, we propose a novel graph contrastive learning method named RoSA that focuses…

Machine Learning · Computer Science 2022-05-03 Yun Zhu , Jianhao Guo , Fei Wu , Siliang Tang

Graph learning models have demonstrated great prowess in learning expressive representations from large-scale graph data in a wide variety of real-world scenarios. As a prevalent strategy for training powerful graph learning models, the…

Machine Learning · Computer Science 2025-06-11 Xingbo Fu , Zehong Wang , Zihan Chen , Jiazheng Li , Yaochen Zhu , Zhenyu Lei , Cong Shen , Yanfang Ye , Chuxu Zhang , Jundong Li

We study self-supervised learning on graphs using contrastive methods. A general scheme of prior methods is to optimize two-view representations of input graphs. In many studies, a single graph-level representation is computed as one of the…

Machine Learning · Computer Science 2021-07-22 Xinyi Xu , Cheng Deng , Yaochen Xie , Shuiwang Ji

Graph anomaly detection aims to identify unusual patterns in graph-based data, with wide applications in fields such as web security and financial fraud detection. Existing methods typically rely on contrastive learning, assuming that a…

Machine Learning · Computer Science 2025-05-26 Di Jin , Jingyi Cao , Xiaobao Wang , Bingdao Feng , Dongxiao He , Longbiao Wang , Jianwu Dang

In recent years, the use of edge information provided by knowledge graphs together with the advantages of higher-order connectivity in graph neural networks for recommendation systems has become an important research direction. However,…

Information Retrieval · Computer Science 2026-05-12 Zhifei Hu , Feng Xia

Learning node-level representations of heterophilic graphs is crucial for various applications, including fraudster detection and protein function prediction. In such graphs, nodes share structural similarity identified by the equivalence…

Machine Learning · Computer Science 2023-08-22 Asif Khan , Amos Storkey

Graph classification is a critical research problem in many applications from different domains. In order to learn a graph classification model, the most widely used supervision component is an output layer together with classification loss…

Machine Learning · Computer Science 2021-01-15 Yuxiang Ren , Jiyang Bai , Jiawei Zhang

We study the impact of different pruning techniques on the representation learned by deep neural networks trained with contrastive loss functions. Our work finds that at high sparsity levels, contrastive learning results in a higher number…

Machine Learning · Computer Science 2022-07-04 Francesco Corti , Rahim Entezari , Sara Hooker , Davide Bacciu , Olga Saukh

Graph contrastive learning is usually performed by first conducting Graph Data Augmentation (GDA) and then employing a contrastive learning pipeline to train GNNs. As we know that GDA is an important issue for graph contrastive learning.…

Machine Learning · Computer Science 2024-01-09 Ziyan Zhang , Bo Jiang , Jin Tang , Bin Luo

With the increasing computation of training graph neural networks (GNNs) on large-scale graphs, graph condensation (GC) has emerged as a promising solution to synthesize a compact, substitute graph of the large-scale original graph for…

Machine Learning · Computer Science 2025-10-09 Xinyi Gao , Yayong Li , Tong Chen , Guanhua Ye , Wentao Zhang , Hongzhi Yin

The recent surge in contrast-based graph self-supervised learning has prominently featured an intensified exploration of spectral cues. Spectral augmentation, which involves modifying a graph's spectral properties such as eigenvalues or…

Machine Learning · Computer Science 2024-12-05 Xiangru Jian , Xinjian Zhao , Wei Pang , Chaolong Ying , Yimu Wang , Yaoyao Xu , Tianshu Yu

Transformations in the input space of Deep Neural Networks (DNN) lead to unintended changes in the feature space. Almost perceptually identical inputs, such as adversarial examples, can have significantly distant feature representations. On…

Machine Learning · Computer Science 2022-11-29 Iordanis Fostiropoulos , Laurent Itti

Anomaly detection on attributed networks attracts considerable research interests due to wide applications of attributed networks in modeling a wide range of complex systems. Recently, the deep learning-based anomaly detection methods have…

Machine Learning · Computer Science 2021-05-07 Yixin Liu , Zhao Li , Shirui Pan , Chen Gong , Chuan Zhou , George Karypis

Graph Contrastive Learning (GCL) relies on semantically consistent graph augmentations, but common local perturbations provide limited control over global structural consistency, motivating a more principled global augmentation strategy. We…

Machine Learning · Computer Science 2026-05-13 Nero Z. Li , Xuehao Zhai , Zhichao Shi , Boshen Shi , Xuhui Jiang

Recommendation systems have become indispensable in various online platforms, from e-commerce to streaming services. A fundamental challenge in this domain is learning effective embeddings from sparse user-item interactions. While…

Information Retrieval · Computer Science 2025-10-13 Yansong Wang , Qihui Lin , Junjie Huang , Tao Jia

Graph Neural Networks (GNNs) have achieved promising performance in semi-supervised node classification in recent years. However, the problem of insufficient supervision, together with representation collapse, largely limits the performance…

Machine Learning · Computer Science 2025-03-07 Xihong Yang , Yiqi Wang , Yue Liu , Yi Wen , Lingyuan Meng , Sihang Zhou , Xinwang Liu , En Zhu

Node representation learning has demonstrated its effectiveness for various applications on graphs. Particularly, recent developments in contrastive learning have led to promising results in unsupervised node representation learning for a…

Machine Learning · Computer Science 2021-06-11 Öykü Deniz Köse , Yanning Shen

Graph Contrastive Learning (GCL) has emerged as a powerful tool for extracting consistent representations from graphs, independent of labeled information. However, existing methods predominantly focus on undirected graphs, disregarding the…

Machine Learning · Computer Science 2025-10-21 Daohan Su , Yang Zhang , Xunkai Li , Rong-Hua Li , Guoren Wang

Graph representation learning plays a vital role in processing graph-structured data. However, prior arts on graph representation learning heavily rely on labeling information. To overcome this problem, inspired by the recent success of…

Machine Learning · Computer Science 2021-07-19 Ming Jin , Yizhen Zheng , Yuan-Fang Li , Chen Gong , Chuan Zhou , Shirui Pan

Pre-trained Language Models (PLMs) have achieved great success in various Natural Language Processing (NLP) tasks under the pre-training and fine-tuning paradigm. With large quantities of parameters, PLMs are computation-intensive and…

Computation and Language · Computer Science 2021-12-15 Runxin Xu , Fuli Luo , Chengyu Wang , Baobao Chang , Jun Huang , Songfang Huang , Fei Huang