English
Related papers

Related papers: Uncovering Capabilities of Model Pruning in Graph …

200 papers

Graph neural networks, a powerful deep learning tool to model graph-structured data, have demonstrated remarkable performance on numerous graph learning tasks. To address the data noise and data scarcity issues in deep graph learning, the…

Machine Learning · Computer Science 2022-11-22 Kaize Ding , Zhe Xu , Hanghang Tong , Huan Liu

Graph convolutional networks (GCNs) have well-documented performance in various graph learning tasks, but their analysis is still at its infancy. Graph scattering transforms (GSTs) offer training-free deep GCN models that extract features…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Vassilis N. Ioannidis , Siheng Chen , Georgios B. Giannakis

Spatial-temporal graph learning has emerged as a promising solution for modeling structured spatial-temporal data and learning region representations for various urban sensing tasks such as crime forecasting and traffic flow prediction.…

Machine Learning · Computer Science 2023-06-21 Qianru Zhang , Chao Huang , Lianghao Xia , Zheng Wang , Siuming Yiu , Ruihua Han

Graph Contrastive Learning (GCL) has shown promising performance in graph representation learning (GRL) without the supervision of manual annotations. GCL can generate graph-level embeddings by maximizing the Mutual Information (MI) between…

Machine Learning · Computer Science 2022-05-25 Jiawei Sun , Ruoxin Chen , Jie Li , Chentao Wu , Yue Ding , Junchi Yan

Contrastive learning is an effective unsupervised method in graph representation learning. Recently, the data augmentation based contrastive learning method has been extended from images to graphs. However, most prior works are directly…

Machine Learning · Computer Science 2023-12-19 Shengyu Feng , Baoyu Jing , Yada Zhu , Hanghang Tong

Graph autoencoders (GAEs) and graph contrastive learning (GCL) are two major paradigms for self-supervised representation learning on graphs, yet they are often studied in isolation and treated as fundamentally different approaches. In this…

Machine Learning · Computer Science 2026-05-28 Jintang Li , Ruofan Wu , Yuchang Zhu , Huizhe Zhang , Zulun Zhu , Liang Chen

In recent years, contrastive learning achieves impressive results on self-supervised visual representation learning, but there still lacks a rigorous understanding of its learning dynamics. In this paper, we show that if we cast a…

Machine Learning · Computer Science 2023-03-09 Yifei Wang , Qi Zhang , Tianqi Du , Jiansheng Yang , Zhouchen Lin , Yisen Wang

Human beings can quickly adapt to environmental changes by leveraging learning experience. However, the poor ability of adapting to dynamic environments remains a major challenge for AI models. To better understand this issue, we study the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Peng Su , Shixiang Tang , Peng Gao , Di Qiu , Ni Zhao , Xiaogang Wang

Due to the significant computational challenge of training large-scale graph neural networks (GNNs), various sparse learning techniques have been exploited to reduce memory and storage costs. Examples include \textit{graph sparsification}…

Machine Learning · Computer Science 2023-02-07 Shuai Zhang , Meng Wang , Pin-Yu Chen , Sijia Liu , Songtao Lu , Miao Liu

Graph representation learning (GRL) makes considerable progress recently, which encodes graphs with topological structures into low-dimensional embeddings. Meanwhile, the time-consuming and costly process of annotating graph labels manually…

Machine Learning · Computer Science 2024-02-28 Haojun Jiang , Jiawei Sun , Jie Li , Chentao Wu

Graph Neural Networks (GNNs) have achieved state-of-the-art performance in solving graph classification tasks. However, most GNN architectures aggregate information from all nodes and edges in a graph, regardless of their relevance to the…

Machine Learning · Statistics 2024-04-19 Pablo Sanchez-Martin , Kinaan Aamir Khan , Isabel Valera

Graph Neural Networks (GNNs) are recognized as potent tools for processing real-world data organized in graph structures. Especially inductive GNNs, which allow for the processing of graph-structured data without relying on predefined graph…

Machine Learning · Computer Science 2024-11-21 Marcin Podhajski , Jan Dubiński , Franziska Boenisch , Adam Dziedzic , Agnieszka Pregowska , Tomasz P. Michalak

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

Machine Learning · Computer Science 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Graph contrastive learning has shown great promise when labeled data is scarce, but large unlabeled datasets are available. However, it often does not take uncertainty estimation into account. We show that a variational Bayesian neural…

Machine Learning · Computer Science 2023-12-04 Alexander Möllers , Alexander Immer , Elvin Isufi , Vincent Fortuin

Graph Neural Networks (GNNs) are widely used in collaborative filtering to capture high-order user-item relationships. To address the data sparsity problem in recommendation systems, Graph Contrastive Learning (GCL) has emerged as a…

Information Retrieval · Computer Science 2025-07-11 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Wei Wang , Xiping Hu , Edith Ngai

Graphical models capture relations between entities in a wide range of applications including social networks, biology, and natural language processing, among others. Graph neural networks (GNN) are neural models that operate over graphs,…

Machine Learning · Computer Science 2024-02-08 Xu Zheng , Farhad Shirani , Tianchun Wang , Shouwei Gao , Wenqian Dong , Wei Cheng , Dongsheng Luo

Contrastive vision-language models, such as CLIP, have garnered considerable attention for various downstream tasks, mainly due to the remarkable ability of the learned features for generalization. However, the features they learned often…

Computer Vision and Pattern Recognition · Computer Science 2025-04-24 Yichao Cai , Yuhang Liu , Zhen Zhang , Javen Qinfeng Shi

Graph Contrastive Learning (GCL) has emerged as a promising approach in the realm of graph self-supervised learning. Prevailing GCL methods mainly derive from the principles of contrastive learning in the field of computer vision: modeling…

Machine Learning · Computer Science 2023-08-03 Zhiyuan Ning , Pengfei Wang , Pengyang Wang , Ziyue Qiao , Wei Fan , Denghui Zhang , Yi Du , Yuanchun Zhou

Heterogeneous Graphs (HGs) effectively model complex relationships in the real world through multi-type nodes and edges. In recent years, inspired by self-supervised learning (SSL), contrastive learning (CL)-based Heterogeneous Graphs…

Machine Learning · Computer Science 2025-05-06 Yu Wang , Lei Sang , Yi Zhang , Yiwen Zhang , Xindong Wu

Graph matching has important applications in pattern recognition and beyond. Current approaches predominantly adopt supervised learning, demanding extensive labeled data which can be limited or costly. Meanwhile, self-supervised learning…

Machine Learning · Computer Science 2024-06-26 Jianyuan Bo , Yuan Fang