English
Related papers

Related papers: Simple yet Effective Graph Distillation via Cluste…

200 papers

Federated training of Graph Neural Networks (GNN) has become popular in recent years due to its ability to perform graph-related tasks under data isolation scenarios while preserving data privacy. However, graph heterogeneity issues in…

Machine Learning · Computer Science 2023-09-22 Qiying Pan , Ruofan Wu , Tengfei Liu , Tianyi Zhang , Yifei Zhu , Weiqiang Wang

Graph Neural Networks (GNNs) are deep-learning architectures designed for graph-type data, where understanding relationships among individual observations is crucial. However, achieving promising GNN performance, especially on unseen data,…

Machine Learning · Computer Science 2024-05-22 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

Current modularity-based community detection algorithms attempt to find cluster memberships that maximize modularity within a fixed graph topology. Diverging from this conventional approach, our work introduces a novel strategy that employs…

Data Analysis, Statistics and Probability · Physics 2024-02-27 Yongyu Wang , Shiqi Hao , Xiaoyang Wang , Xiaotian Zhuang

Graph Convolution Networks (GCNs) have significantly succeeded in learning user and item representations for recommendation systems. The core of their efficacy is the ability to explicitly exploit the collaborative signals from both the…

Information Retrieval · Computer Science 2024-11-11 Fan Liu , Shuai Zhao , Zhiyong Cheng , Liqiang Nie , Mohan Kankanhalli

Graph convolutional networks (GCNs) have well-documented performance in various graph learning tasks, but their analysis is still at its infancy. Graph scattering transforms (GSTs) offer training-free deep GCN models that extract features…

Signal Processing · Electrical Eng. & Systems 2020-01-28 Vassilis N. Ioannidis , Siheng Chen , Georgios B. Giannakis

Recently, there has been considerable research interest in graph clustering aimed at data partition using the graph information. However, one limitation of the most of graph-based methods is that they assume the graph structure to operate…

Social and Information Networks · Computer Science 2022-11-11 Yiming Wang , Dongxia Chang , Zhiqian Fu , Yao Zhao

Using huge training datasets can be costly and inconvenient. This article explores various data distillation techniques that can reduce the amount of data required to successfully train deep networks. Inspired by recent ideas, we suggest…

Machine Learning · Computer Science 2022-03-17 Dmitry Medvedev , Alexander D'yakonov

Graph classification is a challenging problem owing to the difficulty in quantifying the similarity between graphs or representing graphs as vectors, though there have been a few methods using graph kernels or graph neural networks (GNNs).…

Machine Learning · Computer Science 2024-08-22 Zixiao Wang , Jicong Fan

Dataset distillation or condensation refers to compressing a large-scale dataset into a much smaller one, enabling models trained on this synthetic dataset to generalize effectively on real data. Tackling this challenge, as defined, relies…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Ruonan Yu , Songhua Liu , Jingwen Ye , Xinchao Wang

Graph Convolutional Networks (GCNs) have achieved impressive empirical advancement across a wide variety of semi-supervised node classification tasks. Despite their great success, training GCNs on large graphs suffers from computational and…

Machine Learning · Computer Science 2021-11-02 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi

Graph neural networks (GNNs) demonstrate a robust capability for representation learning on graphs with complex structures, showcasing superior performance in various applications. The majority of existing GNNs employ a graph convolution…

Machine Learning · Computer Science 2025-02-19 Jinlu Wang , Jipeng Guo , Yanfeng Sun , Junbin Gao , Shaofan Wang , Yachao Yang , Baocai Yin

Knowledge Distillation (KD) aims at transferring knowledge from a larger well-optimized teacher network to a smaller learnable student network.Existing KD methods have mainly considered two types of knowledge, namely the individual…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Sheng Zhou , Yucheng Wang , Defang Chen , Jiawei Chen , Xin Wang , Can Wang , Jiajun Bu

Recently, there has been increasing interest in the challenge of how to discriminatively vectorize graphs. To address this, we propose a method called Iterative Graph Self-Distillation (IGSD) which learns graph-level representation in an…

Machine Learning · Computer Science 2023-01-05 Hanlin Zhang , Shuai Lin , Weiyang Liu , Pan Zhou , Jian Tang , Xiaodan Liang , Eric P. Xing

Graph Neural Networks (GNNs) have shown significant success for graph-based tasks. Motivated by the prevalence of large datasets in real-world applications, pooling layers are crucial components of GNNs. By reducing the size of input…

Machine Learning · Computer Science 2026-01-13 Katharina Limbeck , Lydia Mezrag , Guy Wolf , Bastian Rieck

Graph convolutional networks (GCNs) have recently achieved great empirical success in learning graph-structured data. To address its scalability issue due to the recursive embedding of neighboring features, graph topology sampling has been…

Machine Learning · Computer Science 2023-12-12 Hongkang Li , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Convolution Neural Network (CNN) has gained tremendous success in computer vision tasks with its outstanding ability to capture the local latent features. Recently, there has been an increasing interest in extending convolution operations…

Machine Learning · Computer Science 2018-11-09 Guokun Lai , Hanxiao Liu , Yiming Yang

Distributed Graph Neural Network (GNN) training suffers from substantial communication overhead due to the inherent neighborhood dependency in graph-structured data. This neighbor explosion problem requires workers to frequently exchange…

Distributed, Parallel, and Cluster Computing · Computer Science 2026-01-27 Zizhao Zhang , Yihan Xue , Haotian Zhu , Sijia Li , Zhijun Wang , Yujie Xiao

Graph clustering is an important unsupervised learning technique for partitioning graphs with attributes and detecting communities. However, current methods struggle to accurately capture true community structures and intra-cluster…

Machine Learning · Computer Science 2024-11-19 Samarth Bhatia , Yukti Makhija , Manoj Kumar , Sandeep Kumar

This paper studies the problem of graph-level clustering, which is a novel yet challenging task. This problem is critical in a variety of real-world applications such as protein clustering and genome analysis in bioinformatics. Recent years…

Machine Learning · Computer Science 2023-03-09 Wei Ju , Yiyang Gu , Binqi Chen , Gongbo Sun , Yifang Qin , Xingyuming Liu , Xiao Luo , Ming Zhang

Contemporary machine learning requires training large neural networks on massive datasets and thus faces the challenges of high computational demands. Dataset distillation, as a recent emerging strategy, aims to compress real-world datasets…

Computer Vision and Pattern Recognition · Computer Science 2024-03-20 Peng Sun , Bei Shi , Daiwei Yu , Tao Lin