English
Related papers

Related papers: ROD: Reception-aware Online Distillation for Spars…

200 papers

Over the past few years, graph representation learning (GRL) has been a powerful strategy for analyzing graph-structured data. Recently, GRL methods have shown promising results by adopting self-supervised learning methods developed for…

Machine Learning · Computer Science 2022-09-05 Namkyeong Lee , Dongmin Hyun , Junseok Lee , Chanyoung Park

Graph neural networks (GNN) have been ubiquitous in graph node classification tasks. Most of GNN methods update the node embedding iteratively by aggregating its neighbors' information. However, they often suffer from negative disturbance,…

Machine Learning · Computer Science 2022-02-02 Jie Chen , Shouzhen Chen , Mingyuan Bai , Jian Pu , Junping Zhang , Junbin Gao

Graph neural networks (GNNs) have become a powerful tool for processing graph-structured data but still face challenges in effectively aggregating and propagating information between layers, which limits their performance. We tackle this…

Machine Learning · Computer Science 2023-02-09 Maxim Fishman , Chaim Baskin , Evgenii Zheltonozhskii , Almog David , Ron Banner , Avi Mendelson

Many applications of machine learning require a model to make accurate pre-dictions on test examples that are distributionally different from training ones, while task-specific labels are scarce during training. An effective approach to…

Machine Learning · Computer Science 2020-02-20 Weihua Hu , Bowen Liu , Joseph Gomes , Marinka Zitnik , Percy Liang , Vijay Pande , Jure Leskovec

The success of graph neural networks on graph-based web mining highly relies on abundant human-annotated data, which is laborious to obtain in practice. When only few labeled nodes are available, how to improve their robustness is a key to…

Machine Learning · Computer Science 2022-12-13 Kaize Ding , Elnaz Nouri , Guoqing Zheng , Huan Liu , Ryen White

Due to the significant computational challenge of training large-scale graph neural networks (GNNs), various sparse learning techniques have been exploited to reduce memory and storage costs. Examples include \textit{graph sparsification}…

Machine Learning · Computer Science 2023-02-07 Shuai Zhang , Meng Wang , Pin-Yu Chen , Sijia Liu , Songtao Lu , Miao Liu

Teaching Graph Neural Networks (GNNs) to accurately classify nodes under severely noisy labels is an important problem in real-world graph learning applications, but is currently underexplored. Although pairwise training methods have…

Machine Learning · Computer Science 2023-06-06 Xuefeng Du , Tian Bian , Yu Rong , Bo Han , Tongliang Liu , Tingyang Xu , Wenbing Huang , Yixuan Li , Junzhou Huang

Graph Neural Networks (GNNs) have shown satisfying performance on various graph learning tasks. To achieve better fitting capability, most GNNs are with a large number of parameters, which makes these GNNs computationally expensive.…

Machine Learning · Computer Science 2023-01-05 Yushun Dong , Binchi Zhang , Yiling Yuan , Na Zou , Qi Wang , Jundong Li

Graph representation learning (GRL) is critical for graph-structured data analysis. However, most of the existing graph neural networks (GNNs) heavily rely on labeling information, which is normally expensive to obtain in the real world.…

Machine Learning · Computer Science 2022-11-22 Yizhen Zheng , Ming Jin , Shirui Pan , Yuan-Fang Li , Hao Peng , Ming Li , Zhao Li

Representation learning on heterogeneous graphs aims to obtain meaningful node representations to facilitate various downstream tasks, such as node classification and link prediction. Existing heterogeneous graph learning methods are…

Machine Learning · Computer Science 2022-04-19 Le Yu , Leilei Sun , Bowen Du , Chuanren Liu , Weifeng Lv , Hui Xiong

Graph Neural Networks (GNNs) have garnered considerable interest due to their exceptional performance in a wide range of graph machine learning tasks. Nevertheless, the majority of GNN-based approaches have been examined using…

Machine Learning · Computer Science 2023-09-27 Jingyang Yuan , Xiao Luo , Yifang Qin , Zhengyang Mao , Wei Ju , Ming Zhang

Graph neural networks (GNNs) have exhibited exceptional efficacy in a diverse array of applications. However, the sheer size of large-scale graphs presents a significant challenge to real-time inference with GNNs. Although existing Scalable…

Machine Learning · Computer Science 2023-12-13 Xinyi Gao , Wentao Zhang , Junliang Yu , Yingxia Shao , Quoc Viet Hung Nguyen , Bin Cui , Hongzhi Yin

Graph neural networks (GNNs) learn to represent nodes by aggregating information from their neighbors. As GNNs increase in depth, their receptive field grows exponentially, leading to high memory costs. Several existing methods address this…

Machine Learning · Computer Science 2025-07-16 Taraneh Younesian , Daniel Daza , Emile van Krieken , Thiviyan Thanapalasingam , Peter Bloem

Graph neural networks (GNNs) have attracted widespread attention for their impressive capability of graph representation learning. However, the increasing prevalence of large-scale graphs presents a significant challenge for GNN training…

Machine Learning · Computer Science 2025-05-13 Xinyi Gao , Hongzhi Yin , Tong Chen , Guanhua Ye , Wentao Zhang , Bin Cui

For large-scale applications, there is growing interest in replacing Graph Neural Networks (GNNs) with lightweight Multi-Layer Perceptrons (MLPs) via knowledge distillation. However, distilling GNNs for self-supervised graph representation…

Machine Learning · Computer Science 2025-10-07 Seong Jin Ahn , Myoung-Ho Kim

Graph neural networks (GNNs) have become one of the most popular research topics in both academia and industry communities for their strong ability in handling irregular graph data. However, large-scale datasets are posing great challenges…

Machine Learning · Computer Science 2022-10-26 Jiongyu Guo , Defang Chen , Can Wang

Graph neural networks (GNNs) have been widely used in various graph machine learning scenarios. Existing literature primarily assumes well-annotated training graphs, while the reliability of labels is not guaranteed in real-world scenarios.…

Machine Learning · Computer Science 2026-01-27 Yusheng Zhao , Jiaye Xie , Qixin Zhang , Weizhi Zhang , Xiao Luo , Zhiping Xiao , Philip S. Yu , Ming Zhang

Knowledge distillation (KD) has shown to be effective to boost the performance of graph neural networks (GNNs), where the typical objective is to distill knowledge from a deeper teacher GNN into a shallower student GNN. However, it is often…

Machine Learning · Computer Science 2023-11-17 Kaituo Feng , Yikun Miao , Changsheng Li , Ye Yuan , Guoren Wang

Graph neural networks (GNNs) have exhibited prominent performance in learning graph-structured data. Considering node classification task, based on the i.i.d assumption among node labels, the traditional supervised learning simply sums up…

Machine Learning · Computer Science 2024-05-28 Rui Miao , Kaixiong Zhou , Yili Wang , Ninghao Liu , Ying Wang , Xin Wang

Graph Neural Networks (GNNs) have emerged as effective tools for learning tasks on graph-structured data. Recently, Graph-Informed (GI) layers were introduced to address regression tasks on graph nodes, extending their applicability beyond…

Machine Learning · Computer Science 2024-03-21 Francesco Della Santa