English
Related papers

Related papers: Cold Brew: Distilling Graph Node Representations w…

200 papers

Graph Neural Networks (GNNs) are deep-learning architectures designed for graph-type data, where understanding relationships among individual observations is crucial. However, achieving promising GNN performance, especially on unseen data,…

Machine Learning · Computer Science 2024-05-22 Lequan Lin , Dai Shi , Andi Han , Zhiyong Wang , Junbin Gao

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

The objective of unsupervised graph representation learning (GRL) is to learn a low-dimensional space of node embeddings that reflect the structure of a given unlabeled graph. Existing algorithms for this task rely on negative sampling…

Machine Learning · Computer Science 2021-01-22 M. Maruf , Anuj Karpatne

Graph diffusion models have recently been proposed to synthesize entire graphs, such as molecule graphs. Although existing methods have shown great performance in generating entire graphs for graph-level learning tasks, no graph diffusion…

Machine Learning · Computer Science 2025-03-18 Yancheng Wang , Changyu Liu , Yingzhen Yang

Models with similar performances exhibit significant disagreement in the predictions of individual samples, referred to as prediction churn. Our work explores this phenomenon in graph neural networks by investigating differences between…

Machine Learning · Computer Science 2023-10-03 Andreas Roth , Thomas Liebig

Student dropout is a significant challenge in educational systems worldwide, leading to substantial social and economic costs. Predicting students at risk of dropout allows for timely interventions. While traditional Machine Learning (ML)…

Machine Learning · Computer Science 2026-01-16 Pablo G. Almeida , Guilherme A. L. Silva , Valéria Santos , Gladston Moreira , Pedro Silva , Eduardo Luz

Given the importance of getting calibrated predictions and reliable uncertainty estimations, various post-hoc calibration methods have been developed for neural networks on standard multi-class classification tasks. However, these methods…

Machine Learning · Computer Science 2022-10-13 Hans Hao-Hsun Hsu , Yuesong Shen , Christian Tomani , Daniel Cremers

Scalability of graph neural networks remains one of the major challenges in graph machine learning. Since the representation of a node is computed by recursively aggregating and transforming representation vectors of its neighboring nodes…

Machine Learning · Computer Science 2021-06-10 Zengfeng Huang , Shengzhong Zhang , Chong Xi , Tang Liu , Min Zhou

Homophily principle, i.e., nodes with the same labels are more likely to be connected, has been believed to be the main reason for the performance superiority of Graph Neural Networks (GNNs) over Neural Networks on node classification…

Social and Information Networks · Computer Science 2024-01-03 Sitao Luan , Chenqing Hua , Minkai Xu , Qincheng Lu , Jiaqi Zhu , Xiao-Wen Chang , Jie Fu , Jure Leskovec , Doina Precup

Graph neural network (GNN) is a powerful learning approach for graph-based recommender systems. Recently, GNNs integrated with contrastive learning have shown superior performance in recommendation with their data augmentation schemes,…

Information Retrieval · Computer Science 2023-06-16 Xuheng Cai , Chao Huang , Lianghao Xia , Xubin Ren

Graph Neural Networks (GNNs) have made significant advances on several fundamental inference tasks. As a result, there is a surge of interest in using these models for making potentially important decisions in high-regret applications.…

Machine Learning · Computer Science 2020-02-26 Kaidi Xu , Sijia Liu , Pin-Yu Chen , Mengshu Sun , Caiwen Ding , Bhavya Kailkhura , Xue Lin

Graph condensation (GC) has become a vital strategy for scaling Graph Neural Networks by compressing massive datasets into small, synthetic node sets. While current GC methods effectively maintain predictive accuracy, they are primarily…

Machine Learning · Computer Science 2026-03-31 Yihan Gao , Chenxi Huang , Wen Shi , Ke Sun , Ziqi Xu , Xikun Zhang , Mingliang Hou , Renqiang Luo

Graph Neural Network (GNN) is an emerging technique for graph-based learning tasks such as node classification. In this work, we reveal the vulnerability of GNN to the imbalance of node labels. Traditional solutions for imbalanced…

Machine Learning · Computer Science 2022-02-08 Xiaohe Li , Lijie Wen , Yawen Deng , Fuli Feng , Xuming Hu , Lei Wang , Zide Fan

Graph neural networks (GNNs) are powerful tools for analyzing and learning from graph-structured (GS) data, facilitating a wide range of services. Deploying such services in privacy-critical cloud environments necessitates the development…

Cryptography and Security · Computer Science 2025-11-05 Fuyi Wang , Zekai Chen , Mingyuan Fan , Jianying Zhou , Lei Pan , Leo Yu Zhang

Graph data often contain noisy and spurious correlations that mask the true causal relationships, which are essential for enabling graph models to make predictions based on the underlying causal structure of the data. Dependence on spurious…

Machine Learning · Computer Science 2026-02-23 Simi Job , Xiaohui Tao , Taotao Cai , Haoran Xie , Jianming Yong

Graph Neural Networks (GNNs) have achieved significant success in machine learning, with wide applications in social networks, bioinformatics, knowledge graphs, and other fields. Most research assumes ideal closed-set environments. However,…

Machine Learning · Computer Science 2025-03-04 Yicong Dong , Rundong He , Guangyao Chen , Wentao Zhang , Zhongyi Han , Jieming Shi , Yilong Yin

Graph Neural Networks (GNNs) are powerful at solving graph classification tasks, yet applied problems often contain noisy labels. In this work, we study GNN robustness to label noise, demonstrate GNN failure modes when models struggle to…

Graph Neural Networks (GNNs) have achieved unprecedented success in identifying categorical labels of graphs. However, most existing graph classification problems with GNNs follow the protocol of balanced data splitting, which misaligns…

Machine Learning · Computer Science 2022-09-29 Yu Wang , Yuying Zhao , Neil Shah , Tyler Derr

Recommendation systems aim to provide personalized predictions by identifying items that are most appealing to individual users. Among various recommendation approaches, k-nearest-neighbor (kNN)-based collaborative filtering (CF) remains…

Information Retrieval · Computer Science 2025-12-16 Yongyu Wang

We investigate the classification performance of graph neural networks with graph-polynomial features, poly-GNNs, on the problem of semi-supervised node classification. We analyze poly-GNNs under a general contextual stochastic block model…

Machine Learning · Computer Science 2024-07-30 Luciano Vinas , Arash A. Amini