English
Related papers

Related papers: Teaching Yourself: Graph Self-Distillation on Neig…

200 papers

Recent years have witnessed great success in handling graph-related tasks with Graph Neural Networks (GNNs). However, most existing GNNs are based on message passing to perform feature aggregation and transformation, where the structural…

Machine Learning · Computer Science 2024-09-10 Lirong Wu , Haitao Lin , Guojiang Zhao , Cheng Tan , Stan Z. Li

Graph Neural Network (GNN) research has highlighted a relationship between high homophily (i.e., the tendency of nodes of the same class to connect) and strong predictive performance in node classification. However, recent work has found…

Social and Information Networks · Computer Science 2023-11-22 Donald Loveland , Jiong Zhu , Mark Heimann , Benjamin Fish , Michael T. Schaub , Danai Koutra

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is…

Machine Learning · Computer Science 2021-10-19 Langzhang Liang , Cuiyun Gao , Shiyi Chen , Shishi Duan , Yu pan , Junjin Zheng , Lei Wang , Zenglin Xu

We focus on graph classification using a graph neural network (GNN) model that precomputes the node features using a bank of neighborhood aggregation graph operators arranged in parallel. These GNN models have a natural advantage of reduced…

Machine Learning · Computer Science 2022-11-23 Siddhant Doshi , Sundeep Prabhakar Chepuri

Graph neural networks (GNNs), which learn the representation of a node by aggregating its neighbors, have become an effective computational tool in downstream applications. Over-smoothing is one of the key issues which limit the performance…

Machine Learning · Computer Science 2020-06-15 Kaixiong Zhou , Xiao Huang , Yuening Li , Daochen Zha , Rui Chen , Xia Hu

Integrating the structural inductive biases of Graph Neural Networks (GNNs) with the global contextual modeling capabilities of Transformers represents a pivotal challenge in graph representation learning. While GNNs excel at capturing…

Machine Learning · Computer Science 2025-03-05 Zhihua Duan , Jialin Wang

Graph neural networks (GNNs) are being increasingly used in many high-stakes tasks, and as a result, there is growing attention on their fairness recently. GNNs have been shown to be unfair as they tend to make discriminatory decisions…

Machine Learning · Computer Science 2023-11-30 Yuchang Zhu , Jintang Li , Liang Chen , Zibin Zheng

Graph neural networks (GNNs) have drawn increasing attention in recent years and achieved remarkable performance in many graph-based tasks, especially in semi-supervised learning on graphs. However, most existing GNNs are based on the…

Machine Learning · Computer Science 2024-01-24 Li Zhou , Wenyu Chen , Dingyi Zeng , Shaohuan Cheng , Wanlong Liu , Malu Zhang , Hong Qu

Graph Neural Networks (GNNs) are pivotal in graph-based learning, particularly excelling in node classification. However, their scalability is hindered by the need for multi-hop data during inference, limiting their application in…

Machine Learning · Computer Science 2025-05-30 Ziang Zhou , Zhihao Ding , Jieming Shi , Qing Li , Shiqi Shen

Graph Neural Networks (GNNs) have recently become the predominant tools for studying graph data. Despite state-of-the-art performance on graph classification tasks, GNNs are overwhelmingly trained in a single domain under supervision, thus…

Machine Learning · Computer Science 2025-02-18 Tao Wen , Elynn Chen , Yuzhou Chen , Qi Lei

Graph Neural Networks (GNNs) have demonstrated strong performance in graph representation learning across various real-world applications. However, they often produce biased predictions caused by sensitive attributes, such as religion or…

Machine Learning · Computer Science 2025-10-28 Chengyu Li , Debo Cheng , Guixian Zhang , Yi Li , Shichao Zhang

Graph Neural Networks (GNNs) have shown advantages in various graph-based applications. Most existing GNNs assume strong homophily of graph structure and apply permutation-invariant local aggregation of neighbors to learn a representation…

Machine Learning · Computer Science 2022-01-04 Tianmeng Yang , Yujing Wang , Zhihan Yue , Yaming Yang , Yunhai Tong , Jing Bai

Although graph neural networks (GNNs) have made great progress recently on learning from graph-structured data in practice, their theoretical guarantee on generalizability remains elusive in the literature. In this paper, we provide a…

Machine Learning · Computer Science 2020-06-26 Shuai Zhang , Meng Wang , Sijia Liu , Pin-Yu Chen , Jinjun Xiong

Graph Convolutional Neural Networks (GCNs) possess strong capabilities for processing graph data in non-grid domains. They can capture the topological logical structure and node features in graphs and integrate them into nodes' final…

Machine Learning · Computer Science 2024-03-26 Yinwei Wu

Predicting molecular properties with data-driven methods has drawn much attention in recent years. Particularly, Graph Neural Networks (GNNs) have demonstrated remarkable success in various molecular generation and prediction tasks. In…

Quantitative Methods · Quantitative Biology 2021-10-19 Zaixi Zhang , Qi Liu , Hao Wang , Chengqiang Lu , Chee-Kong Lee

Graph Convolutional Networks (GCN) is a pioneering model for graph-based semi-supervised learning. However, GCN does not perform well on sparsely-labeled graphs. Its two-layer version cannot effectively propagate the label information to…

Machine Learning · Computer Science 2025-02-24 Wei Ye , Zexi Huang , Yunqi Hong , Ambuj Singh

Graph Neural Nets (GNNs) have received increasing attentions, partially due to their superior performance in many node and graph classification tasks. However, there is a lack of understanding on what they are learning and how sophisticated…

Machine Learning · Computer Science 2020-06-11 Ting Chen , Song Bian , Yizhou Sun

Knowledge distillation (KD) has shown to be effective to boost the performance of graph neural networks (GNNs), where the typical objective is to distill knowledge from a deeper teacher GNN into a shallower student GNN. However, it is often…

Machine Learning · Computer Science 2023-11-17 Kaituo Feng , Yikun Miao , Changsheng Li , Ye Yuan , Guoren Wang

Graph Neural Networks (GNNs) have already been widely applied in various graph mining tasks. However, they suffer from the shallow architecture issue, which is the key impediment that hinders the model performance improvement. Although…

Machine Learning · Computer Science 2021-08-03 Wentao Zhang , Zeang Sheng , Yuezihan Jiang , Yikuan Xia , Jun Gao , Zhi Yang , Bin Cui

Knowledge distillation (KD) has shown great potential for transferring knowledge from a complex teacher model to a simple student model in which the heavy learning task can be accomplished efficiently and without losing too much prediction…

Machine Learning · Computer Science 2023-07-14 Dai Shi , Zhiqi Shao , Yi Guo , Junbin Gao