English
Related papers

Related papers: Homophily modulates double descent generalization …

200 papers

Graph neural networks (GNNs) based methods have achieved impressive performance on node clustering task. However, they are designed on the homophilic assumption of graph and clustering on heterophilic graph is overlooked. Due to the lack of…

Social and Information Networks · Computer Science 2023-05-09 Erlin Pan , Zhao Kang

Graphs are structured data that models complex relations between real-world entities. Heterophilic graphs, where linked nodes are prone to be with different labels or dissimilar features, have recently attracted significant attention and…

Social and Information Networks · Computer Science 2025-03-21 Chenghua Gong , Yao Cheng , Jianxiang Yu , Can Xu , Caihua Shan , Siqiang Luo , Xiang Li

Although overparameterized models have achieved remarkable practical success, their theoretical properties, particularly their generalization behavior, remain incompletely understood. The well known double descents phenomenon suggests that…

Machine Learning · Statistics 2026-01-06 Haoran Zhan , Yingcun Xia

We study the task of node classification for graph neural networks (GNNs) and establish a connection between group fairness, as measured by statistical parity and equal opportunity, and local assortativity, i.e., the tendency of linked…

Social and Information Networks · Computer Science 2022-11-16 Donald Loveland , Jiong Zhu , Mark Heimann , Ben Fish , Michael T. Schaub , Danai Koutra

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

Disordered Systems and Neural Networks · Physics 2026-02-23 O. Duranthon , L. Zdeborová

Graph Neural Networks (GNNs) often struggle to generalize when graphs exhibit both homophily (same-class connections) and heterophily (different-class connections). Specifically, GNNs tend to underperform for nodes with local homophily…

Machine Learning · Computer Science 2024-10-08 Donald Loveland , Danai Koutra

Graph Neural Networks (GNNs) have received increasing attention for representation learning in various machine learning tasks. However, most existing GNNs applying neighborhood aggregation usually perform poorly on the graph with…

Machine Learning · Computer Science 2024-10-29 Wei Zhuo , Guang Tan

Graph neural networks (GNNs) have been widely adopted in engineering applications such as social network analysis, chemical research and computer vision. However, their efficacy is severely compromised by the inherent homophily assumption,…

Machine Learning · Computer Science 2026-04-13 Yi Luo , Xu Sun , Guangchun Luo , Aiguo Chen

The fundamental principle of Graph Neural Networks (GNNs) is to exploit the structural information of the data by aggregating the neighboring nodes using a `graph convolution' in conjunction with a suitable choice for the network…

Machine Learning · Computer Science 2023-11-01 Mahalakshmi Sabanayagam , Pascal Esser , Debarghya Ghoshdastidar

Graph Neural Networks (GNNs) have proven effective in various medical imaging applications, such as automated disease diagnosis. However, due to the local neighborhood aggregation paradigm in message passing which characterizes these…

Machine Learning · Computer Science 2024-11-05 K. Mancini , I. Rekik

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by using the graph structures based on the relational inductive bias (homophily assumption). Though GNNs are believed to outperform NNs in real-world tasks, performance…

Machine Learning · Computer Science 2021-09-14 Sitao Luan , Chenqing Hua , Qincheng Lu , Jiaqi Zhu , Mingde Zhao , Shuyuan Zhang , Xiao-Wen Chang , Doina Precup

Graph Neural Networks (GNNs) have achieved significant success in addressing node classification tasks. However, the effectiveness of traditional GNNs degrades on heterophilic graphs, where connected nodes often belong to different labels…

Machine Learning · Computer Science 2025-11-11 Asela Hevapathige , Asiri Wijesinghe , Ahad N. Zehmakan

Graph Neural Networks (GNNs) often assume strong homophily for graph classification, seldom considering heterophily, which means connected nodes tend to have different class labels and dissimilar features. In real-world scenarios, graphs…

Machine Learning · Computer Science 2024-05-10 Jiayi Yang , Sourav Medya , Wei Ye

In recent years, Graph Neural Networks (GNNs) have achieved remarkable success in tasks such as node classification, link prediction, and graph representation learning. However, they remain susceptible to biases that can arise not only from…

Machine Learning · Computer Science 2026-04-06 Mahdi Tavassoli Kejani , Fadi Dornaika , Charlotte Laclau , Jean-Michel Loubes

In node classification tasks, graph convolutional neural networks (GCNs) have demonstrated competitive performance over traditional methods on diverse graph data. However, it is known that the performance of GCNs degrades with increasing…

Machine Learning · Computer Science 2022-11-29 Yujun Yan , Milad Hashemi , Kevin Swersky , Yaoqing Yang , Danai Koutra

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by using graph structures based on the relational inductive bias (homophily assumption). While GNNs have been commonly believed to outperform NNs in real-world tasks, recent…

Machine Learning · Computer Science 2022-10-17 Sitao Luan , Chenqing Hua , Qincheng Lu , Jiaqi Zhu , Mingde Zhao , Shuyuan Zhang , Xiao-Wen Chang , Doina Precup

Despite the tremendous success of graph-based learning systems in handling structural data, it has been widely investigated that they are fragile to adversarial attacks on homophilic graph data, where adversaries maliciously modify the…

Machine Learning · Computer Science 2025-09-05 Yulin Zhu , Yuni Lai , Xing Ai , Wai Lun LO , Gaolei Li , Jianhua Li , Di Tang , Xingxing Zhang , Mengpei Yang , Kai Zhou

Graph Convolutional Network (GCN) has shown remarkable potential of exploring graph representation. However, the GCN aggregating mechanism fails to generalize to networks with heterophily where most nodes have neighbors from different…

Machine Learning · Computer Science 2021-12-30 Dongxiao He , Chundong Liang , Huixin Liu , Mingxiang Wen , Pengfei Jiao , Zhiyong Feng

Recent work has shown that a simple, fast method called Simple Graph Convolution (SGC) (Wu et al., 2019), which eschews deep learning, is competitive with deep methods like graph convolutional networks (GCNs) (Kipf & Welling, 2017) in…

Machine Learning · Computer Science 2022-06-07 Sudhanshu Chanpuriya , Cameron Musco

Over the past decade, Graph Neural Networks (GNNs) have achieved great success on machine learning tasks with relational data. However, recent studies have found that heterophily can cause significant performance degradation of GNNs,…

Machine Learning · Computer Science 2025-05-20 Sitao Luan , Qincheng Lu , Chenqing Hua , Xinyu Wang , Jiaqi Zhu , Xiao-Wen Chang