English
Related papers

Related papers: Self-attention Dual Embedding for Graphs with Hete…

200 papers

Graph Neural Networks (GNNs) often assume strong homophily for graph classification, seldom considering heterophily, which means connected nodes tend to have different class labels and dissimilar features. In real-world scenarios, graphs…

Machine Learning · Computer Science 2024-05-10 Jiayi Yang , Sourav Medya , Wei Ye

Graph Neural Networks (GNNs) have shown remarkable success in graph representation learning. Unfortunately, current weight assignment schemes in standard GNNs, such as the calculation based on node degrees or pair-wise representations, can…

Machine Learning · Computer Science 2024-07-02 Junfu Wang , Yuanfang Guo , Liang Yang , Yunhong Wang

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak

Recent years have witnessed fast developments of graph neural networks (GNNs) that have benefited myriad graph analytic tasks and applications. Most GNNs rely on the homophily assumption that nodes belonging to the same class are more…

Machine Learning · Computer Science 2026-04-21 Xin Zheng , Yi Wang , Yixin Liu , Ming Li , Miao Zhang , Di Jin , Philip S. Yu , Shirui Pan

Graph neural networks have become the standard approach for dealing with learning problems on graphs. Among the different variants of graph neural networks, graph attention networks (GATs) have been applied with great success to different…

Machine Learning · Computer Science 2023-07-18 Michail Chatzianastasis , Giannis Nikolentzos , Michalis Vazirgiannis

Graph Neural Networks (GNNs) are widely used on a variety of graph-based machine learning tasks. For node-level tasks, GNNs have strong power to model the homophily property of graphs (i.e., connected nodes are more similar) while their…

Machine Learning · Computer Science 2022-04-26 Lun Du , Xiaozhou Shi , Qiang Fu , Xiaojun Ma , Hengyu Liu , Shi Han , Dongmei Zhang

Graph neural networks (GNNs) have been widely adopted in engineering applications such as social network analysis, chemical research and computer vision. However, their efficacy is severely compromised by the inherent homophily assumption,…

Machine Learning · Computer Science 2026-04-13 Yi Luo , Xu Sun , Guangchun Luo , Aiguo Chen

Graph Neural Networks (GNNs) have achieved significant success in addressing node classification tasks. However, the effectiveness of traditional GNNs degrades on heterophilic graphs, where connected nodes often belong to different labels…

Machine Learning · Computer Science 2025-11-11 Asela Hevapathige , Asiri Wijesinghe , Ahad N. Zehmakan

Graph Neural Networks (GNNs) often struggle with heterophilic data, where connected nodes may have dissimilar labels, as they typically assume homophily and rely on local message passing. To address this, we propose creating alternative…

Machine Learning · Computer Science 2025-06-11 Victor M. Tenorio , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

Graph neural networks (GNNs) have demonstrated excellent performance in semi-supervised node classification tasks. Despite this, two primary challenges persist: heterogeneity and heterophily. Each of these two challenges can significantly…

Machine Learning · Computer Science 2025-04-14 Kangkang Lu , Yanhua Yu , Zhiyong Huang , Yunshan Ma , Xiao Wang , Meiyu Liang , Yuling Wang , Yimeng Ren , Tat-Seng Chua

Graph Neural Networks (GNNs) exhibit excellent performance when graphs have strong homophily property, i.e. connected nodes have the same labels. However, they perform poorly on heterophilic graphs. Several approaches address the issue of…

Machine Learning · Computer Science 2021-07-29 Vijay Lingam , Rahul Ragesh , Arun Iyer , Sundararajan Sellamanickam

We introduce Attention Graphs, a new tool for mechanistic interpretability of Graph Neural Networks (GNNs) and Graph Transformers based on the mathematical equivalence between message passing in GNNs and the self-attention mechanism in…

Machine Learning · Computer Science 2025-02-26 Batu El , Deepro Choudhury , Pietro Liò , Chaitanya K. Joshi

Graph neural networks (GNNs) have been extensively studied for prediction tasks on graphs. As pointed out by recent studies, most GNNs assume local homophily, i.e., strong similarities in local neighborhoods. This assumption however limits…

Machine Learning · Computer Science 2021-10-04 Sean Li , Dongwoo Kim , Qing Wang

Graph Neural Networks (GNNs) are deep learning methods which provide the current state of the art performance in node classification tasks. GNNs often assume homophily -- neighboring nodes having similar features and labels--, and therefore…

Machine Learning · Computer Science 2021-10-26 Liheng Ma , Reihaneh Rabbany , Adriana Romero-Soriano

Graph neural networks (GNNs) have shown great prowess in learning representations suitable for numerous graph-based machine learning tasks. When applied to semi-supervised node classification, GNNs are widely believed to work well due to…

Machine Learning · Computer Science 2023-07-24 Yao Ma , Xiaorui Liu , Neil Shah , Jiliang Tang

Under circumstances of heterophily, where nodes with different labels tend to be connected based on semantic meanings, Graph Neural Networks (GNNs) often exhibit suboptimal performance. Current studies on graph heterophily mainly focus on…

Machine Learning · Computer Science 2024-11-13 Yilun Zheng , Jiahao Xu , Lihui Chen

Graph Neural Networks (GNNs) have been predominant for graph learning tasks; however, recent studies showed that a well-known graph algorithm, Label Propagation (LP), combined with a shallow neural network can achieve comparable performance…

Machine Learning · Computer Science 2022-12-01 Zhiqiang Zhong , Sergey Ivanov , Jun Pang

Graph Neural Network (GNN) research has highlighted a relationship between high homophily (i.e., the tendency of nodes of the same class to connect) and strong predictive performance in node classification. However, recent work has found…

Social and Information Networks · Computer Science 2023-11-22 Donald Loveland , Jiong Zhu , Mark Heimann , Benjamin Fish , Michael T. Schaub , Danai Koutra

Graph Neural Networks (GNNs) have proven to be useful for many different practical applications. However, many existing GNN models have implicitly assumed homophily among the nodes connected in the graph, and therefore have largely…

Machine Learning · Computer Science 2021-06-16 Jiong Zhu , Ryan A. Rossi , Anup Rao , Tung Mai , Nedim Lipka , Nesreen K. Ahmed , Danai Koutra

Graph neural networks (GNN) have been ubiquitous in graph node classification tasks. Most of GNN methods update the node embedding iteratively by aggregating its neighbors' information. However, they often suffer from negative disturbance,…

Machine Learning · Computer Science 2022-02-02 Jie Chen , Shouzhen Chen , Mingyuan Bai , Jian Pu , Junping Zhang , Junbin Gao
‹ Prev 1 2 3 10 Next ›