English
Related papers

Related papers: Heterophily-Aware Graph Attention Network

200 papers

Due to the homophily assumption in graph convolution networks (GNNs), a common consensus in the graph node classification task is that GNNs perform well on homophilic graphs but may fail on heterophilic graphs with many inter-class edges.…

Machine Learning · Computer Science 2023-04-18 Jie Chen , Shouzhen Chen , Junbin Gao , Zengfeng Huang , Junping Zhang , Jian Pu

Graph Neural Networks (GNNs) have become pivotal tools for a range of graph-based learning tasks. Notably, most current GNN architectures operate under the assumption of homophily, whether explicitly or implicitly. While this underlying…

Machine Learning · Computer Science 2024-06-19 Kun Wang , Guibin Zhang , Xinnan Zhang , Junfeng Fang , Xun Wu , Guohao Li , Shirui Pan , Wei Huang , Yuxuan Liang

Graph neural networks (GNN) have been ubiquitous in graph node classification tasks. Most of GNN methods update the node embedding iteratively by aggregating its neighbors' information. However, they often suffer from negative disturbance,…

Machine Learning · Computer Science 2022-02-02 Jie Chen , Shouzhen Chen , Mingyuan Bai , Jian Pu , Junping Zhang , Junbin Gao

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by using the graph structures based on the relational inductive bias (homophily assumption). Though GNNs are believed to outperform NNs in real-world tasks, performance…

Machine Learning · Computer Science 2021-09-14 Sitao Luan , Chenqing Hua , Qincheng Lu , Jiaqi Zhu , Mingde Zhao , Shuyuan Zhang , Xiao-Wen Chang , Doina Precup

The message-passing mechanism underlying Graph Neural Networks (GNNs) is not naturally suited for heterophilic datasets, where adjacent nodes often have different labels. Most solutions to this problem remain confined to the task of node…

Machine Learning · Computer Science 2025-06-30 Andrea Giuseppe Di Francesco , Francesco Caso , Maria Sofia Bucarelli , Fabrizio Silvestri

Although hypergraph neural networks (HGNNs) have emerged as a powerful framework for analyzing complex datasets, their practical performance often remains limited. On one hand, existing networks typically employ a single type of attention…

Machine Learning · Computer Science 2025-11-14 Murong Yang , Shihui Ying , Yue Gao , Xin-Jian Xu

Local Attention-guided Message Passing Mechanism (LAMP) adopted in Graph Attention Networks (GATs) is designed to adaptively learn the importance of neighboring nodes for better local aggregation on the graph, which can bring the…

Machine Learning · Computer Science 2024-06-18 Silu He , Qinyao Luo , Xinsha Fu , Ling Zhao , Ronghua Du , Haifeng Li

Graph neural networks (GNNs) have proven effective in capturing relationships among nodes in a graph. This study introduces a novel perspective by considering a graph as a simplicial complex, encompassing nodes, edges, triangles, and…

Machine Learning · Computer Science 2024-04-23 Jinghan Huang , Qiufeng Chen , Yijun Bian , Pengli Zhu , Nanguang Chen , Moo K. Chung , Anqi Qiu

In recent years, Graph Neural Networks (GNNs) have achieved remarkable success in tasks such as node classification, link prediction, and graph representation learning. However, they remain susceptible to biases that can arise not only from…

Machine Learning · Computer Science 2026-04-06 Mahdi Tavassoli Kejani , Fadi Dornaika , Charlotte Laclau , Jean-Michel Loubes

Graph neural networks (GNNs) have been proved powerful in graph-oriented tasks. However, many real-world graphs are heterophilous, challenging the homophily assumption of classical GNNs. To solve the universality problem, many studies…

Machine Learning · Computer Science 2023-10-09 Shengbo Gong , Jiajun Zhou , Chenxuan Xie , Qi Xuan

Graph Neural Networks (GNNs) have emerged as a promising tool to handle data exhibiting an irregular structure. However, most GNN architectures perform well on homophilic datasets, where the labels of neighboring nodes are likely to be the…

Machine Learning · Computer Science 2024-12-03 Victor M. Tenorio , Madeline Navarro , Samuel Rey , Santiago Segarra , Antonio G. Marques

Graph Convolutional Networks (GCNs) gained traction for graph representation learning, with recent attention on improving performance on heterophilic graphs for various real-world applications. The localized feature aggregation in a typical…

Machine Learning · Computer Science 2025-07-30 Garv Kaushik

We present graph attention networks (GATs), novel neural network architectures that operate on graph-structured data, leveraging masked self-attentional layers to address the shortcomings of prior methods based on graph convolutions or…

Machine Learning · Statistics 2018-02-06 Petar Veličković , Guillem Cucurull , Arantxa Casanova , Adriana Romero , Pietro Liò , Yoshua Bengio

Variants of Graph Neural Networks (GNNs) for representation learning have been proposed recently and achieved fruitful results in various fields. Among them, Graph Attention Network (GAT) first employs a self-attention strategy to learn…

Machine Learning · Computer Science 2021-07-28 Heng Chang , Yu Rong , Tingyang Xu , Wenbing Huang , Somayeh Sojoudi , Junzhou Huang , Wenwu Zhu

With the rapid development of the World Wide Web (WWW), heterogeneous graphs (HG) have explosive growth. Recently, heterogeneous graph neural network (HGNN) has shown great potential in learning on HG. Current studies of HGNN mainly focus…

Social and Information Networks · Computer Science 2023-02-27 Jiayan Guo , Lun Du , Wendong Bi , Qiang Fu , Xiaojun Ma , Xu Chen , Shi Han , Dongmei Zhang , Yan Zhang

Graph Neural Networks (GNNs) have been predominant for graph learning tasks; however, recent studies showed that a well-known graph algorithm, Label Propagation (LP), combined with a shallow neural network can achieve comparable performance…

Machine Learning · Computer Science 2022-12-01 Zhiqiang Zhong , Sergey Ivanov , Jun Pang

Graph Neural Networks (GNNs) update node representations through message passing, which is primarily based on the homophily principle, assuming that adjacent nodes share similar features. However, in real-world graphs with long-tailed…

Artificial Intelligence · Computer Science 2025-04-22 Van Thuy Hoang , Hyeon-Ju Jeon , O-Joun Lee

Graphs with heterophily have been regarded as challenging scenarios for Graph Neural Networks (GNNs), where nodes are connected with dissimilar neighbors through various patterns. In this paper, we present theoretical understandings of the…

Machine Learning · Computer Science 2024-06-05 Junfu Wang , Yuanfang Guo , Liang Yang , Yunhong Wang

Graph Neural Networks (GNNs) have emerged as the de facto standard for modeling graph data, with attention mechanisms and transformers significantly enhancing their performance on graph-based tasks. Despite these advancements, the…

Machine Learning · Computer Science 2025-04-07 Nikhil Shivakumar Nayak

Stock selection is important for investors to construct profitable portfolios. Graph neural networks (GNNs) are increasingly attracting researchers for stock prediction due to their strong ability of relation modelling and generalisation.…

Statistical Finance · Quantitative Finance 2023-06-28 Yang Qiao , Yiping Xia , Xiang Li , Zheng Li , Yan Ge