English
Related papers

Related papers: Self-attention Dual Embedding for Graphs with Hete…

200 papers

This paper presents a novel graph-based deep learning model for tasks involving relations between two nodes (edge-centric tasks), where the focus lies on predicting relationships and interactions between pairs of nodes rather than node…

Machine Learning · Computer Science 2025-07-08 Eugenio Borzone , Leandro Di Persia , Matias Gerard

Graph heterophily, where connected nodes have different labels, has attracted significant interest recently. Most existing works adopt a simplified approach - using low-pass filters for homophilic graphs and high-pass filters for…

Machine Learning · Computer Science 2025-10-14 Shuaicheng Zhang , Haohui Wang , Junhong Lin , Xiaojie Guo , Yada Zhu , Si Zhang , Dongqi Fu , Dawei Zhou

We investigate the representation power of graph neural networks in the semi-supervised node classification task under heterophily or low homophily, i.e., in networks where connected nodes may have different class labels and dissimilar…

Machine Learning · Computer Science 2020-10-26 Jiong Zhu , Yujun Yan , Lingxiao Zhao , Mark Heimann , Leman Akoglu , Danai Koutra

Graph Neural Networks (GNNs) exploit signals from node features and the input graph topology to improve node classification task performance. However, these models tend to perform poorly on heterophilic graphs, where connected nodes have…

Machine Learning · Computer Science 2021-12-08 Vijay Lingam , Chanakya Ekbote , Manan Sharma , Rahul Ragesh , Arun Iyer , Sundararajan Sellamanickam

In representation learning on graph-structured data, many popular graph neural networks (GNNs) fail to capture long-range dependencies, leading to performance degradation. Furthermore, this weakness is magnified when the concerned graph is…

Machine Learning · Computer Science 2024-03-07 Mengying Jiang , Guizhong Liu , Yuanchao Su , Xinliang Wu

Graph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data across various domains. Despite their great successful, one critical challenge is often overlooked by existing works, i.e., the…

Machine Learning · Computer Science 2024-02-15 Tianxiang Zhao , Xiang Zhang , Suhang Wang

Graph convolutional networks (GCNs) have shown the powerful ability in text structure representation and effectively facilitate the task of text classification. However, challenges still exist in adapting GCN on learning discriminative…

Machine Learning · Computer Science 2019-12-02 Xueya Zhang , Tong Zhang , Wenting Zhao , Zhen Cui , Jian Yang

Graph Transformer (GT), as a special type of Graph Neural Networks (GNNs), utilizes multi-head attention to facilitate high-order message passing. However, this also imposes several limitations in node classification applications: 1) nodes…

Machine Learning · Computer Science 2024-10-16 Jiajun Zhou , Xuanze Chen , Chenxuan Xie , Yu Shanqing , Qi Xuan , Xiaoniu Yang

Graph Neural Networks (GNNs) are popular machine learning methods for modeling graph data. A lot of GNNs perform well on homophily graphs while having unsatisfactory performance on heterophily graphs. Recently, some researchers turn their…

Machine Learning · Computer Science 2022-09-20 Wendong Bi , Lun Du , Qiang Fu , Yanlin Wang , Shi Han , Dongmei Zhang

Graphs can model real-world, complex systems by representing entities and their interactions in terms of nodes and edges. To better exploit the graph structure, graph neural networks have been developed, which learn entity and edge…

Machine Learning · Computer Science 2022-06-06 Tong Liu , Yushan Liu , Marcel Hildebrandt , Mitchell Joblin , Hang Li , Volker Tresp

This paper addresses the challenging problem of retrieval and matching of graph structured objects, and makes two key contributions. First, we demonstrate how Graph Neural Networks (GNN), which have emerged as an effective model for various…

Machine Learning · Computer Science 2019-05-14 Yujia Li , Chenjie Gu , Thomas Dullien , Oriol Vinyals , Pushmeet Kohli

Self-supervised learning has shown its promising capability in graph representation learning in recent work. Most existing pre-training strategies usually choose the popular Graph neural networks (GNNs), which can be seen as a special form…

Machine Learning · Computer Science 2023-06-16 Yilin Ding , Zhen Liu , Hao Hao

Graph neural networks (GNNs) have gained traction over the past few years for their superior performance in numerous machine learning tasks. Graph Convolutional Neural Networks (GCN) are a common variant of GNNs that are known to have high…

Machine Learning · Computer Science 2022-07-06 Sannat Singh Bhasin , Vaibhav Holani , Divij Sanjanwala

We bridge two research directions on graph neural networks (GNNs), by formalizing the relation between heterophily of node labels (i.e., connected nodes tend to have dissimilar labels) and the robustness of GNNs to adversarial attacks. Our…

Machine Learning · Computer Science 2022-07-26 Jiong Zhu , Junchen Jin , Donald Loveland , Michael T. Schaub , Danai Koutra

Attention-based graph neural networks (GNNs), such as graph attention networks (GATs), have become popular neural architectures for processing graph-structured data and learning node embeddings. Despite their empirical success, these models…

Machine Learning · Statistics 2023-06-07 Dexiong Chen , Paolo Pellizzoni , Karsten Borgwardt

Graph Convolutional Networks (GCNs) gained traction for graph representation learning, with recent attention on improving performance on heterophilic graphs for various real-world applications. The localized feature aggregation in a typical…

Machine Learning · Computer Science 2025-07-30 Garv Kaushik

Previous studies have demonstrated the strong performance of Graph Neural Networks (GNNs) in node classification. However, most existing GNNs adopt a node-centric perspective and rely on global message passing, leading to high computational…

Machine Learning · Computer Science 2026-01-14 Qian Zeng , Xin Lin , Jingyi Gao , Yang Yu

Graph-based semi-supervised node classification has been shown to become a state-of-the-art approach in many applications with high research value and significance. Most existing methods are only based on the original intrinsic or…

Machine Learning · Computer Science 2023-06-08 Jianpeng Liao , Jun Yan , Qian Tao

Graph Convolutional Networks (GCNs) are predominantly tailored for graphs displaying homophily, where similar nodes connect, but often fail on heterophilic graphs. The strategy of adopting distinct approaches to learn from homophilic and…

Machine Learning · Computer Science 2025-04-09 Han Lei , Jiaxing Xu , Xia Dong , Yiping Ke

Graph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data but often struggle on heterophilous graphs, where connected nodes differ in features or class labels. This limitation arises from…

Machine Learning · Computer Science 2025-09-30 Zhongtian Sun , Anoushka Harit , Alexandra Cristea , Christl A. Donnelly , Pietro Liò