English
Related papers

Related papers: Neighbourhood Transformer: Switchable Attention fo…

200 papers

Graph Neural Networks (GNNs) have become a central tool for learning on graph-structured data, yet their applicability to real-world systems remains limited by key challenges such as scalability, temporality, directionality, data…

Machine Learning · Computer Science 2025-10-28 Emanuele Rossi

Towards the challenging problem of semi-supervised node classification, there have been extensive studies. As a frontier, Graph Neural Networks (GNNs) have aroused great interest recently, which update the representation of each node by…

Machine Learning · Computer Science 2020-05-12 Huaxiu Yao , Chuxu Zhang , Ying Wei , Meng Jiang , Suhang Wang , Junzhou Huang , Nitesh V. Chawla , Zhenhui Li

Transformers have attained outstanding performance across various modalities, owing to their simple but powerful scaled-dot-product (SDP) attention mechanisms. Researchers have attempted to migrate Transformers to graph learning, but most…

Machine Learning · Computer Science 2026-01-30 Liheng Ma , Soumyasundar Pal , Yingxue Zhang , Philip H. S. Torr , Mark Coates

Graph neural networks (GNNs) have shown promising results across various graph learning tasks, but they often assume homophily, which can result in poor performance on heterophilic graphs. The connected nodes are likely to be from different…

Machine Learning · Computer Science 2023-05-31 Kai Zhao , Qiyu Kang , Yang Song , Rui She , Sijie Wang , Wee Peng Tay

A large number of real-world networks include multiple types of nodes and edges. Graph Neural Network (GNN) emerged as a deep learning framework to generate node and graph embeddings for downstream machine learning tasks. However, popular…

Machine Learning · Computer Science 2024-11-26 Ziynet Nesibe Kesimoglu , Serdar Bozdag

Graph neural networks (GNNs) are widely used in domains like social networks and biological systems. However, the locality assumption of GNNs, which limits information exchange to neighboring nodes, hampers their ability to capture…

Machine Learning · Computer Science 2023-07-04 Tingting Dan , Jiaqi Ding , Ziquan Wei , Shahar Z Kovalsky , Minjeong Kim , Won Hwa Kim , Guorong Wu

Graph neural networks (GNN) have been ubiquitous in graph node classification tasks. Most of GNN methods update the node embedding iteratively by aggregating its neighbors' information. However, they often suffer from negative disturbance,…

Machine Learning · Computer Science 2022-02-02 Jie Chen , Shouzhen Chen , Mingyuan Bai , Jian Pu , Junping Zhang , Junbin Gao

Local neighborhoods play a crucial role in embedding generation in graph-based learning. It is commonly believed that nodes ought to have embeddings that resemble those of their neighbors. In this research, we try to carefully expand the…

Social and Information Networks · Computer Science 2024-01-04 Yassin Mohamadi , Mostafa Haghir Chehreghani

Graph Neural Networks (GNNs) have emerged as powerful tools for learning on graph-structured data, but often struggle to balance local and global information. While graph Transformers aim to address this by enabling long-range interactions,…

Machine Learning · Computer Science 2025-11-18 Jeongwhan Choi , Seungjun Park , Sumin Park , Sung-Bae Cho , Noseong Park

Heterogeneous graphs (HGs) are common in real-world scenarios and often exhibit heterophily. However, most existing studies focus on either heterogeneity or heterophily in isolation, overlooking the prevalence of heterophilic HGs in…

Machine Learning · Computer Science 2025-08-11 Qin Chen , Guojie Song

Graph Neural Networks (GNNs) have garnered significant attention for their success in learning the representation of homophilic or heterophilic graphs. However, they cannot generalize well to real-world graphs with different levels of…

Machine Learning · Computer Science 2024-03-07 Bingheng Li , Xuanting Xie , Haoxiang Lei , Ruiyi Fang , Zhao Kang

Recently, neighbor-based contrastive learning has been introduced to effectively exploit neighborhood information for clustering. However, these methods rely on the homophily assumption-that connected nodes share similar class labels and…

Social and Information Networks · Computer Science 2025-12-23 Liang Peng , Yixuan Ye , Cheng Liu , Hangjun Che , Man-Fai Leung , Si Wu , Hau-San Wong

Heterophily has been considered as an issue that hurts the performance of Graph Neural Networks (GNNs). To address this issue, some existing work uses a graph-level weighted fusion of the information of multi-hop neighbors to include more…

Machine Learning · Computer Science 2023-06-21 Yuhan Chen , Yihong Luo , Jing Tang , Liang Yang , Siya Qiu , Chuan Wang , Xiaochun Cao

Recently popularized graph neural networks achieve the state-of-the-art accuracy on a number of standard benchmark datasets for graph-based semi-supervised learning, improving significantly over existing approaches. These architectures…

Machine Learning · Statistics 2018-03-13 Kiran K. Thekumparampil , Chong Wang , Sewoong Oh , Li-Jia Li

We study the task of node classification for graph neural networks (GNNs) and establish a connection between group fairness, as measured by statistical parity and equal opportunity, and local assortativity, i.e., the tendency of linked…

Social and Information Networks · Computer Science 2022-11-16 Donald Loveland , Jiong Zhu , Mark Heimann , Ben Fish , Michael T. Schaub , Danai Koutra

Node classification is a classical graph machine learning task on which Graph Neural Networks (GNNs) have recently achieved strong results. However, it is often believed that standard GNNs only work well for homophilous graphs, i.e., graphs…

Machine Learning · Computer Science 2024-03-05 Oleg Platonov , Denis Kuznedelev , Michael Diskin , Artem Babenko , Liudmila Prokhorenkova

Graph Neural Networks (GNNs) have gained popularity in various learning tasks, with successful applications in fields like molecular biology, transportation systems, and electrical grids. These fields naturally use graph data, benefiting…

Machine Learning · Computer Science 2024-09-23 Caio F. Deberaldini Netto , Zhiyang Wang , Luana Ruiz

We bridge two research directions on graph neural networks (GNNs), by formalizing the relation between heterophily of node labels (i.e., connected nodes tend to have dissimilar labels) and the robustness of GNNs to adversarial attacks. Our…

Machine Learning · Computer Science 2022-07-26 Jiong Zhu , Junchen Jin , Donald Loveland , Michael T. Schaub , Danai Koutra

Graph Neural Networks (GNNs) have shown impressive performance in graph representation learning, but they face challenges in capturing long-range dependencies due to their limited expressive power. To address this, Graph Transformers (GTs)…

Machine Learning · Computer Science 2024-06-19 Kaan Sancak , Zhigang Hua , Jin Fang , Yan Xie , Andrey Malevich , Bo Long , Muhammed Fatih Balin , Ümit V. Çatalyürek

The dominant graph neural networks (GNNs) over-rely on the graph links, several serious performance problems with which have been witnessed already, e.g., suspended animation problem and over-smoothing problem. What's more, the inherently…

Machine Learning · Computer Science 2020-01-23 Jiawei Zhang , Haopeng Zhang , Congying Xia , Li Sun