English
Related papers

Related papers: Supervised Attention Using Homophily in Graph Neur…

200 papers

Graph attention networks (GATs) are widely used and often appear robust to noise in node covariates and edges, yet rigorous statistical guarantees demonstrating a provable advantage of GATs over non-attention graph neural networks~(GNNs)…

Machine Learning · Statistics 2026-02-02 Somak Laha , Suqi Liu , Morgane Austern

Graphs with heterophily have been regarded as challenging scenarios for Graph Neural Networks (GNNs), where nodes are connected with dissimilar neighbors through various patterns. In this paper, we present theoretical understandings of the…

Machine Learning · Computer Science 2024-06-05 Junfu Wang , Yuanfang Guo , Liang Yang , Yunhong Wang

Graph neural networks (GNNs) have shown advantages in graph-based analysis tasks. However, most existing methods have the homogeneity assumption and show poor performance on heterophilic graphs, where the linked nodes have dissimilar…

Machine Learning · Computer Science 2024-04-16 Tianhao Peng , Wenjun Wu , Haitao Yuan , Zhifeng Bao , Zhao Pengrui , Xin Yu , Xuetao Lin , Yu Liang , Yanjun Pu

This paper presents a contextualized graph attention network that combines edge features and multiple sub-graphs for improving relation extraction. A novel method is proposed to use multiple sub-graphs to learn rich node representations in…

Computation and Language · Computer Science 2020-04-23 Angrosh Mandya , Danushka Bollegala , Frans Coenen

Graph Neural Networks (GNNs) have greatly advanced the semi-supervised node classification task on graphs. The majority of existing GNNs are trained in an end-to-end manner that can be viewed as tackling a bi-level optimization problem.…

Machine Learning · Computer Science 2023-07-20 Haoyu Han , Xiaorui Liu , Haitao Mao , MohamadAli Torkamani , Feng Shi , Victor Lee , Jiliang Tang

How can we find the right graph for semi-supervised learning? In real world applications, the choice of which edges to use for computation is the first step in any graph learning process. Interestingly, there are often many types of…

Machine Learning · Computer Science 2020-07-24 Jonathan Halcrow , Alexandru Moşoi , Sam Ruth , Bryan Perozzi

Node classification is an essential problem in graph learning. However, many models typically obtain unsatisfactory performance when applied to few-shot scenarios. Some studies have attempted to combine meta-learning with graph neural…

Machine Learning · Computer Science 2024-07-23 Yonghao Liu , Mengyu Li , Ximing Li , Lan Huang , Fausto Giunchiglia , Yanchun Liang , Xiaoyue Feng , Renchu Guan

The irreducible complexity of natural phenomena has led Graph Neural Networks to be employed as a standard model to perform representation learning tasks on graph-structured data. While their capacity to capture local and global patterns is…

Machine Learning · Computer Science 2024-02-13 Lorenzo Giusti

Graph neural networks (GNNs) have gained traction over the past few years for their superior performance in numerous machine learning tasks. Graph Convolutional Neural Networks (GCN) are a common variant of GNNs that are known to have high…

Machine Learning · Computer Science 2022-07-06 Sannat Singh Bhasin , Vaibhav Holani , Divij Sanjanwala

Studying peer relationships is crucial in solving complex challenges underserved communities face and designing interventions. The effectiveness of such peer-based interventions relies on accurate network data regarding individual…

Social and Information Networks · Computer Science 2025-03-27 Ajitesh Srivastava , Aryan Shetty , Eric Rice

Affinity graphs are widely used in deep architectures, including graph convolutional neural networks and attention networks. Thus far, the literature has focused on abstracting features from such graphs, while the learning of the affinities…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Chu Wang , Babak Samari , Vladimir G. Kim , Siddhartha Chaudhuri , Kaleem Siddiqi

Graph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data but often struggle on heterophilous graphs, where connected nodes differ in features or class labels. This limitation arises from…

Machine Learning · Computer Science 2025-09-30 Zhongtian Sun , Anoushka Harit , Alexandra Cristea , Christl A. Donnelly , Pietro Liò

We investigate graph neural networks on graphs with heterophily. Some existing methods amplify a node's neighborhood with multi-hop neighbors to include more nodes with homophily. However, it is a significant challenge to set personalized…

Machine Learning · Computer Science 2022-05-17 Xiang Li , Renyu Zhu , Yao Cheng , Caihua Shan , Siqiang Luo , Dongsheng Li , Weining Qian

Graph Neural Networks (GNNs) have been widely studied for graph data representation and learning. However, existing GNNs generally conduct context-aware learning on node feature representation only which usually ignores the learning of edge…

Machine Learning · Computer Science 2019-10-07 Bo Jiang , Leiling Wang , Jin Tang , Bin Luo

Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by using the graph structures based on the relational inductive bias (homophily assumption). Though GNNs are believed to outperform NNs in real-world tasks, performance…

Machine Learning · Computer Science 2021-09-14 Sitao Luan , Chenqing Hua , Qincheng Lu , Jiaqi Zhu , Mingde Zhao , Shuyuan Zhang , Xiao-Wen Chang , Doina Precup

Graph Neural Networks have shown excellent performance on semi-supervised classification tasks. However, they assume access to a graph that may not be often available in practice. In the absence of any graph, constructing k-Nearest Neighbor…

Machine Learning · Computer Science 2021-02-23 Vijay Lingam , Arun Iyer , Rahul Ragesh

Graph Neural Networks (GNNs) for prediction tasks like node classification or edge prediction have received increasing attention in recent machine learning from graphically structured data. However, a large quantity of labeled graphs is…

Machine Learning · Computer Science 2021-11-22 Yuexin Wu , Yichong Xu , Aarti Singh , Yiming Yang , Artur Dubrawski

Graph Attention Network (GAT) focuses on modelling simple undirected and single relational graph data only. This limits its ability to deal with more general and complex multi-relational graphs that contain entities with directed links of…

Artificial Intelligence · Computer Science 2021-09-14 Meiqi Chen , Yuan Zhang , Xiaoyu Kou , Yuntao Li , Yan Zhang

Graph heterophily, where connected nodes have different labels, has attracted significant interest recently. Most existing works adopt a simplified approach - using low-pass filters for homophilic graphs and high-pass filters for…

Machine Learning · Computer Science 2025-10-14 Shuaicheng Zhang , Haohui Wang , Junhong Lin , Xiaojie Guo , Yada Zhu , Si Zhang , Dongqi Fu , Dawei Zhou

Anomaly analytics is a popular and vital task in various research contexts, which has been studied for several decades. At the same time, deep learning has shown its capacity in solving many graph-based tasks like, node classification, link…

Machine Learning · Computer Science 2022-12-13 Jing Ren , Feng Xia , Azadeh Noori Hoshyar , Charu C. Aggarwal