English
Related papers

Related papers: Towards Training GNNs using Explanation Directed M…

200 papers

Graph Neural Networks (GNNs) are a powerful tool for machine learning on graphs.GNNs combine node feature information with the graph structure by recursively passing neural messages along edges of the input graph. However, incorporating…

Machine Learning · Computer Science 2019-11-15 Rex Ying , Dylan Bourgeois , Jiaxuan You , Marinka Zitnik , Jure Leskovec

Graph neural networks (GNNs) have demonstrated significant promise in modelling relational data and have been widely applied in various fields of interest. The key mechanism behind GNNs is the so-called message passing where information is…

Machine Learning · Computer Science 2023-10-31 Andi Han , Dai Shi , Lequan Lin , Junbin Gao

Graph Convolutional Networks (GCNs) are known to suffer from performance degradation as the number of layers increases, which is usually attributed to over-smoothing. Despite the apparent consensus, we observe that there exists a…

Machine Learning · Computer Science 2021-10-29 Weilin Cong , Morteza Ramezani , Mehrdad Mahdavi

Oversmoothing in Graph Neural Networks (GNNs) refers to the phenomenon where increasing network depth leads to homogeneous node representations. While previous work has established that Graph Convolutional Networks (GCNs) exponentially lose…

Machine Learning · Computer Science 2024-06-05 Xinyi Wu , Amir Ajorlou , Zihui Wu , Ali Jadbabaie

Presently with technology node scaling, an accurate prediction model at early design stages can significantly reduce the design cycle. Especially during logic synthesis, predicting cell congestion due to improper logic combination can…

Machine Learning · Computer Science 2021-11-12 Amur Ghose , Vincent Zhang , Yingxue Zhang , Dong Li , Wulong Liu , Mark Coates

Message passing graph neural networks (GNNs) are a popular learning architectures for graph-structured data. However, one problem GNNs experience is oversquashing, where a GNN has difficulty sending information between distant nodes.…

Machine Learning · Computer Science 2023-06-07 Mitchell Black , Zhengchao Wan , Amir Nayyeri , Yusu Wang

Message-passing graph neural networks (MPGNNs) dominate modern graph learning. Typical efforts enhance MPGNN's expressive power by enriching the adjacency-based aggregation. In contrast, we introduce an efficient aggregation over walk…

Machine Learning · Computer Science 2025-09-29 Marek Černý

Graph Neural Networks (GNNs) have become a popular approach for various applications, ranging from social network analysis to modeling chemical properties of molecules. While GNNs often show remarkable performance on public datasets, they…

Machine Learning · Computer Science 2022-02-03 Krzysztof Sadowski , Michał Szarmach , Eddie Mattia

Graph Neural Networks (GNNs) are powerful deep learning methods for Non-Euclidean data. Popular GNNs are message-passing algorithms (MPNNs) that aggregate and combine signals in a local graph neighborhood. However, shallow MPNNs tend to…

Machine Learning · Statistics 2022-11-08 Ningyuan Huang , Soledad Villar , Carey E. Priebe , Da Zheng , Chengyue Huang , Lin Yang , Vladimir Braverman

Graph neural networks (GNNs) for link prediction can loosely be divided into two broad categories. First, \emph{node-wise} architectures pre-compute individual embeddings for each node that are later combined by a simple decoder to make…

Machine Learning · Computer Science 2024-12-31 Yuxin Wang , Xiannian Hu , Quan Gan , Xuanjing Huang , Xipeng Qiu , David Wipf

Message Passing Neural Networks (MPNNs) are instances of Graph Neural Networks that leverage the graph to send messages over the edges. This inductive bias leads to a phenomenon known as over-squashing, where a node feature is insensitive…

Machine Learning · Computer Science 2023-05-25 Francesco Di Giovanni , Lorenzo Giusti , Federico Barbero , Giulia Luise , Pietro Lio' , Michael Bronstein

Graph Neural Network (GNN) resembles the diffusion process, leading to the over-smoothing of learned representations when stacking many layers. Hence, the reverse process of message passing can produce the distinguishable node…

Social and Information Networks · Computer Science 2024-06-12 MoonJeong Park , Jaeseung Heo , Dongwoo Kim

This paper studies asynchronous message passing (AMP), a new paradigm for applying neural network based learning to graphs. Existing graph neural networks use the synchronous distributed computing model and aggregate their neighbors in each…

Machine Learning · Computer Science 2022-05-25 Lukas Faber , Roger Wattenhofer

While graph neural networks (GNNs) have allowed researchers to successfully apply neural networks to non-Euclidean domains, deep GNNs often exhibit lower predictive performance than their shallow counterparts. This phenomena has been…

Machine Learning · Computer Science 2025-05-20 Keqin Wang , Yulong Yang , Ishan Saha , Christine Allen-Blanchette

Uncovering rationales behind predictions of graph neural networks (GNNs) has received increasing attention over recent years. Instance-level GNN explanation aims to discover critical input elements, like nodes or edges, that the target GNN…

Machine Learning · Computer Science 2022-12-20 Tianxiang Zhao , Dongsheng Luo , Xiang Zhang , Suhang Wang

Long-range interactions are essential for the correct description of complex systems in many scientific fields. The price to pay for including them in the calculations, however, is a dramatic increase in the overall computational costs.…

We propose Dynamically Pruned Message Passing Networks (DPMPN) for large-scale knowledge graph reasoning. In contrast to existing models, embedding-based or path-based, we learn an input-dependent subgraph to explicitly model reasoning…

Artificial Intelligence · Computer Science 2020-04-09 Xiaoran Xu , Wei Feng , Yunsheng Jiang , Xiaohui Xie , Zhiqing Sun , Zhi-Hong Deng

Among the many variants of graph neural network (GNN) architectures capable of modeling data with cross-instance relations, an important subclass involves layers designed such that the forward pass iteratively reduces a graph-regularized…

Machine Learning · Computer Science 2025-03-03 Haitian Jiang , Renjie Liu , Zengfeng Huang , Yichuan Wang , Xiao Yan , Zhenkun Cai , Minjie Wang , David Wipf

Graph Neural Networks (GNNs), originally proposed for node classification, have also motivated many recent works on edge prediction (a.k.a., link prediction). However, existing methods lack elaborate design regarding the distinctions…

Machine Learning · Computer Science 2024-01-24 Jiarui Jin , Yangkun Wang , Weinan Zhang , Quan Gan , Xiang Song , Yong Yu , Zheng Zhang , David Wipf

Graph Neural Networks (GNNs) have shown great power in various domains. However, their predictions may inherit societal biases on sensitive attributes, limiting their adoption in real-world applications. Although many efforts have been…

Machine Learning · Computer Science 2023-06-21 Huaisheng Zhu , Guoji Fu , Zhimeng Guo , Zhiwei Zhang , Teng Xiao , Suhang Wang