English
Related papers

Related papers: Probing Graph Neural Network Activation Patterns T…

200 papers

Graph neural networks (GNNs) are effective machine learning models for many graph-related applications. Despite their empirical success, many research efforts focus on the theoretical limitations of GNNs, i.e., the GNNs expressive power.…

Machine Learning · Computer Science 2025-01-13 Bingxu Zhang , Changjun Fan , Shixuan Liu , Kuihua Huang , Xiang Zhao , Jincai Huang , Zhong Liu

Despite much research, Graph Neural Networks (GNNs) still do not display the favorable scaling properties of other deep neural networks such as Convolutional Neural Networks and Transformers. Previous work has identified issues such as…

Machine Learning · Computer Science 2023-12-19 Ameen Ali , Hakan Cevikalp , Lior Wolf

Graph neural networks (GNNs) are the most widely adopted model in graph-structured data oriented learning and representation. Despite their extraordinary success in real-world applications, understanding their working mechanism by theory is…

Machine Learning · Computer Science 2023-05-16 Huayi Tang , Yong Liu

The quality of signal propagation in message-passing graph neural networks (GNNs) strongly influences their expressivity as has been observed in recent works. In particular, for prediction tasks relying on long-range interactions, recursive…

Machine Learning · Computer Science 2022-08-09 Pradeep Kr. Banerjee , Kedar Karhadkar , Yu Guang Wang , Uri Alon , Guido Montúfar

Graph-structured data are pervasive in the real-world such as social networks, molecular graphs and transaction networks. Graph neural networks (GNNs) have achieved great success in representation learning on graphs, facilitating various…

Machine Learning · Computer Science 2025-02-27 Zhimeng Guo , Teng Xiao , Zongyu Wu , Charu Aggarwal , Hui Liu , Suhang Wang

Graph neural networks (GNNs) are widely applied in graph data modeling. However, existing GNNs are often trained in a task-driven manner that fails to fully capture the intrinsic nature of the graph structure, resulting in sub-optimal node…

Machine Learning · Computer Science 2024-07-17 Zhenhua Huang , Kunhao Li , Shaojie Wang , Zhaohong Jia , Wentao Zhu , Sharad Mehrotra

Properties of interest for crystals and molecules, such as band gap, elasticity, and solubility, are generally related to each other: they are governed by the same underlying laws of physics. However, when state-of-the-art graph neural…

Machine Learning · Computer Science 2022-08-04 Alexander New , Michael J. Pekala , Nam Q. Le , Janna Domenico , Christine D. Piatko , Christopher D. Stiles

Graph neural networks (GNNs) have been widely used in many real applications, and recent studies have revealed their vulnerabilities against topology attacks. To address this issue, existing efforts have mainly been dedicated to improving…

Machine Learning · Computer Science 2022-04-27 Senrong Xu , Yuan Yao , Liangyue Li , Wei Yang , Feng Xu , Hanghang Tong

Graph neural networks (GNNs) work remarkably well in semi-supervised node regression, yet a rigorous theory explaining when and why they succeed remains lacking. To address this gap, we study an aggregate-and-readout model that encompasses…

Machine Learning · Statistics 2026-02-20 Juntong Chen , Claire Donnat , Olga Klopp , Johannes Schmidt-Hieber

Graph neural networks have shown significant success in the field of graph representation learning. Graph convolutions perform neighborhood aggregation and represent one of the most important graph operations. Nevertheless, one layer of…

Machine Learning · Computer Science 2020-07-21 Meng Liu , Hongyang Gao , Shuiwang Ji

Graph Neural Networks (GNNs) are characterized by their capacity of processing graph-structured data. However, due to the sparsity of labels under semi-supervised learning, they have been found to exhibit biased performance on specific…

Machine Learning · Computer Science 2025-12-16 Yihan Zhang

Graph neural networks are increasingly becoming the go-to approach in various fields such as computer vision, computational biology and chemistry, where data are naturally explained by graphs. However, unlike traditional convolutional…

Machine Learning · Computer Science 2021-10-28 Moshe Eliasof , Eldad Haber , Eran Treister

Graph Neural Networks (GNNs) have emerged as a powerful technique for learning on relational data. Owing to the relatively limited number of message passing steps they perform -- and hence a smaller receptive field -- there has been…

Machine Learning · Computer Science 2022-06-27 Ameya Velingker , Ali Kemal Sinop , Ira Ktena , Petar Veličković , Sreenivas Gollapudi

A long-standing goal in deep learning has been to characterize the learning behavior of black-box models in a more interpretable manner. For graph neural networks (GNNs), considerable advances have been made in formalizing what functions…

Machine Learning · Computer Science 2024-06-19 Chenxiao Yang , Qitian Wu , David Wipf , Ruoyu Sun , Junchi Yan

Graph Attention Networks (GATs) are the state-of-the-art neural architecture for representation learning with graphs. GATs learn attention functions that assign weights to nodes so that different nodes have different influences in the…

Machine Learning · Computer Science 2019-10-29 Guangtao Wang , Rex Ying , Jing Huang , Jure Leskovec

Attention mechanisms have become a cornerstone in modern neural networks, driving breakthroughs across diverse domains. However, their application to graph structured data, where capturing topological connections is essential, remains…

Machine Learning · Computer Science 2025-09-19 Xuanting Xie , Bingheng Li , Erlin Pan , Rui Hou , Wenyu Chen , Zhao Kang

Graph convolutional networks are a popular class of deep neural network algorithms which have shown success in a number of relational learning tasks. Despite their success, graph convolutional networks exhibit a number of peculiar features,…

Machine Learning · Computer Science 2022-08-22 Thomas Gebhart

Graph Neural Networks (GNNs) have exploded onto the machine learning scene in recent years owing to their capability to model and learn from graph-structured data. Such an ability has strong implications in a wide variety of fields whose…

Machine Learning · Computer Science 2021-07-26 Sergi Abadal , Akshay Jain , Robert Guirado , Jorge López-Alonso , Eduard Alarcón

Deep learning models for graphs have advanced the state of the art on many tasks. Despite their recent success, little is known about their robustness. We investigate training time attacks on graph neural networks for node classification…

Machine Learning · Computer Science 2024-01-30 Daniel Zügner , Stephan Günnemann

Graph Neural Networks (GNNs) have emerged as a notorious alternative to address learning problems dealing with non-Euclidean datasets. However, although most works assume that the graph is perfectly known, the observed topology is prone to…

Machine Learning · Computer Science 2023-12-12 Victor M. Tenorio , Samuel Rey , Antonio G. Marques