English
Related papers

Related papers: Probing Graph Neural Network Activation Patterns T…

200 papers

Activation functions are crucial in graph neural networks (GNNs) as they allow defining a nonlinear family of functions to capture the relationship between the input graph data and their representations. This paper proposes activation…

Signal Processing · Electrical Eng. & Systems 2020-09-16 Bianca Iancu , Luana Ruiz , Alejandro Ribeiro , Elvin Isufi

Graph Neural Networks (GNNs) have been highly successful for the node classification task. GNNs typically assume graphs are homophilic, i.e. neighboring nodes are likely to belong to the same class. However, a number of real-world graphs…

Machine Learning · Computer Science 2024-09-20 Yurui Lai , Taiyan Zhang , Rui Fan

Graph signals are signals with an irregular structure that can be described by a graph. Graph neural networks (GNNs) are information processing architectures tailored to these graph signals and made of stacked layers that compose graph…

Signal Processing · Electrical Eng. & Systems 2020-02-19 Luana Ruiz , Fernando Gama , Antonio G. Marques , Alejandro Ribeiro

Graph Neural Networks (GNNs), particularly Graph Convolutional Neural Networks (GCNNs), have emerged as pivotal instruments in machine learning and signal processing for processing graph-structured data. This paper proposes an analysis…

Machine Learning · Statistics 2024-11-04 Xinjue Wang , Esa Ollila , Sergiy A. Vorobyov

Despite the growing popularity of graph attention mechanisms, their theoretical understanding remains limited. This paper aims to explore the conditions under which these mechanisms are effective in node classification tasks through the…

Machine Learning · Computer Science 2025-05-14 Zhongtian Ma , Qiaosheng Zhang , Bocheng Zhou , Yexin Zhang , Shuyue Hu , Zhen Wang

Graph neural networks (GNN) are powerful models for many graph-structured tasks. Existing models often assume that the complete structure of the graph is available during training. In practice, however, graph-structured data is usually…

Machine Learning · Computer Science 2022-03-29 Chen Wang , Yuheng Qiu , Dasong Gao , Sebastian Scherer

Seeking effective neural networks is a critical and practical field in deep learning. Besides designing the depth, type of convolution, normalization, and nonlinearities, the topological connectivity of neural networks is also important.…

Computer Vision and Pattern Recognition · Computer Science 2020-08-20 Kun Yuan , Quanquan Li , Jing Shao , Junjie Yan

Graphs can model complex relationships between objects, enabling a myriad of Web applications such as online page/article classification and social recommendation. While graph neural networks(GNNs) have emerged as a powerful tool for graph…

Machine Learning · Computer Science 2023-02-28 Zemin Liu , Xingtong Yu , Yuan Fang , Xinming Zhang

Graph neural networks (GNNs) have attracted much attention due to their ability to leverage the intrinsic geometries of the underlying data. Although many different types of GNN models have been developed, with many benchmarking procedures…

Graph neural networks (GNNs) are a powerful architecture for tackling graph learning tasks, yet have been shown to be oblivious to eminent substructures such as cycles. We present TOGL, a novel layer that incorporates global topological…

Machine Learning · Computer Science 2022-03-18 Max Horn , Edward De Brouwer , Michael Moor , Yves Moreau , Bastian Rieck , Karsten Borgwardt

Graph Neural Networks (GNNs) have proven effective in various medical imaging applications, such as automated disease diagnosis. However, due to the local neighborhood aggregation paradigm in message passing which characterizes these…

Machine Learning · Computer Science 2024-11-05 K. Mancini , I. Rekik

Diffusion models have gained popularity in graph generation tasks; however, the extent of their expressivity concerning the graph distributions they can learn is not fully understood. Unlike models in other domains, popular backbones for…

Machine Learning · Computer Science 2025-02-05 Xiyuan Wang , Yewei Liu , Lexi Pang , Siwei Chen , Muhan Zhang

Unraveling the complexities of Gene Regulatory Networks (GRNs) is crucial for understanding cellular processes and disease mechanisms. Traditional computational methods often struggle with the dynamic nature of these networks. This study…

Machine Learning · Computer Science 2025-03-04 Hakan T. Otal , Abdulhamit Subasi , Furkan Kurt , M. Abdullah Canbaz , Yasin Uzun

Graph Neural Networks (GNNs) have achieved remarkable success in various graph-based learning tasks. While their performance is often attributed to the powerful neighborhood aggregation mechanism, recent studies suggest that other…

Machine Learning · Computer Science 2024-12-11 Yushun Dong , Patrick Soga , Yinhan He , Song Wang , Jundong Li

Quantitative structure-activity relationship assumes a smooth relationship between molecular structure and biological activity. However, activity cliffs defined as pairs of structurally similar compounds with large potency differences break…

Computational Engineering, Finance, and Science · Computer Science 2025-11-11 Hajung Kim , Jueon Park , Junseok Choe , Sheunheun Baek , Hyeon Hwang , Jaewoo Kang

Recently, transformer architectures for graphs emerged as an alternative to established techniques for machine learning with graphs, such as (message-passing) graph neural networks. So far, they have shown promising empirical results, e.g.,…

Machine Learning · Computer Science 2024-04-01 Luis Müller , Mikhail Galkin , Christopher Morris , Ladislav Rampášek

Graph Neural Networks (GNNs) are powerful to learn the representation of graph-structured data. Most of the GNNs use the message-passing scheme, where the embedding of a node is iteratively updated by aggregating the information of its…

Machine Learning · Computer Science 2020-07-28 Shuo Zhang , Lei Xie

Graph neural networks (GNNs) are processing architectures that exploit graph structural information to model representations from network data. Despite their success, GNNs suffer from sub-optimal generalization performance given limited…

Machine Learning · Computer Science 2021-06-08 Zhan Gao , Subhrajit Bhattacharya , Leiming Zhang , Rick S. Blum , Alejandro Ribeiro , Brian M. Sadler

Message-passing Graph Neural Networks (GNNs) are often criticized for their limited expressiveness, issues like over-smoothing and over-squashing, and challenges in capturing long-range dependencies. Conversely, Graph Transformers (GTs) are…

Machine Learning · Computer Science 2025-11-04 Yuankai Luo , Lei Shi , Xiao-Ming Wu

Deep Neural Networks have shown tremendous success in the area of object recognition, image classification and natural language processing. However, designing optimal Neural Network architectures that can learn and output arbitrary graphs…

Machine Learning · Computer Science 2019-07-02 Mital Kinderkhedia