English
Related papers

Related papers: Stronger Graph Transformer with Regularized Attent…

200 papers

We explore the use of graph neural networks (GNNs) to model spatial processes in which there is no a priori graphical structure. Similar to finite element analysis, we assign nodes of a GNN to spatial locations and use a computational…

Machine Learning · Computer Science 2019-11-19 Ferran Alet , Adarsh K. Jeewajee , Maria Bauza , Alberto Rodriguez , Tomas Lozano-Perez , Leslie Pack Kaelbling

Current graph neural networks (GNNs) lack generalizability with respect to scales (graph sizes, graph diameters, edge weights, etc..) when solving many graph analysis problems. Taking the perspective of synthesizing graph theory programs,…

Machine Learning · Computer Science 2020-10-27 Hao Tang , Zhiao Huang , Jiayuan Gu , Bao-Liang Lu , Hao Su

Graph Neural Networks (GNNs) have shown success in learning from graph-structured data, with applications to fraud detection, recommendation, and knowledge graph reasoning. However, training GNN efficiently is challenging because: 1) GPU…

Machine Learning · Computer Science 2021-11-12 Seung Won Min , Kun Wu , Mert Hidayetoğlu , Jinjun Xiong , Xiang Song , Wen-mei Hwu

Graph neural networks (GNNs) which apply the deep neural networks to graph data have achieved significant performance for the task of semi-supervised node classification. However, only few work has addressed the adversarial robustness of…

Machine Learning · Computer Science 2019-10-16 Kaidi Xu , Hongge Chen , Sijia Liu , Pin-Yu Chen , Tsui-Wei Weng , Mingyi Hong , Xue Lin

Cross-graph node classification, utilizing the abundant labeled nodes from one graph to help classify unlabeled nodes in another graph, can be viewed as a domain generalization problem of graph neural networks (GNNs) due to the structure…

Machine Learning · Computer Science 2025-02-26 Guanzi Chen , Jiying Zhang , Yang Li

Existing studies have shown that Message-Passing Graph Neural Networks (MPNNs) are highly susceptible to adversarial attacks. In contrast, despite the increasing importance of Graph Transformers (GTs), their robustness properties are…

Machine Learning · Computer Science 2026-04-14 Philipp Foth , Lukas Gosch , Simon Geisler , Leo Schwinn , Stephan Günnemann

Attention mechanisms have become a cornerstone in modern neural networks, driving breakthroughs across diverse domains. However, their application to graph structured data, where capturing topological connections is essential, remains…

Machine Learning · Computer Science 2025-09-19 Xuanting Xie , Bingheng Li , Erlin Pan , Rui Hou , Wenyu Chen , Zhao Kang

We aim to better understand attention over nodes in graph neural networks (GNNs) and identify factors influencing its effectiveness. We particularly focus on the ability of attention GNNs to generalize to larger, more complex or noisy…

Machine Learning · Computer Science 2019-10-29 Boris Knyazev , Graham W. Taylor , Mohamed R. Amer

Graph Neural Networks (GNNs) have become the standard for graph representation learning but remain vulnerable to structural perturbations. We propose a novel framework that integrates persistent homology features with stability…

Machine Learning · Computer Science 2025-12-17 Jelena Losic

Graph Neural Networks (GNNs) have become powerful tools for learning from graph-structured data, finding applications across diverse domains. However, as graph sizes and connectivity increase, standard GNN training methods face significant…

Machine Learning · Computer Science 2025-12-01 Eshed Gal , Moshe Eliasof , Carola-Bibiane Schönlieb , Ivan I. Kyrchei , Eldad Haber , Eran Treister

Graph Convolutional Neural Networks (GCNNs) are generalizations of CNNs to graph-structured data, in which convolution is guided by the graph topology. In many cases where graphs are unavailable, existing methods manually construct graphs…

Machine Learning · Computer Science 2019-09-17 Xiang Gao , Wei Hu , Zongming Guo

Graph neural networks (GNNs) have attracted much attention because of their excellent performance on tasks such as node classification. However, there is inadequate understanding on how and why GNNs work, especially for node representation…

Machine Learning · Computer Science 2020-06-09 Guoji Fu , Yifan Hou , Jian Zhang , Kaili Ma , Barakeel Fanseu Kamhoua , James Cheng

In the realm of Graph Neural Networks (GNNs), two exciting research directions have recently emerged: Subgraph GNNs and Graph Transformers. In this paper, we propose an architecture that integrates both approaches, dubbed Subgraphormer,…

Machine Learning · Computer Science 2024-05-29 Guy Bar-Shalom , Beatrice Bevilacqua , Haggai Maron

We show that standard Transformers without graph-specific modifications can lead to promising results in graph learning both in theory and practice. Given a graph, we simply treat all nodes and edges as independent tokens, augment them with…

Machine Learning · Computer Science 2022-10-25 Jinwoo Kim , Tien Dat Nguyen , Seonwoo Min , Sungjun Cho , Moontae Lee , Honglak Lee , Seunghoon Hong

To improve the robustness of graph neural networks (GNN), graph structure learning (GSL) has attracted great interest due to the pervasiveness of noise in graph data. Many approaches have been proposed for GSL to jointly learn a clean graph…

Machine Learning · Computer Science 2023-07-06 Shaogao Lv , Gang Wen , Shiyu Liu , Linsen Wei , Ming Li

While convolutional neural nets (CNNs) have achieved remarkable performance for a wide range of inverse imaging applications, the filter coefficients are computed in a purely data-driven manner and are not explainable. Inspired by an…

Image and Video Processing · Electrical Eng. & Systems 2020-02-18 Weng-tai Su , Gene Cheung , Richard Wildes , Chia-Wen Lin

In this paper, we propose an interpretable denoising method for graph signals using regularization by denoising (RED). RED is a technique developed for image restoration that uses an efficient (and sometimes black-box) denoiser in the…

Signal Processing · Electrical Eng. & Systems 2026-05-27 Hayate Kojima , Hiroshi Higashi , Yuichi Tanaka

Positional Encodings (PEs) are essential for injecting structural information into Graph Neural Networks (GNNs), particularly Graph Transformers, yet their empirical impact remains insufficiently understood. We introduce a unified…

Machine Learning · Computer Science 2026-01-15 Florian Grötschla , Jiaqing Xie , Roger Wattenhofer

Graph convolutional neural networks (GCNNs) have received much attention recently, owing to their capability in handling graph-structured data. Among the existing GCNNs, many methods can be viewed as instances of a neural message passing…

Machine Learning · Computer Science 2021-03-19 Tien Huu Do , Duc Minh Nguyen , Giannis Bekoulis , Adrian Munteanu , Nikos Deligiannis

We consider the two problems of predicting links in a dynamic graph sequence and predicting functions defined at each node of the graph. In many applications, the solution of one problem is useful for solving the other. Indeed, if these…

Machine Learning · Computer Science 2012-03-27 Emile Richard , Andreas Argyriou , Theodoros Evgeniou , Nicolas Vayatis