English
Related papers

Related papers: LON-GNN: Spectral GNNs with Learnable Orthonormal …

200 papers

Graph neural networks (GNNs) are effective models for representation learning on relational data. However, standard GNNs are limited in their expressive power, as they cannot distinguish graphs beyond the capability of the Weisfeiler-Leman…

Machine Learning · Computer Science 2021-06-07 Ralph Abboud , İsmail İlkan Ceylan , Martin Grohe , Thomas Lukasiewicz

Rationalizing which parts of a molecule drive the predictions of a molecular graph convolutional neural network (GCNN) can be difficult. To help, we propose two simple regularization techniques to apply during the training of GCNNs: Batch…

Machine Learning · Statistics 2021-09-09 Ryan Henderson , Djork-Arné Clevert , Floriane Montanari

We consider the problem of learning generalized policies for classical planning domains using graph neural networks from small instances represented in lifted STRIPS. The problem has been considered before but the proposed neural…

Artificial Intelligence · Computer Science 2022-05-13 Simon Ståhlberg , Blai Bonet , Hector Geffner

This paper studies semi-supervised graph classification, which is an important problem with various applications in social network analysis and bioinformatics. This problem is typically solved by using graph neural networks (GNNs), which…

Machine Learning · Computer Science 2022-05-24 Wei Ju , Junwei Yang , Meng Qu , Weiping Song , Jianhao Shen , Ming Zhang

Graph learning has become essential in various domains, including recommendation systems and social network analysis. Graph Neural Networks (GNNs) have emerged as promising techniques for encoding structural information and improving…

Machine Learning · Computer Science 2024-10-10 Lianghao Xia , Ben Kao , Chao Huang

In this work, we provide a new formulation for Graph Convolutional Neural Networks (GCNNs) for link prediction on graph data that addresses common challenges for biomedical knowledge graphs (KGs). We introduce a regularized attention…

Machine Learning · Computer Science 2018-12-04 Daniel Neil , Joss Briody , Alix Lacoste , Aaron Sim , Paidi Creed , Amir Saffari

Graph transformers (GTs) have emerged as a promising architecture that is theoretically more expressive than message-passing graph neural networks (GNNs). However, typical GT models have at least quadratic complexity and thus cannot scale…

Machine Learning · Computer Science 2024-04-09 Chenhui Deng , Zichao Yue , Zhiru Zhang

Despite the recent success of graph neural networks (GNN), common architectures often exhibit significant limitations, including sensitivity to oversmoothing, long-range dependencies, and spurious edges, e.g., as can occur as a result of…

Machine Learning · Computer Science 2021-12-06 Yongyi Yang , Tang Liu , Yangkun Wang , Jinjing Zhou , Quan Gan , Zhewei Wei , Zheng Zhang , Zengfeng Huang , David Wipf

We study the problem of semi-supervised learning on graphs, for which graph neural networks (GNNs) have been extensively explored. However, most existing GNNs inherently suffer from the limitations of over-smoothing, non-robustness, and…

Machine Learning · Computer Science 2021-09-22 Wenzheng Feng , Jie Zhang , Yuxiao Dong , Yu Han , Huanbo Luan , Qian Xu , Qiang Yang , Evgeny Kharlamov , Jie Tang

Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard plights in training deep architectures such as vanishing gradients and overfitting, it also uniquely suffers from over-smoothing, information squashing,…

Machine Learning · Computer Science 2022-05-10 Tianlong Chen , Kaixiong Zhou , Keyu Duan , Wenqing Zheng , Peihao Wang , Xia Hu , Zhangyang Wang

While Graph Neural Networks (GNNs) have achieved remarkable results in a variety of applications, recent studies exposed important shortcomings in their ability to capture the structure of the underlying graph. It has been shown that the…

Machine Learning · Computer Science 2023-09-26 Giorgos Bouritsas , Fabrizio Frasca , Stefanos Zafeiriou , Michael M. Bronstein

Graph neural networks (GNNs) have struggled to outperform traditional optimization methods on combinatorial problems, limiting their practical impact. We address this gap by introducing a novel chaining procedure for the graph alignment…

Machine Learning · Computer Science 2025-10-06 Marc Lelarge

Graph Neural Networks (GNNs) have emerged as a powerful tool to learn from graph-structured data. A paramount example of such data is the brain, which operates as a network, from the micro-scale of neurons, to the macro-scale of regions.…

Machine Learning · Computer Science 2022-11-17 Ahmed ElGazzar , Rajat Thomas , Guido van Wingen

Hybrid optical neural networks (HONNs) offload some electronic computation to optical preprocessors to achieve low-power and fast training and inference phases in machine learning tasks. Our contribution to the development of HONNs is a…

Optics · Physics 2025-10-07 Altai Perry , Luat Vuong

Graph neural networks (GNNs) leverage message passing mechanisms to learn the topological features of graph data. Traditional GNNs learns node features in a spatial domain unrelated to the topology, which can hardly ensure topological…

Machine Learning · Computer Science 2025-05-30 Juwei Yue , Haikuo Li , Jiawei Sheng , Xiaodong Li , Taoyu Su , Tingwen Liu , Li Guo

While Graph Neural Networks (GNNs) are powerful models for learning representations on graphs, most state-of-the-art models do not have significant accuracy gain beyond two to three layers. Deep GNNs fundamentally need to address: 1).…

The era of data deluge has sparked the interest in graph-based learning methods in a number of disciplines such as sociology, biology, neuroscience, or engineering. In this paper, we introduce a graph recurrent neural network (GRNN) for…

Machine Learning · Computer Science 2019-02-19 Vassilis N. Ioannidis , Antonio G. Marques , Georgios B. Giannakis

Spectral Graph Neural Networks (GNNs) have achieved tremendous success in graph machine learning, with polynomial filters applied for graph convolutions, where all nodes share the identical filter weights to mine their local contexts.…

Machine Learning · Computer Science 2024-05-24 Jingwei Guo , Kaizhu Huang , Xinping Yi , Rui Zhang

It is well established that spectral graph neural networks (GNNs) can universally approximate node signals; however, their expressive power remains bounded by the 1-dimensional Weisfeiler-Lehman test, which is mirrored in their lack of…

Machine Learning · Computer Science 2026-05-26 Xiaohan Wang , Deyu Bo , Longlong Li , Kelin Xia

Whilst spectral Graph Neural Networks (GNNs) are theoretically well-founded in the spectral domain, their practical reliance on polynomial approximation implies a profound linkage to the spatial domain. As previous studies rarely examine…

Machine Learning · Computer Science 2024-09-17 Jingwei Guo , Kaizhu Huang , Xinping Yi , Zixian Su , Rui Zhang