English
Related papers

Related papers: Improving Expressive Power of Spectral Graph Neura…

200 papers

Message-passing neural networks (MPNNs) are the leading architecture for deep learning on graph-structured data, in large part due to their simplicity and scalability. Unfortunately, it was shown that these architectures are limited in…

The network alignment problem asks for the best correspondence between two given graphs, so that the largest possible number of edges are matched. This problem appears in many scientific problems (like the study of protein-protein…

Computation · Statistics 2017-07-18 Efe Onaran , Soledad Villar

Here we have investigated a few properties of the eigenvalues of normalized (geometric) graph Laplacian in different graphs. Preservation of eigenvalue 1 from a particular subgraph to the entire graph, the spectrum of the graph constructed…

Combinatorics · Mathematics 2014-03-07 Anirban Banerjee

Large graphs commonly appear in social networks, knowledge graphs, recommender systems, life sciences, and decision making problems. Summarizing large graphs by their high level properties is helpful in solving problems in these settings.…

Machine Learning · Statistics 2022-08-01 Elise van der Pol , Ian Gemp , Yoram Bachrach , Richard Everett

Power Normalizations (PN) are useful non-linear operators which tackle feature imbalances in classification problems. We study PNs in the deep learning setup via a novel PN layer pooling feature maps. Our layer combines the feature vectors…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Piotr Koniusz , Hongguang Zhang

The paper defines and studies manifold (M) convolutional filters and neural networks (NNs). \emph{Manifold} filters and MNNs are defined in terms of the Laplace-Beltrami operator exponential and are such that \emph{graph} (G) filters and…

Machine Learning · Computer Science 2024-03-18 Zhiyang Wang , Luana Ruiz , Alejandro Ribeiro

We present the spectrum of the (normalized) graph Laplacian as a systematic tool for the investigation of networks, and we describe basic properties of eigenvalues and eigenfunctions. Processes of graph formation like motif joining or…

Adaptation and Self-Organizing Systems · Physics 2012-10-19 Anirban Banerjee , Jürgen Jost

Separating multiple graph signals from a single observed mixture is an inherently ill-posed problem that traditionally relies on restrictive and handcrafted priors. This letter addresses this challenge by proposing an unsupervised learnable…

Signal Processing · Electrical Eng. & Systems 2026-04-28 Keivan Faghih Niresi , Dorina Thanou , Olga Fink

Graph neural networks (GNNs), consisting of a cascade of layers applying a graph convolution followed by a pointwise nonlinearity, have become a powerful architecture to process signals supported on graphs. Graph convolutions (and thus,…

Machine Learning · Computer Science 2019-10-23 Fernando Gama , Joan Bruna , Alejandro Ribeiro

End-to-end training of graph neural networks (GNN) on large graphs presents several memory and computational challenges, and limits the application to shallow architectures as depth exponentially increases the memory and space complexities.…

Machine Learning · Computer Science 2023-09-06 Oscar Pina , Verónica Vilaplana

Since the Message Passing (Graph) Neural Networks (MPNNs) have a linear complexity with respect to the number of nodes when applied to sparse graphs, they have been widely implemented and still raise a lot of interest even though their…

Machine Learning · Computer Science 2021-06-15 Muhammet Balcilar , Pierre Héroux , Benoit Gaüzère , Pascal Vasseur , Sébastien Adam , Paul Honeine

Because of the significant increase in size and complexity of the networks, the distributed computation of eigenvalues and eigenvectors of graph matrices has become very challenging and yet it remains as important as before. In this paper…

Numerical Analysis · Mathematics 2017-11-27 Konstantin Avrachenkov , Philippe Jacquet , Jithin Sreedharan

This paper focuses on the concentration properties of the spectral norm of the normalized Laplacian matrix for Erd\H{o}s-R\'enyi random graphs. First, We achieve the optimal bound that can be attained in the further question posed by Le et…

Probability · Mathematics 2025-02-05 Yiming Chen , Xuanang Hu , Pengtao Li

Convolutional Neural Networks (CNNs) have recently led to incredible breakthroughs on a variety of pattern recognition problems. Banks of finite impulse response filters are learned on a hierarchy of layers, each contributing more abstract…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 Felipe Petroski Such , Shagan Sah , Miguel Dominguez , Suhas Pillai , Chao Zhang , Andrew Michael , Nathan Cahill , Raymond Ptucha

While graph heterophily has been extensively studied in recent years, a fundamental research question largely remains nascent: How and to what extent will graph heterophily affect the prediction performance of graph neural networks (GNNs)?…

Machine Learning · Computer Science 2023-06-27 Shuaicheng Zhang , Haohui Wang , Si Zhang , Dawei Zhou

Graph Neural Networks (GNNs) are effective tools for graph representation learning. Most GNNs rely on a recursive neighborhood aggregation scheme, named message passing, thereby their theoretical expressive power is limited to the…

Machine Learning · Computer Science 2023-09-19 Dingmin Wang , Shengchao Liu , Hanchen Wang , Bernardo Cuenca Grau , Linfeng Song , Jian Tang , Song Le , Qi Liu

We offer a new method for proving that the maximal eigenvalue of the normalized graph Laplacian of a graph with $n$ vertices is at least $\frac{n+1}{n-1}$ provided the graph is not complete and that equality is attained if and only if the…

Spectral Theory · Mathematics 2021-04-07 Jürgen Jost , Raffaella Mulas , Florentin Münch

The relationships between eigenvalues and eigenvectors of a product graph and those of its factor graphs have been known for the standard products, while characterization of Laplacian eigenvalues and eigenvectors of the Kronecker product of…

Social and Information Networks · Computer Science 2021-02-08 Milan Bašić , Branko Arsić , Zoran Obradović

Popular graph neural networks are shallow models, despite the success of very deep architectures in other application domains of deep learning. This reduces the modeling capacity and leaves models unable to capture long-range relationships.…

Machine Learning · Computer Science 2022-07-05 Andreas Roth , Thomas Liebig

Graph neural networks have developed by leaps and bounds in recent years due to the restriction of traditional convolutional filters on non-Euclidean structured data. Spectral graph theory mainly studies fundamental graph properties using…

Spectral Theory · Mathematics 2023-09-08 Xinye Chen