English
Related papers

Related papers: A Simple Spectral Failure Mode for Graph Convoluti…

200 papers

Graph neural networks (GNNs) have emerged as powerful tools for processing relational data in applications. However, GNNs suffer from the problem of oversmoothing, the property that the features of all nodes exponentially converge to the…

Machine Learning · Statistics 2025-05-22 Bastian Epping , Alexandre René , Moritz Helias , Michael T. Schaub

In the deep metric learning approach to image segmentation, a convolutional net densely generates feature vectors at the pixels of an image. Pairs of feature vectors are trained to be similar or different, depending on whether the…

Computer Vision and Pattern Recognition · Computer Science 2019-02-04 Kyle Luther , H. Sebastian Seung

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

Machine Learning · Computer Science 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang

Graph convolutional networks (GCNs) are powerful deep neural networks for graph-structured data. However, GCN computes the representation of a node recursively from its neighbors, making the receptive field size grow exponentially with the…

Machine Learning · Statistics 2018-03-02 Jianfei Chen , Jun Zhu , Le Song

A main challenge in mining network-based data is finding effective ways to represent or encode graph structures so that it can be efficiently exploited by machine learning algorithms. Several methods have focused in network representation…

Social and Information Networks · Computer Science 2019-03-18 Leonardo Gutiérrez-Gómez , Jean-Charles Delvenne

The lack of anisotropic kernels in graph neural networks (GNNs) strongly limits their expressiveness, contributing to well-known issues such as over-smoothing. To overcome this limitation, we propose the first globally consistent…

Machine Learning · Computer Science 2021-04-09 Dominique Beaini , Saro Passaro , Vincent Létourneau , William L. Hamilton , Gabriele Corso , Pietro Liò

In this paper, we study the problem of unsupervised graph representation learning by harnessing the control properties of dynamical networks defined on graphs. Our approach introduces a novel framework for contrastive learning, a widely…

Machine Learning · Computer Science 2024-04-19 Obaid Ullah Ahmad , Anwar Said , Mudassir Shabbir , Waseem Abbas , Xenofon Koutsoukos

Since their introduction by Kipf and Welling in $2017$, a primary use of graph convolutional networks is transductive node classification, where missing labels are inferred within a single observed graph and its feature matrix. Despite the…

Machine Learning · Statistics 2025-09-09 Nils Detering , Luca Galimberti , Anastasis Kratsios , Giulia Livieri , A. Martina Neuman

A graph convolutional network (GCN) employs a graph filtering kernel tailored for data with irregular structures. However, simply stacking more GCN layers does not improve performance; instead, the output converges to an uninformative…

Machine Learning · Computer Science 2022-11-04 Jin Zeng , Yang Liu , Gene Cheung , Wei Hu

Non-local self-similarity is well-known to be an effective prior for the image denoising problem. However, little work has been done to incorporate it in convolutional neural networks, which surpass non-local model-based methods despite…

Image and Video Processing · Electrical Eng. & Systems 2023-07-19 Diego Valsesia , Giulia Fracastoro , Enrico Magli

Modern data analysis pipelines are becoming increasingly complex due to the presence of multi-view information sources. While graphs are effective in modeling complex relationships, in many scenarios a single graph is rarely sufficient to…

Machine Learning · Statistics 2019-04-02 Uday Shankar Shanthamallu , Jayaraman J. Thiagarajan , Huan Song , Andreas Spanias

Graph neural networks (GNNs), consisting of a cascade of layers applying a graph convolution followed by a pointwise nonlinearity, have become a powerful architecture to process signals supported on graphs. Graph convolutions (and thus,…

Machine Learning · Computer Science 2019-10-23 Fernando Gama , Joan Bruna , Alejandro Ribeiro

In recent years, inductive graph embedding models, \emph{viz.}, graph neural networks (GNNs) have become increasingly accurate at link prediction (LP) in online social networks. The performance of such networks depends strongly on the input…

Machine Learning · Computer Science 2021-08-24 Chitrank Gupta , Yash Jain , Abir De , Soumen Chakrabarti

Representation learning has overcome the often arduous and manual featurization of networks through (unsupervised) feature learning as it results in embeddings that can apply to a variety of downstream learning tasks. The focus of…

Machine Learning · Computer Science 2021-01-01 Piotr Bielak , Tomasz Kajdanowicz , Nitesh V. Chawla

Graph machine learning has been widely explored in various domains, such as community detection, transaction analysis, and recommendation systems. In these applications, anomaly detection plays an important role. Recently, studies have…

Machine Learning · Computer Science 2025-11-21 Wei Herng Choong , Jixing Liu , Ching-Yu Kao , Philip Sperl

Graph neural networks (GNNs) are designed to process data associated with graphs. They are finding an increasing range of applications; however, as with other modern machine learning techniques, their theoretical understanding is limited.…

Disordered Systems and Neural Networks · Physics 2026-02-23 O. Duranthon , L. Zdeborová

Incorporating spectral information to enhance Graph Neural Networks (GNNs) has shown promising results but raises a fundamental challenge due to the inherent ambiguity of eigenvectors. Various architectures have been proposed to address…

Machine Learning · Computer Science 2024-06-07 Bohang Zhang , Lingxiao Zhao , Haggai Maron

In representation learning on the graph-structured data, under heterophily (or low homophily), many popular GNNs may fail to capture long-range dependencies, which leads to their performance degradation. To solve the above-mentioned issue,…

Machine Learning · Computer Science 2021-06-29 Mengying Jiang , Guizhong Liu , Yuanchao Su , Xinliang Wu

Graph Neural Networks (GNNs) set the state-of-the-art in representation learning for graph-structured data. They are used in many domains, from online social networks to complex molecules. Most GNNs leverage the message-passing paradigm and…

Machine Learning · Computer Science 2025-03-06 Tuğrul Hasan Karabulut , İnci M. Baytaş

Designing spectral convolutional networks is a formidable task in graph learning. In traditional spectral graph neural networks (GNNs), polynomial-based methods are commonly used to design filters via the Laplacian matrix. In practical…

Machine Learning · Computer Science 2024-08-19 Gongpei Zhao , Tao Wang , Yi Jin , Congyan Lang , Yidong Li , Haibin Ling