English
Related papers

Related papers: Rethinking Spectral Augmentation for Contrast-base…

200 papers

Graph contrastive learning (GCL) has recently achieved substantial advancements. Existing GCL approaches compare two different ``views'' of the same graph in order to learn node/graph representations. The underlying assumption of these…

Machine Learning · Computer Science 2024-01-18 Gehang Zhang , Bowen Yu , Jiangxia Cao , Xinghua Zhang , Jiawei Sheng , Chuan Zhou , Tingwen Liu

Spectral analysis of networks states that many structural properties of graphs, such as centrality of their nodes, are given in terms of their adjacency matrices. The natural extension of such spectral analysis to higher order networks is…

Spectral Theory · Mathematics 2025-03-17 Gonzalo Contreras-Aso , Cristian Pérez-Corral , Miguel Romance

Self-supervised learning attempts to learn representations from un-labeled data; it does so via a loss function that encourages the embedding of a point to be close to that of its augmentations. This simple idea performs remarkably well,…

Machine Learning · Computer Science 2026-01-30 Parikshit Bansal , Ali Kavis , Sujay Sanghavi

Graph Neural Networks (GNN) have been extensively used to extract meaningful representations from graph structured data and to perform predictive tasks such as node classification and link prediction. In recent years, there has been a lot…

Image and Video Processing · Electrical Eng. & Systems 2020-07-10 Arijit Sehanobish , Neal G. Ravindra , David van Dijk

We describe a novel method for blind, single-image spectral super-resolution. While conventional super-resolution aims to increase the spatial resolution of an input image, our goal is to spectrally enhance the input, i.e., generate an…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Silvano Galliani , Charis Lanaras , Dimitrios Marmanis , Emmanuel Baltsavias , Konrad Schindler

Graph representation learning is a fundamental research issue in various domains of applications, of which the inductive learning problem is particularly challenging as it requires models to generalize to unseen graph structures during…

Machine Learning · Computer Science 2024-03-27 Hanxuan Yang , Zhaoxin Yu , Qingchao Kong , Wei Liu , Wenji Mao

Graph is a highly generic and diverse representation, suitable for almost any data processing problem. Spectral graph theory has been shown to provide powerful algorithms, backed by solid linear algebra theory. It thus can be extremely…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Or Streicher , Ido Cohen , Guy Gilboa

Graph Neural Networks (GNNs) have achieved state-of-the-art performance in solving graph classification tasks. However, most GNN architectures aggregate information from all nodes and edges in a graph, regardless of their relevance to the…

Machine Learning · Statistics 2024-04-19 Pablo Sanchez-Martin , Kinaan Aamir Khan , Isabel Valera

We study how the spectral gap of the normalized Laplacian of a random graph changes when an edge is added to or removed from the graph. There are known examples of graphs where, perhaps counterintuitively, adding an edge can decrease the…

Combinatorics · Mathematics 2015-06-23 Ronen Eldan , Miklós Rácz , Tselil Schramm

Spectral graph neural networks (GNNs) learn graph representations via spectral-domain graph convolutions. However, most existing spectral graph filters are scalar-to-scalar functions, i.e., mapping a single eigenvalue to a single filtered…

Machine Learning · Computer Science 2023-03-03 Deyu Bo , Chuan Shi , Lele Wang , Renjie Liao

This paper presents bounds for the variation of the spectral radius $\lambda(G)$ of a graph $G$ after some perturbations or local vertex/edge modifications of $G$. The perturbations considered here are the connection of a new vertex with,…

Combinatorics · Mathematics 2012-09-25 C. Dalfó , M. A. Fiol , E. Garriga

This paper aims at revisiting Graph Convolutional Neural Networks by bridging the gap between spectral and spatial design of graph convolutions. We theoretically demonstrate some equivalence of the graph convolution process regardless it is…

Machine Learning · Computer Science 2020-03-27 Muhammet Balcilar , Guillaume Renton , Pierre Heroux , Benoit Gauzere , Sebastien Adam , Paul Honeine

Graph Neural Networks (GNNs) have been studied through the lens of expressive power and generalization. However, their optimization properties are less well understood. We take the first step towards analyzing GNN training by studying the…

Machine Learning · Computer Science 2021-05-27 Keyulu Xu , Mozhi Zhang , Stefanie Jegelka , Kenji Kawaguchi

Graph self-supervised learning can reduce the need for labeled graph data and has been widely used in recommendation, social networks, and other web applications. However, existing methods often underuse high-frequency signals and may…

Machine Learning · Computer Science 2026-04-20 Haojie Li , Mengjiao Zhang , Guanfeng Liu , Qiang Hu , Yan Wang , Junwei Du

Self-supervised contrastive learning has emerged as a powerful tool in machine learning and computer vision to learn meaningful representations from unlabeled data. Meanwhile, its empirical success has encouraged many theoretical studies to…

Machine Learning · Computer Science 2025-05-29 Jingyi Cui , Hongwei Wen , Yisen Wang

Can one reduce the size of a graph without significantly altering its basic properties? The graph reduction problem is hereby approached from the perspective of restricted spectral approximation, a modification of the spectral similarity…

Data Structures and Algorithms · Computer Science 2019-01-01 Andreas Loukas

Stochastic graph neural networks (SGNNs) are information processing architectures that learn representations from data over random graphs. SGNNs are trained with respect to the expected performance, which comes with no guarantee about…

Signal Processing · Electrical Eng. & Systems 2023-03-22 Zhan Gao , Elvin Isufi

We introduce a self-supervised approach for learning node and graph level representations by contrasting structural views of graphs. We show that unlike visual representation learning, increasing the number of views to more than two or…

Machine Learning · Computer Science 2020-06-11 Kaveh Hassani , Amir Hosein Khasahmadi

Anomaly detection in massive networks has numerous theoretical and computational challenges, especially as the behavior to be detected becomes small in comparison to the larger network. This presentation focuses on recent results in three…

Social and Information Networks · Computer Science 2014-12-16 Benjamin A. Miller , Nicholas Arcolano , Michael M. Wolf , Nadya T. Bliss

This paper studies learning node representations with graph neural networks (GNNs) for unsupervised scenario. Specifically, we derive a theoretical analysis and provide an empirical demonstration about the non-steady performance of GNNs…

Machine Learning · Computer Science 2021-12-16 Lu Yu , Shichao Pei , Lizhong Ding , Jun Zhou , Longfei Li , Chuxu Zhang , Xiangliang Zhang