English
Related papers

Related papers: SpecNet2: Orthogonalization-free spectral embeddin…

200 papers

Network renormalization has traditionally relied on spatial adjacency-grouping nearby nodes together, but this approach fails to capture the dynamical correlations that govern system-wide behavior in scale-free networks. We present a…

Physics and Society · Physics 2025-10-21 Cook Hyun Kim , B. Kahng

Graph neural networks (GNNs) have attracted considerable attention from the research community. It is well established that GNNs are usually roughly divided into spatial and spectral methods. Despite that spectral GNNs play an important…

Machine Learning · Computer Science 2023-02-14 Deyu Bo , Xiao Wang , Yang Liu , Yuan Fang , Yawen Li , Chuan Shi

Semantic segmentation is a fundamental task in visual scene understanding. We focus on the supervised setting, where ground-truth semantic annotations are available. Based on knowledge about the high regularity of real-world scenes, we…

Computer Vision and Pattern Recognition · Computer Science 2023-11-16 Stamatis Alexandropoulos , Christos Sakaridis , Petros Maragos

The fast development of self-supervised learning lowers the bar learning feature representation from massive unlabeled data and has triggered a series of research on change detection of remote sensing images. Challenges in adapting…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Meiqi Hu , Chen Wu , Liangpei Zhang

The task of graph-level out-of-distribution (OOD) detection is crucial for deploying graph neural networks in real-world settings. In this paper, we observe a significant difference in the relationship between the largest and second-largest…

Machine Learning · Computer Science 2025-05-26 Jiawei Gu , Ziyue Qiao , Zechao Li

We introduce SignNet and BasisNet -- new neural architectures that are invariant to two key symmetries displayed by eigenvectors: (i) sign flips, since if $v$ is an eigenvector then so is $-v$; and (ii) more general basis symmetries, which…

Machine Learning · Computer Science 2022-10-04 Derek Lim , Joshua Robinson , Lingxiao Zhao , Tess Smidt , Suvrit Sra , Haggai Maron , Stefanie Jegelka

This paper proposes a scalable algorithmic framework for spectral reduction of large undirected graphs. The proposed method allows computing much smaller graphs while preserving the key spectral (structural) properties of the original…

Data Structures and Algorithms · Computer Science 2018-12-24 Zhiqiang Zhao , Yongyu Wang , Zhuo Feng

The area of Data Analytics on graphs promises a paradigm shift as we approach information processing of classes of data, which are typically acquired on irregular but structured domains (social networks, various ad-hoc sensor networks).…

Information Theory · Computer Science 2019-08-13 Ljubisa Stankovic , Danilo Mandic , Milos Dakovic , Milos Brajovic , Bruno Scalzo , Tony Constantinides

Spectral clustering is a popular method for community detection in network graphs: starting from a matrix representation of the graph, the nodes are clustered on a low dimensional projection obtained from a truncated spectral decomposition…

Machine Learning · Statistics 2022-08-10 Francesco Sanna Passino , Nicholas A. Heard , Patrick Rubin-Delanchy

With growing investigations into solving partial differential equations by physics-informed neural networks (PINNs), more accurate and efficient PINNs are required to meet the practical demands of scientific computing. One bottleneck of…

Machine Learning · Computer Science 2025-10-29 Tianchi Yu , Yiming Qi , Ivan Oseledets , Shiyi Chen

Spectral graph neural networks (GNNs) learn graph representations via spectral-domain graph convolutions. However, most existing spectral graph filters are scalar-to-scalar functions, i.e., mapping a single eigenvalue to a single filtered…

Machine Learning · Computer Science 2023-03-03 Deyu Bo , Chuan Shi , Lele Wang , Renjie Liao

Network data appears in very diverse applications, like biological, social, or sensor networks. Clustering of network nodes into categories or communities has thus become a very common task in machine learning and data mining. Network data…

Machine Learning · Computer Science 2020-01-24 Mireille El Gheche , Giovanni Chierchia , Pascal Frossard

Spectral Graph Neural Networks (GNNs) have achieved tremendous success in graph learning. As an essential part of spectral GNNs, spectral graph convolution extracts crucial frequency information in graph data, leading to superior…

Machine Learning · Computer Science 2024-04-09 Guoming Li , Jian Yang , Shangsong Liang , Dongsheng Luo

Compression techniques for deep neural network models are becoming very important for the efficient execution of high-performance deep learning systems on edge-computing devices. The concept of model compression is also important for…

While several feature embedding models have been developed in the literature, comparisons of these embeddings have largely focused on their numerical performance in classification-related downstream applications. However, an interpretable…

Machine Learning · Computer Science 2025-08-19 Mohammad Jalali , Bahar Dibaei Nia , Farzan Farnia

Spectral algorithms leverage spectral regularization techniques to analyze and process data, providing a flexible framework for addressing supervised learning problems. To deepen our understanding of their performance in real-world…

Machine Learning · Statistics 2025-07-23 Jun Fan , Zheng-Chu Guo , Lei Shi

Due to the growing ubiquity of unlabeled data, learning with unlabeled data is attracting increasing attention in machine learning. In this paper, we propose a novel semi-supervised kernel learning method which can seamlessly combine…

Machine Learning · Computer Science 2012-03-19 Qi Mao , Ivor W. Tsang

Spectral estimators are fundamental in lowrank matrix models and arise throughout machine learning and statistics, with applications including network analysis, matrix completion and PCA. These estimators aim to recover the leading…

Statistics Theory · Mathematics 2025-02-17 Hao Yan , Keith Levin

Unsupervised localization and segmentation are long-standing computer vision challenges that involve decomposing an image into semantically-meaningful segments without any labeled data. These tasks are particularly interesting in an…

Computer Vision and Pattern Recognition · Computer Science 2022-05-17 Luke Melas-Kyriazi , Christian Rupprecht , Iro Laina , Andrea Vedaldi

Statistical inference on graphs often proceeds via spectral methods involving low-dimensional embeddings of matrix-valued graph representations, such as the graph Laplacian or adjacency matrix. In this paper, we analyze the asymptotic…

Statistics Theory · Mathematics 2018-08-16 Joshua Cape , Minh Tang , Carey E. Priebe