English
Related papers

Related papers: Robust Spectral Detection of Global Structures in …

200 papers

We study networks that display community structure -- groups of nodes within which connections are unusually dense. Using methods from random matrix theory, we calculate the spectra of such networks in the limit of large size, and hence…

Social and Information Networks · Computer Science 2012-05-10 Raj Rao Nadakuditi , M. E. J. Newman

Node classification on graphs is a significant task with a wide range of applications, including social analysis and anomaly detection. Even though graph neural networks (GNNs) have produced promising results on this task, current…

Machine Learning · Computer Science 2023-06-16 Jingyang Yuan , Xiao Luo , Yifang Qin , Yusheng Zhao , Wei Ju , Ming Zhang

Diverse inverse problems in imaging can be cast as variational problems composed of a task-specific data fidelity term and a regularization term. In this paper, we propose a novel learnable general-purpose regularizer exploiting recent…

Optimization and Control · Mathematics 2020-02-19 Erich Kobler , Alexander Effland , Karl Kunisch , Thomas Pock

Recent work in signal processing and statistics have focused on defining new regularization functions, which not only induce sparsity of the solution, but also take into account the structure of the problem. We present in this paper a class…

Machine Learning · Computer Science 2011-10-21 Julien Mairal , Rodolphe Jenatton , Guillaume Obozinski , Francis Bach

Motion detection has been widely used in many applications, such as surveillance and robotics. Due to the presence of the static background, a motion video can be decomposed into a low-rank background and a sparse foreground. Many…

Computer Vision and Pattern Recognition · Computer Science 2023-04-12 Jing Qin , Biyun Xie

The Laplacian eigenvalues of a network play an important role in the analysis of many structural and dynamical network problems. In this paper, we study the relationship between the eigenvalue spectrum of the normalized Laplacian matrix and…

Social and Information Networks · Computer Science 2013-10-21 Zhengwei Wu , Victor M. Preciado

Low-complexity non-smooth convex regularizers are routinely used to impose some structure (such as sparsity or low-rank) on the coefficients for linear predictors in supervised learning. Model consistency consists then in selecting the…

Optimization and Control · Mathematics 2019-01-17 Jalal Fadili , Guillaume Garrigos , Jérome Malick , Gabriel Peyré

Regularization is a well studied problem in the context of neural networks. It is usually used to improve the generalization performance when the number of input samples is relatively small or heavily contaminated with noise. The…

Artificial Intelligence · Computer Science 2011-04-19 Salah Rifai , Xavier Glorot , Yoshua Bengio , Pascal Vincent

We present new, original and alternative method for searching signals coded in noisy data. The method is based on the properties of random matrix eigenvalue spectra. First, we describe general ideas and support them with results of…

Data Analysis, Statistics and Probability · Physics 2015-05-28 D. Grech , J. Miskiewicz

We develop techniques to solve ill-posed inverse problems on the sphere by sparse regularisation, exploiting sparsity in both axisymmetric and directional scale-discretised wavelet space. Denoising, inpainting, and deconvolution problems,…

Information Theory · Computer Science 2017-08-17 Christopher G. R. Wallis , Yves Wiaux , Jason D. McEwen

This paper focuses on recovering an unknown vector $\beta$ from the noisy data $Y=X\beta +\sigma\xi$, where $X$ is a known $n\times p$-matrix, $\xi $ is a standard white Gaussian noise, and $\sigma$ is an unknown noise level. In order to…

Statistics Theory · Mathematics 2011-12-30 Yuri Golubev

The recently developed data-driven eigenmatrix method shows very promising reconstruction accuracy in sparse recovery for a wide range of kernel functions and random sample locations. However, its current implementation can lead to…

Numerical Analysis · Mathematics 2024-05-15 Koung Hee Leem , Jun Liu , George Pelekanos

Semi-supervised Laplacian regularization, a standard graph-based approach for learning from both labelled and unlabelled data, was recently demonstrated to have an insignificant high dimensional learning efficiency with respect to…

Machine Learning · Computer Science 2020-06-16 Xiaoyi Mai , Romain Couillet

Numerical computations involving rational matrices often benefit from preserving underlying matrix structures such as symmetry, Hermitian properties, or sparsity that reflect physical, geometric, or algebraic characteristics of the system.…

Rings and Algebras · Mathematics 2026-02-26 Avisek Bist , Namita Behera

One of the major issues in signed networks is to use network structure to predict the missing sign of an edge. In this paper, we introduce a novel probabilistic approach for the sign prediction problem. The main characteristic of the…

Social and Information Networks · Computer Science 2018-02-20 Amin Javari , HongXiang Qiu , Elham Barzegaran , Mahdi Jalili , Kevin Chen-Chuan Chang

We study the spectral properties of a class of random matrices where the matrix elements depend exponentially on the distance between uniformly and randomly distributed points. This model arises naturally in various physical contexts, such…

Disordered Systems and Neural Networks · Physics 2015-05-18 Ariel Amir , Yuval Oreg , Yoseph Imry

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini

Generalized linear model with $L_1$ and $L_2$ regularization is a widely used technique for solving classification, class probability estimation and regression problems. With the numbers of both features and examples growing rapidly in the…

Machine Learning · Statistics 2017-06-28 Ilya Trofimov , Alexander Genkin

Recovering a low-complexity signal from its noisy observations by regularization methods is a cornerstone of inverse problems and compressed sensing. Stable recovery ensures that the original signal can be approximated linearly by optimal…

Optimization and Control · Mathematics 2025-05-30 Tran T. A. Nghia , Huy N. Pham , Nghia V. Vo

In this work, we investigate data fitting problems with random noises. A randomized progressive iterative regularization method is proposed. It works well for large-scale matrix computations and converges in expectation to the least-squares…

Numerical Analysis · Mathematics 2025-06-05 Dakang Cen , Wenlong Zhang , Junbin Zhong