English
Related papers

Related papers: Statistical mechanics of the maximum-average subma…

200 papers

In this paper we study the phase diagram of a Sherrington-Kirkpatrick (SK) model where the couplings are forced to thermalize at different time scales. Besides being a challenging generalization of the SK model, such settings may arise…

Mathematical Physics · Physics 2026-01-14 Francesco Camilli , Pierluigi Contucci , Emanuele Mingione , Daniele Tantari

Can the behavior of a random matrix be improved by modifying a small fraction of its entries? Consider a random matrix $A$ with i.i.d. entries. We show that the operator norm of $A$ can be reduced to the optimal order $O(\sqrt{n})$ by…

Probability · Mathematics 2017-11-02 Elizaveta Rebrova , Roman Vershynin

We study the problem of testing and recovering $k$-clique Ferromagnetic mean shift in the planted Sherrington-Kirkpatrick model (i.e., a type of spin glass model) with $n$ spins. The planted SK model -- a stylized mixture of an uncountable…

Statistics Theory · Mathematics 2024-03-25 Yihan He , Han Liu , Jianqing Fan

During the last years, through the combined effort of the insight, coming from physical intuition and computer simulation, and the exploitation of rigorous mathematical methods, the main features of the mean field Sherrington-Kirkpatrick…

Disordered Systems and Neural Networks · Physics 2015-05-18 Adriano Barra , Aldo Di Biasio , Francesco Guerra

Random matrix theory successfully models many systems, from the energy levels of heavy nuclei to zeros of $L$-functions. While most ensembles studied have continuous spectral distribution, Burkhardt et al introduced the ensemble of…

Probability · Mathematics 2020-09-24 Fangu Chen , Jiahui Yu , Steven J. Miller , Yuxin Lin

We study random submatrices of a large matrix A. We show how to approximately compute A from its random submatrix of the smallest possible size O(r log r) with a small error in the spectral norm, where r = ||A||_F^2 / ||A||_2^2 is the…

Functional Analysis · Mathematics 2016-12-23 Mark Rudelson , Roman Vershynin

We study the statistical decision process of detecting the low-rank signal from various signal-plus-noise type data matrices, known as the spiked random matrix models. We first show that the principal component analysis can be improved by…

Statistics Theory · Mathematics 2023-01-18 Ji Hyung Jung , Hye Won Chung , Ji Oon Lee

Tensor models play an increasingly prominent role in many fields, notably in machine learning. In several applications, such as community detection, topic modeling and Gaussian mixture learning, one must estimate a low-rank signal from a…

Machine Learning · Statistics 2022-06-16 José Henrique de Morais Goulart , Romain Couillet , Pierre Comon

We derive the zero-temperature phase diagram of spin glass models with a generic fraction of ferromagnetic interactions on the Bethe lattice. We use the cavity method at the level of one-step replica symmetry breaking (1RSB) and we find…

Disordered Systems and Neural Networks · Physics 2009-11-10 Tommaso Castellani , Florent Krzakala , Federico Ricci-Tersenghi

This article is an extended version of previous work of the authors [40, 41] on low-rank matrix estimation in the presence of constraints on the factors into which the matrix is factorized. Low-rank matrix factorization is one of the basic…

Statistics Theory · Mathematics 2017-08-28 Thibault Lesieur , Florent Krzakala , Lenka Zdeborová

We consider increasingly complex models of matrix denoising and dictionary learning in the Bayes-optimal setting, in the challenging regime where the matrices to infer have a rank growing linearly with the system size. This is in contrast…

Information Theory · Computer Science 2022-09-14 Jean Barbier , Nicolas Macris

We consider the problem of designing optimal $M \times N$ ($M \leq N$) sensing matrices which minimize the maximum condition number of all the submatrices of $K$ columns. Such matrices minimize the worst-case estimation errors when only $K$…

Information Theory · Computer Science 2012-06-04 Hema Kumari Achanta , Soura Dasgupta , Weiyu Xu

The use of Mean-Field theory to unwrap principal phase patterns has been recently proposed. In this paper we generalize the Mean-Field approach to process phase patterns with arbitrary degree of undersampling. The phase unwrapping problem…

Statistical Mechanics · Physics 2009-10-31 S. Stramaglia , A. Refice , L. Guerriero

Optimizing a high-dimensional non-convex function is, in general, computationally hard and many problems of this type are hard to solve even approximately. Complexity theory characterizes the optimal approximation ratios achievable in…

Statistical Mechanics · Physics 2020-09-25 Ahmed El Alaoui , Andrea Montanari

The concept of replica symmetry breaking found in the solution of the mean-field Sherrington-Kirkpatrick spin-glass model has been applied to a variety of problems in science ranging from biological to computational and even financial…

Disordered Systems and Neural Networks · Physics 2008-03-25 Helmut G. Katzgraber , Alexander K. Hartmann , A. P. Young

An important yet challenging problem in numerical linear algebra is finding a principal submatrix with maximum determinant from a given symmetric positive semidefinite matrix. This problem arises in experimental design, statistics, and…

Optimization and Control · Mathematics 2026-05-26 Hao Hu , Stefan Sremac , Hugo J. Woerdeman , Henry Wolkowicz

We consider the probability distribution of large deviations in the spin-glass free energy for the Sherrington-Kirkpatrick mean field model, i.e. the exponentially small probability of finding a system with intensive free energy smaller…

Disordered Systems and Neural Networks · Physics 2012-10-31 Giorgio Parisi , Tommaso Rizzo

We analyse the matrix factorization problem. Given a noisy measurement of a product of two matrices, the problem is to estimate back the original matrices. It arises in many applications such as dictionary learning, blind matrix…

Numerical Analysis · Computer Science 2016-07-19 Yoshiyuki Kabashima , Florent Krzakala , Marc Mézard , Ayaka Sakata , Lenka Zdeborová

An algorithmic limit of compressed sensing or related variable-selection problems is analytically evaluated when a design matrix is given by an overcomplete random matrix. The replica method from statistical mechanics is employed to derive…

Disordered Systems and Neural Networks · Physics 2018-11-14 Tomoyuki Obuchi , Yoshinori Nakanishi-Ohno , Masato Okada , Yoshiyuki Kabashima

We study the chaotic behavior of the Gibbs state of spin-glasses under the application of an external magnetic field, in the crossover region where the field intensity scales proportional to $1/\sqrt{N}$, being $N$ the system size. We show…