English
Related papers

Related papers: Phase transitions in spiked matrix estimation: inf…

200 papers

Percolation on complex networks is used both as a model for dynamics on networks, such as network robustness or epidemic spreading, and as a benchmark for our models of networks, where our ability to predict percolation measures our ability…

Physics and Society · Physics 2019-08-21 Laurent Hébert-Dufresne , Antoine Allard

In this document, some general results in approximation theory and matrix analysis with applications to sparse identification of time series models and nonlinear discrete-time dynamical systems are presented. The aforementioned theoretical…

Numerical Analysis · Mathematics 2021-08-04 Fredy Vides

Dynamical phase transitions are nonequilibrium counterparts of thermodynamic phase transitions and share many similarities with their equilibrium analogs. In continuous phase transitions, critical exponents play a key role in characterizing…

Statistical Mechanics · Physics 2025-06-09 Timo Schorlepp , Ohad Shpielberg

One major challenge for living cells is the measurement and prediction of signals corrupted by noise. In general, cells need to make decisions based on their compressed representation of noisy, time-varying signals. Strategies for signal…

Quantitative Methods · Quantitative Biology 2023-07-07 Jenny Poulton , Age Tjalma , Lotte Slim , Pieter Rein ten Wolde

Probabilistic machine learning models are distinguished by their ability to integrate prior knowledge of noise statistics, smoothness parameters, and training data uncertainty. A common approach involves modeling data with Gaussian…

Computation · Statistics 2025-07-31 Cristian A. Galvis-Florez , Ahmad Farooq , Simo Särkkä

The ability to understand and solve high-dimensional inference problems is essential for modern data science. This article examines high-dimensional inference problems through the lens of information theory and focuses on the standard…

Information Theory · Computer Science 2019-07-05 Galen Reeves , Henry Pfister

This paper proposes simple moment based spectrum sensing algorithm for cognitive radio networks in a flat fading channel. It is assumed that the transmitted signal samples are binary (quadrature) phase-shift keying BPSK (QPSK), Mary…

Applications · Statistics 2013-11-26 Tadilo Endeshaw Bogale , Luc Vandendorpe

The effective use of noisy intermediate-scale quantum devices requires error mitigation to improve the accuracy of sampled measurement distributions. The more accurately the effects of noise on these distributions can be modeled, the more…

Quantum Physics · Physics 2024-04-24 Michael Hanks , Soovin Lee , M. S. Kim

We consider the prediction of weak effects in a multiple-output regression setup, when covariates are expected to explain a small amount, less than $\approx 1%$, of the variance of the target variables. To facilitate the prediction of the…

We consider the problem of estimating the factors of a low-rank $n \times d$ matrix, when this is corrupted by additive Gaussian noise. A special example of our setting corresponds to clustering mixtures of Gaussians with equal (known)…

Statistics Theory · Mathematics 2022-11-02 Andrea Montanari , Yuchen Wu

We study the problem of estimating a large, low-rank matrix corrupted by additive noise of unknown covariance, assuming one has access to additional side information in the form of noise-only measurements. We study the Whiten-Shrink-reColor…

Statistics Theory · Mathematics 2023-07-18 Matan Gavish , William Leeb , Elad Romanov

In many industrial applications, signals with short periodic pulses, caused by repeated steps in the manufacturing process, are present, and their fundamental frequency or period may be of interest. Fundamental frequency estimation is in…

This paper investigates statistical inference for noisy matrix completion in a semi-supervised model when auxiliary covariates are available. The model consists of two parts. One part is a low-rank matrix induced by unobserved latent…

Methodology · Statistics 2024-03-27 Shujie Ma , Po-Yao Niu , Yichong Zhang , Yinchu Zhu

Factorizing low-rank matrices has many applications in machine learning and statistics. For probabilistic models in the Bayes optimal setting, a general expression for the mutual information has been proposed using heuristic statistical…

Information Theory · Computer Science 2017-03-24 Jean Barbier , Mohamad Dia , Nicolas Macris , Florent Krzakala , Thibault Lesieur , Lenka Zdeborova

Generally, phase retrieval problem can be viewed as the reconstruction of a function/signal from only the magnitude of the linear measurements. These measurements can be, for example, the Fourier transform of the density function.…

Optimization and Control · Mathematics 2019-11-21 Bing Gao , Haixia Liu , Yang Wang

Tipping points have been shown to be ubiquitous, both in models and empirically in a range of physical and biological systems. The question of how tipping points cascade through systems has been less well studied and is an important one. A…

Dynamical Systems · Mathematics 2020-11-19 Abhishek Mallela , Alan Hastings

Consider a two-class clustering problem where we observe $X_i = \ell_i \mu + Z_i$, $Z_i \stackrel{iid}{\sim} N(0, I_p)$, $1 \leq i \leq n$. The feature vector $\mu\in R^p$ is unknown but is presumably sparse. The class labels…

Statistics Theory · Mathematics 2016-06-09 Jiashun Jin , Zheng Tracy Ke , Wanjie Wang

Approximate message passing (AMP) emerges as an effective iterative paradigm for solving high-dimensional statistical problems. However, prior AMP theory -- which focused mostly on high-dimensional asymptotics -- fell short of predicting…

Statistics Theory · Mathematics 2023-03-20 Gen Li , Yuting Wei

In this work we explore encoding strategies learned by statistical models of sensory coding in noisy spiking networks. Early stages of sensory communication in neural systems can be viewed as encoding channels in the information-theoretic…

Neurons and Cognition · Quantitative Biology 2020-06-30 M. E. Rule , M. Sorbaro , M. H. Hennig

We investigate whether the Wigner semi-circle and Marcenko-Pastur distributions, often used for deep neural network theoretical analysis, match empirically observed spectral densities. We find that even allowing for outliers, the observed…

Machine Learning · Statistics 2021-11-04 Diego Granziol