English
Related papers

Related papers: Detection limits in the high-dimensional spiked re…

200 papers

This paper is concerned with the problem of Model Predictive Control and Rolling Horizon Control of discrete-time systems subject to possibly unbounded random noise inputs, while satisfying hard bounds on the control inputs. We use a…

Optimization and Control · Mathematics 2010-09-08 Peter Hokayem , Debasish Chatterjee , John Lygeros

We analyze the behavior of a non-Hermitian opened one-dimensional quantum system with $\mathcal{PT}$ symmetry. This system is built by a dimer, with balanced gains and losses described by a parameter $\gamma$. By varying $\gamma$ the system…

Quantum Physics · Physics 2024-04-11 J. Colín-Gálvez , E. Castaño , G. Báez , V. Domínguez-Rocha

We revisit the fundamental question of simple-versus-simple hypothesis testing with an eye towards computational complexity, as the statistically optimal likelihood ratio test is often computationally intractable in high-dimensional…

Statistics Theory · Mathematics 2025-05-05 Ankur Moitra , Alexander S. Wein

We consider the linearly transformed spiked model, where observations $Y_i$ are noisy linear transforms of unobserved signals of interest $X_i$: \begin{align*} Y_i = A_i X_i + \varepsilon_i, \end{align*} for $i=1,\ldots,n$. The transform…

Statistics Theory · Mathematics 2018-07-13 Edgar Dobriban , William Leeb , Amit Singer

Peak counts have been shown to be an excellent tool to extract the non-Gaussian part of the weak lensing signal. Recently, we developped a fast stochastic forward model to predict weak-lensing peak counts. Our model is able to reconstruct…

Cosmology and Nongalactic Astrophysics · Physics 2015-11-16 Chieh-An Lin , Martin Kilbinger

A uniform shrinkage prior (USP) distribution on the unknown variance component of a random-effects model is known to produce good frequency properties. The USP has a parameter that determines the shape of its density function, but it has…

Methodology · Statistics 2017-12-12 Hyungsuk Tak

This paper considers the problem of detecting equal-shaped non-overlapping unimodal peaks in the presence of Gaussian ergodic stationary noise, where the number, location and heights of the peaks are unknown. A multiple testing approach is…

Methodology · Statistics 2010-08-12 Armin Schwartzman , Yulia Gavrilov , Robert J. Adler

We study a model of random surfaces arising in the dimer model on the honeycomb lattice. For a fixed ``wire frame'' boundary condition, as the lattice spacing $\epsilon\to0$, Cohn, Kenyon and Propp [CKP] showed the almost sure convergence…

Mathematical Physics · Physics 2007-06-13 Richard Kenyon

Given a random sample from a multivariate population, estimating the number of large eigenvalues of the population covariance matrix is an important problem in Statistics with wide applications in many areas. In the context of Principal…

Statistics Theory · Mathematics 2020-11-10 Abhinav Chakraborty , Soumendu Sundar Mukherjee , Arijit Chakrabarti

The power spectrum (PS) of mass density fluctuations, independent of `biasing', is estimated from the Mark III catalog of peculiar velocities using Bayesian statistics. A parametric model is assumed for the PS, and the free parameters are…

Astrophysics · Physics 2009-10-28 S. Zaroubi , I. Zehavi , A. Dekel , Y. Hoffman , T. Kolatt

It has been shown in recent years that the stochastic block model (SBM) is sometimes undetectable in the sparse limit, i.e., that no algorithm can identify a partition correlated with the partition used to generate an instance, if the…

We consider a special type of Restricted Boltzmann machine (RBM), namely a Gaussian-spherical RBM where the visible units have Gaussian priors while the vector of hidden variables is constrained to stay on an ${\mathbbm L}_2$ sphere. The…

Disordered Systems and Neural Networks · Physics 2023-07-17 Aurélien Decelle , Cyril Furtlehner

High-dimensional data sets are commonly collected in many contemporary applications arising in various fields of scientific research. We present two views of finite samples in high dimensions: a probabilistic one and a nonprobabilistic one.…

Statistics Theory · Mathematics 2013-11-13 Jinchi Lv

We address high dimensional covariance estimation for elliptical distributed samples, which are also known as spherically invariant random vectors (SIRV) or compound-Gaussian processes. Specifically we consider shrinkage methods that are…

Methodology · Statistics 2015-05-20 Yilun Chen , Ami Wiesel , Alfred O. Hero

Let the dimension $N$ of data and the sample size $T$ tend to $\infty$ with $N/T \to c > 0$. The spectral properties of a sample correlation matrix $\mathbf{C}$ and a sample covariance matrix $\mathbf{S}$ are asymptotically equal whenever…

Statistics Theory · Mathematics 2024-07-11 Yohji Akama , Peng Tian

We investigate dynamics of an inference algorithm termed the belief propagation (BP) when employed in spin glass (SG) models and show that its macroscopic behaviors can be traced by recursive updates of certain auxiliary field distributions…

Disordered Systems and Neural Networks · Physics 2009-11-07 Yoshiyuki Kabashima

The Sherrington--Kirkpatrick model of spin glasses, the Hopfield model of neural networks and the Ising spin glass are all models of binary data belonging to the one-parameter exponential family with quadratic sufficient statistic. Under…

Probability · Mathematics 2007-12-18 Sourav Chatterjee

The boson peak (BP), a low-energy excess in the vibrational density of states over the phonon Debye contribution, is usually identified as one of the distinguishing features between ordered crystals and amorphous solid materials. Despite…

Soft Condensed Matter · Physics 2023-08-23 Cunyuan Jiang , Matteo Baggioli , Jack F. Douglas

To model modern large-scale datasets, we need efficient algorithms to infer a set of $P$ unknown model parameters from $N$ noisy measurements. What are fundamental limits on the accuracy of parameter inference, given finite signal-to-noise…

Machine Learning · Statistics 2016-09-07 Madhu Advani , Surya Ganguli

In this paper we study the asymptotic normality in high-dimensional linear regression. We focus on the case where the covariance matrix of the regression variables has a KMS structure, in asymptotic settings where the number of predictors,…

Statistics Theory · Mathematics 2022-05-17 Saulius Jokubaitis , Remigijus Leipus