English
Related papers

Related papers: Detection limits in the high-dimensional spiked re…

200 papers

For regression model selection via maximum likelihood estimation, we adopt a vector representation of candidate models and study the likelihood ratio confidence region for the regression parameter vector of a full model. We show that when…

Statistics Theory · Mathematics 2024-04-09 Min Tsao

In this paper we introduce a novel approach for an important problem of break detection. Specifically, we are interested in detection of an abrupt change in the covariance structure of a high-dimensional random process -- a problem, which…

Statistics Theory · Mathematics 2020-07-30 Valeriy Avanesov , Nazar Buzun

We consider the quickest change detection problem where both the parameters of pre- and post- change distributions are unknown, which prevents the use of classical simple hypothesis testing. Without additional assumptions, optimal solutions…

Machine Learning · Computer Science 2021-06-10 Firas Jarboui , Viannet Perchet

The Latent Block Model (LBM) is a model-based method to cluster simultaneously the $d$ columns and $n$ rows of a data matrix. Parameter estimation in LBM is a difficult and multifaceted problem. Although various estimation strategies have…

Statistics Theory · Mathematics 2020-02-26 Vincent Brault , Christine Keribin , Mahendra Mariadassou

An important challenge in statistical analysis concerns the control of the finite sample bias of estimators. For example, the maximum likelihood estimator has a bias that can result in a significant inferential loss. This problem is…

Statistics Theory · Mathematics 2019-11-04 Stéphane Guerrier , Mucyo Karemera , Samuel Orso , Maria-Pia Victoria-Feser

We consider a prototypical problem of Bayesian inference for a structured spiked model: a low-rank signal is corrupted by additive noise. While both information-theoretic and algorithmic limits are well understood when the noise is a…

Information Theory · Computer Science 2024-07-09 Jean Barbier , Francesco Camilli , Marco Mondelli , Yizhou Xu

The spiked model is an important special case of the Wishart ensemble, and a natural generalization of the white Wishart ensemble. Mathematically, it can be defined on three kinds of variables: the real, the complex and the quaternion. For…

Probability · Mathematics 2008-04-08 Dong Wang

This paper investigates the ability of the stochastic subspace identification technique to return a valid model from finite measurement data, its asymptotic properties as the data set becomes large, and asymptotic error bounds of the…

Systems and Control · Computer Science 2017-06-06 Quan Li , Jeffrey T. Scruggs

We introduce a new approach to prediction in graphical models with latent-shift adaptation, i.e., where source and target environments differ in the distribution of an unobserved confounding latent variable. Previous work has shown that as…

Machine Learning · Statistics 2023-06-26 William I. Walker , Arthur Gretton , Maneesh Sahani

A Wishart matrix is said to be spiked when the underlying covariance matrix has a single eigenvalue $b$ different from unity. As $b$ increases through $b=2$, a gap forms from the largest eigenvalue to the rest of the spectrum, and with…

Mathematical Physics · Physics 2014-07-01 Peter J. Forrester

Detection limits (DLs), where a variable is unable to be measured outside of a certain range, are common in research. Most approaches to handle DLs in the response variable implicitly make parametric assumptions on the distribution of data…

Methodology · Statistics 2022-07-07 Yuqi Tian , Chun Li , Shengxin Tu , Nathan T. James , Frank E. Harrell , Bryan E. Shepherd

Model selection, via penalized likelihood type criteria, is a standard task in many statistical inference and machine learning problems. Progress has led to deriving criteria with asymptotic consistency results and an increasing emphasis on…

Statistics Theory · Mathematics 2022-05-13 TrungTin Nguyen , Faicel Chamroukhi , Hien Duy Nguyen , Florence Forbes

Anomaly detection is defined as the problem of finding data points that do not follow the patterns of the majority. Among the various proposed methods for solving this problem, classification-based methods, including one-class Support…

Optimization and Control · Mathematics 2023-12-05 Amir Hossein Noormohammadia , Seyed Ali MirHassania , Farnaz Hooshmand Khaligh

We study here the so-called spiked Wigner and Wishart models, where one observes a low-rank matrix perturbed by some Gaussian noise. These models encompass many classical statistical tasks such as sparse PCA, submatrix localization,…

Probability · Mathematics 2019-06-25 Léo Miolane

We introduce a random matrix framework for studying statistical-mechanical lattice systems through spectral observables. Equilibrium configurations sampled from a Boltzmann measure are mapped to matrix ensembles whose covariance structure…

Disordered Systems and Neural Networks · Physics 2026-05-21 Yaprak Önder , Abbas Ali Saberi , Roderich Moessner

We study a disordered vibrational model system, where the spring constants k are chosen from a distribution P(k) ~ 1/k above a cut-off value k_min > 0. We can motivate this distribution by the presence of free volume in glassy materials. We…

Disordered Systems and Neural Networks · Physics 2009-10-31 Jan W. Kantelhardt , Stefanie Russ , Armin Bunde

We derive the asymptotic distributions of the spiked eigenvalues and eigenvectors under a generalized and unified asymptotic regime, which takes into account the spike magnitude of leading eigenvalues, sample size, and dimensionality. This…

Statistics Theory · Mathematics 2015-09-15 Jianqing Fan , Weichen Wang

We consider the problem of algorithmically sampling from the Gibbs measure of a mixed $p$-spin spherical spin glass. We give a polynomial-time algorithm that samples from the Gibbs measure up to vanishing total variation error, for any…

Probability · Mathematics 2024-04-25 Brice Huang , Andrea Montanari , Huy Tuan Pham

In the sparse normal means model, coverage of adaptive Bayesian posterior credible sets associated to spike and slab prior distributions is considered. The key sparsity hyperparameter is calibrated via marginal maximum likelihood empirical…

Statistics Theory · Mathematics 2019-02-05 Ismael Castillo , Botond Szabo

A disordered mean field model for multimode laser in open and irregular cavities is proposed and discussed within the replica analysis. The model includes the dynamics of the mode intensity and accounts also for the possible presence of a…

Statistical Mechanics · Physics 2015-05-20 Fabrizio Antenucci , Andrea Crisanti , Luca Leuzzi