English
Related papers

Related papers: Detection problems in the spiked matrix models

200 papers

Random-matrix theory helps disentangle signal from noise in large data sets. We analyze rectangular $p \times q$ matrices $W = W_0 + M$ in which the noise $M$ generates a Marchenko-Pastur bulk, whereas the signal $W_0$ injects an extensive…

Disordered Systems and Neural Networks · Physics 2025-11-25 Niklas Forner , Alexander Maloney , Bernd Rosenow

In large-scale systems, complex internal relationships are often present. Such interconnected systems can be effectively described by low rank stochastic processes. When identifying a predictive model of low rank processes from sampling…

Machine Learning · Computer Science 2025-01-17 Wenqi Cao , Aming Li

We study the performance of a Bayesian statistician who estimates a rank-one signal corrupted by non-symmetric rotationally invariant noise with a generic distribution of singular values. As the signal-to-noise ratio and the noise structure…

Information Theory · Computer Science 2023-02-09 Teng Fu , YuHao Liu , Jean Barbier , Marco Mondelli , ShanSuo Liang , TianQi Hou

We provide a rigorous random matrix theory analysis of spiked cross-covariance models where the signals across two high-dimensional data channels are partially aligned. These models are motivated by multi-modal learning and form the…

Statistics Theory · Mathematics 2026-02-23 Pierre Mergny , Lenka Zdeborová

In a previous paper (gr-qc/0105100) we derived a set of near-optimal signal detection techniques for gravitational wave detectors whose noise probability distributions contain non-Gaussian tails. The methods modify standard methods by…

General Relativity and Quantum Cosmology · Physics 2009-11-07 Bruce Allen , Jolien D. E. Creighton , Eanna E. Flanagan , Joseph D. Romano

We present new, original and alternative method for searching signals coded in noisy data. The method is based on the properties of random matrix eigenvalue spectra. First, we describe general ideas and support them with results of…

Data Analysis, Statistics and Probability · Physics 2015-05-28 D. Grech , J. Miskiewicz

We consider the problem of detecting (testing) Gaussian stochastic sequences (signals) with imprecisely known means and covariance matrices. The alternative is independent identically distributed zero-mean Gaussian random variables with…

Information Theory · Computer Science 2023-02-28 Marat V. Burnashev

We consider a statistical problem of detection of a signal with unknown energy in a multi-channel system, observed in a Gaussian noise. We assume that the signal can appear in the $k$-th channel with a known small prior probability…

Statistics Theory · Mathematics 2017-12-19 Evgeny Burnaev , Georgy Golubev

This note presents a unified analysis of the identification of dynamical systems with low-rank constraints under high-dimensional scaling. This identification problem for dynamic systems are challenging due to the intrinsic dependency of…

Statistics Theory · Mathematics 2019-12-23 Junlin Li

Although a generalized spike population model has been actively studied in random matrix theory, its application to real data has been rarely explored. We find that most methods for determining the number of spikes based on the Johnstone's…

Methodology · Statistics 2018-05-01 Hyo Young Choi , J. S. Marron

We consider the Principal Component Analysis problem for large tensors of arbitrary order $k$ under a single-spike (or rank-one plus noise) model. On the one hand, we use information theory, and recent results in probability theory, to…

Machine Learning · Computer Science 2014-11-06 Andrea Montanari , Emile Richard

We consider the problem of estimating a rank-1 signal corrupted by structured rotationally invariant noise, and address the following question: how well do inference algorithms perform when the noise statistics is unknown and hence Gaussian…

Information Theory · Computer Science 2022-05-23 Jean Barbier , TianQi Hou , Marco Mondelli , Manuel Sáenz

System identification is of special interest in science and engineering. This article is concerned with a system identification problem arising in stochastic dynamic systems, where the aim is to estimate the parameters of a system along…

Methodology · Statistics 2022-01-27 Christos Merkatas , Simo Särkkä

Signal processing in non-Gaussian noise environment is addressed in this paper. For many real-life situations, the additive noise process present in the system is found to be dominantly non-Gaussian. The problem of detection and estimation…

Statistics Theory · Mathematics 2014-01-23 Jugalkishore K. Banoth , Pradip Sircar

The detection problem in statistical signal processing can be succinctly formulated: Given m (possibly) signal bearing, n-dimensional signal-plus-noise snapshot vectors (samples) and N statistically independent n-dimensional noise-only…

Information Theory · Computer Science 2009-02-26 N. Raj Rao , Jack W. Silverstein

This paper investigates the problem of sparse support detection (SSD) via a detection-oriented algorithm named Bayesian hypothesis test via belief propagation (BHT-BP). Our main focus is to compare BHT-BP to an estimation-based algorithm,…

Information Theory · Computer Science 2013-04-09 Jaewook Kang , Heung-No Lee , Kiseon Kim

The interplay between computational efficiency and statistical accuracy in high-dimensional inference has drawn increasing attention in the literature. In this paper, we study computational and statistical boundaries for submatrix…

Statistics Theory · Mathematics 2020-07-27 T. Tony Cai , Tengyuan Liang , Alexander Rakhlin

Recent work has generalized several results concerning the well-understood spiked Wigner matrix model of a low-rank signal matrix corrupted by additive i.i.d. Gaussian noise to the inhomogeneous case, where the noise has a variance profile.…

Statistics Theory · Mathematics 2025-10-10 Debsurya De , Dmitriy Kunisky

Large-scale modern data often involves estimation and testing for high-dimensional unknown parameters. It is desirable to identify the sparse signals, ``the needles in the haystack'', with accuracy and false discovery control. However, the…

Machine Learning · Computer Science 2021-11-08 Junhui Cai , Xu Han , Ya'acov Ritov , Linda Zhao

We propose an estimator for the singular vectors of high-dimensional low-rank matrices corrupted by additive subgaussian noise, where the noise matrix is allowed to have dependence within rows and heteroskedasticity between them. We prove…

Statistics Theory · Mathematics 2022-09-15 Joshua Agterberg , Zachary Lubberts , Carey Priebe