English
Related papers

Related papers: Extreme value theory for singular subspace estimat…

200 papers

Score-based generative models achieve state-of-the-art sampling performance by denoising a distribution perturbed by Gaussian noise. In this paper, we focus on a single deterministic denoising step, and compare the optimal denoiser for the…

Machine Learning · Computer Science 2026-03-18 Eliot Beyler , Francis Bach

Matrix completion algorithms recover a low rank matrix from a small fraction of the entries, each entry contaminated with additive errors. In practice, the singular vectors and singular values of the low rank matrix play a pivotal role for…

Methodology · Statistics 2016-05-03 Juhee Cho , Donggyu Kim , Karl Rohe

Maximum-type statistics of certain functions of the sample covariance matrix of high-dimensional vector time series are studied to statistically confirm or reject the null hypothesis that a data set has been collected under normal…

Statistics Theory · Mathematics 2023-10-13 Ansgar Steland

After decades of attention, emergence continues to lack a centralized mathematical definition that leads to a rigorous emergence test applicable to physical flocks and swarms, particularly those containing both deterministic elements (eg,…

Multiagent Systems · Computer Science 2024-06-24 Imraan A. Faruque , Ishriak Ahmed

Structure-agnostic causal inference studies how well one can estimate a treatment effect given black-box machine learning estimates of nuisance functions (like the impact of confounders on treatment and outcomes). Here, we find that the…

Machine Learning · Statistics 2025-11-10 Jikai Jin , Lester Mackey , Vasilis Syrgkanis

We study denoising score matching (DSM) when the latent distribution is supported on a smooth embedded manifold $M \subset \mathbb{R}^D$. Under ambient Gaussian corruption, the tangent denoising target contains a singular normal-fiber noise…

Machine Learning · Statistics 2026-05-28 Divit Rawal

This study explores the application of a two-level algorithm to enhance the signal-to-noise ratio of glueball calculations in four-dimensional $\mathrm{SU(3)}$ pure gauge theory. Our findings demonstrate that the statistical errors exhibit…

High Energy Physics - Lattice · Physics 2024-06-19 Lorenzo Barca , Francesco Knechtli , Sofie Martins , Michael Peardon , Stefan Schaefer , Juan Andrés Urrea-Niño

In this manuscript we consider denoising of large rectangular matrices: given a noisy observation of a signal matrix, what is the best way of recovering the signal matrix itself? For Gaussian noise and rotationally-invariant signal priors,…

Disordered Systems and Neural Networks · Physics 2022-10-03 Emanuele Troiani , Vittorio Erba , Florent Krzakala , Antoine Maillard , Lenka Zdeborová

High-dimensional inference refers to problems of statistical estimation in which the ambient dimension of the data may be comparable to or possibly even larger than the sample size. We study an instance of high-dimensional inference in…

Statistics Theory · Mathematics 2009-12-31 Sahand Negahban , Martin J. Wainwright

This paper develops a new mathematical framework for denoising in blind two-dimensional (2D) super-resolution upon using the atomic norm. The framework denoises a signal that consists of a weighted sum of an unknown number of time-delayed…

Information Theory · Computer Science 2023-07-19 Mohamed A. Suliman , Wei Dai

We consider the high-dimensional linear regression model and assume that a fraction of the measurements are altered by an adversary with complete knowledge of the data and the underlying distribution. We are interested in a scenario where…

Statistics Theory · Mathematics 2023-12-11 Stanislav Minsker , Mohamed Ndaoud , Lang Wang

Classical multidimensional scaling only works well when the noisy distances observed in a high dimensional space can be faithfully represented by Euclidean distances in a low dimensional space. Advanced models such as Maximum Variance…

Machine Learning · Statistics 2014-06-24 Chao Ding , Hou-Duo Qi

Tweedie distributions are a special case of exponential dispersion models, which are often used in classical statistics as distributions for generalized linear models. Here, we reveal that Tweedie distributions also play key roles in modern…

Image and Video Processing · Electrical Eng. & Systems 2021-12-08 Kwanyoung Kim , Taesung Kwon , Jong Chul Ye

We analyze a class of estimators based on convex relaxation for solving high-dimensional matrix decomposition problems. The observations are noisy realizations of a linear transformation $\mathfrak{X}$ of the sum of an approximately) low…

Machine Learning · Statistics 2012-08-09 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

Despite the importance of denoising in modern machine learning and ample empirical work on supervised denoising, its theoretical understanding is still relatively scarce. One concern about studying supervised denoising is that one might not…

Machine Learning · Computer Science 2024-03-18 Chinmaya Kausik , Kashvi Srivastava , Rishi Sonthalia

This paper is concerned with estimating the column space of an unknown low-rank matrix $\boldsymbol{A}^{\star}\in\mathbb{R}^{d_{1}\times d_{2}}$, given noisy and partial observations of its entries. There is no shortage of scenarios where…

Statistics Theory · Mathematics 2022-09-13 Changxiao Cai , Gen Li , Yuejie Chi , H. Vincent Poor , Yuxin Chen

Recent work has generalized several results concerning the well-understood spiked Wigner matrix model of a low-rank signal matrix corrupted by additive i.i.d. Gaussian noise to the inhomogeneous case, where the noise has a variance profile.…

Statistics Theory · Mathematics 2025-10-10 Debsurya De , Dmitriy Kunisky

We consider the high-dimensional inference problem where the signal is a low-rank symmetric matrix which is corrupted by an additive Gaussian noise. Given a probabilistic model for the low-rank matrix, we compute the limit in the large…

Probability · Mathematics 2017-03-31 Marc Lelarge , Léo Miolane

Likelihood-based deep generative models have recently been shown to exhibit pathological behaviour under the manifold hypothesis as a consequence of using high-dimensional densities to model data with low-dimensional structure. In this…

We study least-squares trace regression when the parameter is the sum of a $r$-low-rank matrix and a $s$-sparse matrix and a fraction $\epsilon$ of the labels is corrupted. For subgaussian distributions and feature-dependent noise, we…

Statistics Theory · Mathematics 2024-01-08 Philip Thompson