English
Related papers

Related papers: Extreme value theory for singular subspace estimat…

200 papers

Deep neural networks generalize well despite being exceedingly overparameterized and being trained without explicit regularization. This curious phenomenon has inspired extensive research activity in establishing its statistical principles:…

Machine Learning · Statistics 2021-09-16 Ke Wang , Christos Thrampoulidis

The singular value decomposition is widely used to approximate data matrices with lower rank matrices. Feng and He [Ann. Appl. Stat. 3 (2009) 1634-1654] developed tests on dimensionality of the mean structure of a data matrix based on the…

Statistics Theory · Mathematics 2014-02-28 Xingdong Feng , Xuming He

In an increasing number of applications, it is of interest to recover an approximately low-rank data matrix from noisy observations. This paper develops an unbiased risk estimate---holding in a Gaussian model---for any spectral estimator…

Statistics Theory · Mathematics 2015-06-11 Emmanuel J. Candes , Carlos A. Sing-Long , Joshua D. Trzasko

We study the finite-size scaling of the roughness of signals in systems displaying Gaussian 1/f power spectra. It is found that one of the extreme value distributions (Gumbel distribution) emerges as the scaling function when the boundary…

Statistical Mechanics · Physics 2009-11-07 T. Antal , M. Droz , G. Gyorgyi , Z. Racz

We consider a spectrum-sharing cognitive radio system with antenna selection applied at the secondary transmitter (ST). Based on the extreme value theory, we deduce a simple and accurate expression for the asymptotic distribution of the…

Information Theory · Computer Science 2015-06-18 Ruifeng Duan , Zhong Zheng , Riku Jäntti , Jyri Hämäläinen

Searches for gravitational-wave signals are often based on maximizing a detection statistic over a bank of waveform templates, covering a given parameter space with a variable level of correlation. Results are often evaluated using a…

General Relativity and Quantum Cosmology · Physics 2022-02-15 Rodrigo Tenorio , Luana M. Modafferi , David Keitel , Alicia M. Sintes

The density estimation is one of the core problems in statistics. Despite this, existing techniques like maximum likelihood estimation are computationally inefficient due to the intractability of the normalizing constant. For this reason an…

Machine Learning · Computer Science 2021-01-14 Tsimboy Olga , Yermek Kapushev , Evgeny Burnaev , Ivan Oseledets

This paper studies low-rank matrix completion in the presence of heavy-tailed and possibly asymmetric noise, where we aim to estimate an underlying low-rank matrix given a set of highly incomplete noisy entries. Though the matrix completion…

Statistics Theory · Mathematics 2022-06-10 Bingyan Wang , Jianqing Fan

We study the spherical cap packing problem with a probabilistic approach. Such probabilistic considerations result in an asymptotic sharp universal uniform bound on the maximal inner product between any set of unit vectors and a…

Statistics Theory · Mathematics 2017-05-08 Kai Zhang

In this letter, we address the problem of estimating Gaussian noise level from the trained dictionaries in update stage. We first provide rigorous statistical analysis on the eigenvalue distributions of a sample covariance matrix. Then we…

Signal Processing · Electrical Eng. & Systems 2017-12-12 Rui Chen , Changshui Yang , Huizhu Jia , Xiaodong Xie

This paper considers distributed estimation of linear systems when the state observations are corrupted with Gaussian noise of unbounded support and under possible random adversarial attacks. We consider sensors equipped with single…

Systems and Control · Electrical Eng. & Systems 2021-05-25 Mohammadreza Doostmohammadian , Themistoklis Charalambous , Miadreza Shafie-khah , Nader Meskin , Usman A. Khan

The problem of low-rank matrix completion with heterogeneous and sub-exponential (as opposed to homogeneous and Gaussian) noise is particularly relevant to a number of applications in modern commerce. Examples include panel sales data and…

Machine Learning · Statistics 2021-10-26 Vivek F. Farias , Andrew A. Li , Tianyi Peng

The truncated singular value decomposition may be used to find the solution of linear discrete ill-posed problems in conjunction with Tikhonov regularization and requires the estimation of a regularization parameter that balances between…

Numerical Analysis · Mathematics 2022-08-16 Rosemary A. Renaut , Anthony W. Helmstetter , Saeed Vatankhah

Robustness of deep neural networks to input noise remains a critical challenge, as naive noise injection often degrades accuracy on clean (uncorrupted) data. We propose a novel training framework that addresses this trade-off through two…

Machine Learning · Statistics 2026-01-06 Hai-Vy Nguyen , Fabrice Gamboa , Sixin Zhang , Reda Chhaibi , Serge Gratton , Thierry Giaccone

This paper studies the Gaussian approximation of high-dimensional and non-degenerate U-statistics of order two under the supremum norm. We propose a two-step Gaussian approximation procedure that does not impose structural assumptions on…

Statistics Theory · Mathematics 2016-10-04 Xiaohui Chen

Denoising score matching (DSM) provides a way to learn data distributions by training a neural network to recover the score function, defined as the gradient of the log density, from noise-corrupted samples. Once trained, the score…

Machine Learning · Computer Science 2026-05-11 Victor Livernoche , Jie Zan , Reihaneh Rabbany

Decentralized learning often involves a weighted global loss with heterogeneous node weights $\lambda$. We revisit two natural strategies for incorporating these weights: (i) embedding them into the local losses to retain a uniform weight…

Machine Learning · Computer Science 2026-05-07 Bing Liu , Boao Kong , Limin Lu , Kun Yuan , Chengcheng Zhao

This paper aims to address two fundamental challenges arising in eigenvector estimation and inference for a low-rank matrix from noisy observations: (1) how to estimate an unknown eigenvector when the eigen-gap (i.e. the spacing between the…

Statistics Theory · Mathematics 2021-09-09 Chen Cheng , Yuting Wei , Yuxin Chen

Gaussian smoothing combined with a probabilistic framework for denoising via the empirical Bayes formalism, i.e., the Tweedie-Miyasawa formula (TMF), are the two key ingredients in the success of score-based generative models in Euclidean…

Machine Learning · Statistics 2025-02-04 Francis Bach , Saeed Saremi

There are two major routes to address the ubiquitous family of inverse problems appearing in signal and image processing, such as denoising or deblurring. A first route relies on Bayesian modeling, where prior probabilities are used to…

Statistics Theory · Mathematics 2026-03-24 Rémi Gribonval , Mila Nikolova