English
Related papers

Related papers: Extreme value theory for singular subspace estimat…

200 papers

We study the singular values and Lyapunov exponents of non-stationary random matrix products subject to small, absolutely continuous, additive noise. Consider a fixed sequence of matrices of bounded norm. Independently perturb the matrices…

Probability · Mathematics 2025-12-22 Sam Bednarski , Jonathan DeWitt , Anthony Quas

Given measurements of a linear time-invariant system, the McMillan degree is the dimension of the smallest such system that reproduces these observed dynamics. Using impulse response measurements where the system has been started in some…

Numerical Analysis · Mathematics 2023-03-24 Jeffrey M. Hokanson

We consider the problem of image denoising in the presence of noise whose statistical properties are a combination of two different distributions. We focus on noise distributions that are frequently considered in applications, in particular…

Optimization and Control · Mathematics 2016-11-22 Luca Calatroni , Juan Carlos De Los Reyes , Carola-Bibiane Schönlieb

We study the problem of estimating vector-valued variables from noisy "relative" measurements. This problem arises in several sensor network applications. The measurement model can be expressed in terms of a graph, whose nodes correspond to…

Information Theory · Computer Science 2016-11-17 Prabir Barooah , Joao P. Hespanha

We consider the problem of estimating the factors of a rank-$1$ matrix with i.i.d. Gaussian, rank-$1$ measurements that are nonlinearly transformed and corrupted by noise. Considering two prototypical choices for the nonlinearity, we study…

Optimization and Control · Mathematics 2024-10-02 Kabir Aladin Chandrasekher , Mengqi Lou , Ashwin Pananjady

The extremal inequality approach plays a key role in network information theory problems. In this paper, we propose a novel monotone path construction in product probability space. The optimality of Gaussian distribution is then established…

Information Theory · Computer Science 2021-09-02 Yinfei Xu , Guojun Chen

Being able to reliably assess not only the \emph{accuracy} but also the \emph{uncertainty} of models' predictions is an important endeavour in modern machine learning. Even if the model generating the data and labels is known, computing the…

Machine Learning · Computer Science 2023-09-12 Lucas Clarté , Bruno Loureiro , Florent Krzakala , Lenka Zdeborová

In this work, we study non-asymptotic bounds on correlation between two time realizations of stable linear systems with isotropic Gaussian noise. Consequently, via sampling from a sub-trajectory and using \emph{Talagrands'} inequality, we…

Machine Learning · Statistics 2023-04-05 Muhammad Abdullah Naeem

This paper introduces a unified framework for the detection of a source with a sensor array in the context where the noise variance and the channel between the source and the sensors are unknown at the receiver. The Generalized Maximum…

Probability · Mathematics 2010-06-16 Pascal Bianchi , Merouane Debbah , Mylène Maïda , Jamal Najim

Estimating singular subspaces from noisy matrices is a fundamental problem with wide-ranging applications across various fields. Driven by the challenges of data integration and multi-view analysis, this study focuses on estimating shared…

Statistics Theory · Mathematics 2024-11-27 Zhengchi Ma , Rong Ma

We consider a model where a signal (discrete or continuous) is observed with an additive Gaussian noise process. The signal is issued from a linear combination of a finite but increasing number of translated features. The features are…

Statistics Theory · Mathematics 2024-07-23 Cristina Butucea , Jean-François Delmas , Anne Dutfoy , Clément Hardy

The classical random matrix theory is mostly focused on asymptotic spectral properties of random matrices as their dimensions grow to infinity. At the same time many recent applications from convex geometry to functional analysis to…

Functional Analysis · Mathematics 2014-03-05 Mark Rudelson , Roman Vershynin

Low-rank pseudoinverses are widely used to approximate matrix inverses in scalable machine learning, optimization, and scientific computing. However, real-world matrices are often observed with noise, arising from sampling, sketching, and…

Machine Learning · Computer Science 2025-10-30 Phuc Tran , Nisheeth K. Vishnoi

A considerable amount of research in harmonic analysis has been devoted to non-linear estimators of signals contaminated by additive Gaussian noise. They are implemented by thresholding coefficients in a frame, which provide a sparse signal…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Nathanaël Cuvelle--Magar , Stéphane Mallat

We study the cosmic variance limit on constraining primordial non-Gaussianity for a variety of theory-motivated shapes. We consider general arguments for 2D and 3D surveys, with a particular emphasis on the CMB. A scale-invariant $N$-point…

Cosmology and Nongalactic Astrophysics · Physics 2021-05-11 Alba Kalaja , P. Daniel Meerburg , Guilherme L. Pimentel , William R. Coulton

This study proposes a novel hierarchical prior for inferring possibly low-rank matrices measured with noise. We consider three-component matrix factorization, as in singular value decomposition, and its fully Bayesian inference. The…

Methodology · Statistics 2020-10-09 Masahiro Tanaka

Deep neural networks have established as a powerful tool for large scale supervised classification tasks. The state-of-the-art performances of deep neural networks are conditioned to the availability of large number of accurately labeled…

Computer Vision and Pattern Recognition · Computer Science 2021-06-22 Bharath Bhushan Damodaran , Rémi Flamary , Viven Seguy , Nicolas Courty

We study a new random matrix ensemble $X$ which is constructed by an application of a two dimensional linear filter to a matrix of iid random variables with infinite fourth moments. Our result gives asymptotic lower and upper bounds for the…

Probability · Mathematics 2012-12-03 Oliver Pfaffel

Estimation of a deterministic quantity observed in non-Gaussian additive noise is explored via order statistics approach. More specifically, we study the estimation problem when measurement noises either have positive supports or follow a…

Signal Processing · Electrical Eng. & Systems 2020-07-15 Kamiar Radnosrati , Gustaf Hendeby , Fredrik Gustafsson

This paper proposes two linear projection methods for supervised dimension reduction using only the first and second-order statistics. The methods, each catering to a different parameter regime, are derived under the general Gaussian model…

Information Theory · Computer Science 2024-08-13 Biao Chen , Joshua Kortje