English
Related papers

Related papers: Analysis of singular subspaces under random pertur…

200 papers

Across many disciplines from neuroscience and genomics to machine learning, atmospheric science and finance, the problems of denoising large data matrices to recover signals obscured by noise, and of estimating the structure of these…

Data Analysis, Statistics and Probability · Physics 2023-12-06 Itamar D. Landau , Gabriel C. Mel , Surya Ganguli

Perturbation bounds for singular spaces, in particular Wedin's $\sin \Theta$ theorem, are a fundamental tool in many fields including high-dimensional statistics, machine learning, and applied mathematics. In this paper, we establish…

Statistics Theory · Mathematics 2020-06-08 T. Tony Cai , Anru Zhang

We provide a complete description of perturbative unitarity bounds on the gauge-scalar sectors of models with extra $SU(2)$ doublet, neutral singlet, and charged singlet scalars. Such additions are very frequent in models beyond the…

High Energy Physics - Phenomenology · Physics 2026-03-03 Carolina T. Lopes , André Milagre , João P. Silva

Let $A$ be a full ranked $ n\times n$ matrix, with singular values $\sigma_1 (A) \ge \dots \ge \sigma_n (A) >0$. The condition number $\kappa(A):= \sigma_1(A)/\sigma_n(A)=\|A\|\cdot \|A\|^{-1}$ is a key parameter in the analysis of…

Numerical Analysis · Mathematics 2026-04-07 Phuc Tran , Van Vu

We establish a finite-sample Berry-Esseen theorem for the entrywise limits of the eigenvectors for a broad collection of signal-plus-noise random matrix models under challenging weak signal regimes. The signal strength is characterized by a…

Statistics Theory · Mathematics 2022-03-08 Fangzheng Xie

We study singular limits of stochastic evolution equations in the interplay of disappearing strength of the noise and insufficient regularity, where the equation in the limit with noise would not be defined due to lack of regularity. We…

Probability · Mathematics 2023-11-07 Dirk Blömker , Jonas M. Tölle

Deep neural networks generalize well despite being exceedingly overparameterized and being trained without explicit regularization. This curious phenomenon has inspired extensive research activity in establishing its statistical principles:…

Machine Learning · Statistics 2021-09-16 Ke Wang , Christos Thrampoulidis

Estimating singular subspaces from noisy matrices is a fundamental problem with wide-ranging applications across various fields. Driven by the challenges of data integration and multi-view analysis, this study focuses on estimating shared…

Statistics Theory · Mathematics 2024-11-27 Zhengchi Ma , Rong Ma

Concatenating matrices is a common technique for uncovering shared structures in data through singular value decomposition (SVD) and low-rank approximations. The fundamental question arises: How does the singular value spectrum of the…

Machine Learning · Computer Science 2025-07-01 Maksym Shamrai

We consider the singular vectors of any $m \times n$ submatrix of a rectangular $M \times N$ Gaussian matrix and study their asymptotic overlaps with those of the full matrix, in the macroscopic regime where $N \,/\, M\,$, $m \,/\, M$ as…

Probability · Mathematics 2025-01-16 Elie Attal , Romain Allez

The singular value matrix decomposition plays a ubiquitous role throughout statistics and related fields. Myriad applications including clustering, classification, and dimensionality reduction involve studying and exploiting the geometric…

Statistics Theory · Mathematics 2018-10-03 Joshua Cape , Minh Tang , Carey E. Priebe

Deep neural networks have been successfully applied to a broad range of problems where overparametrization yields weight matrices which are partially random. A comparison of weight matrix singular vectors to the Porter-Thomas distribution…

Disordered Systems and Neural Networks · Physics 2024-01-22 Max Staats , Matthias Thamm , Bernd Rosenow

It has been observed that the performances of many high-dimensional estimation problems are universal with respect to underlying sensing (or design) matrices. Specifically, matrices with markedly different constructions seem to achieve…

Information Theory · Computer Science 2023-07-24 Rishabh Dudeja , Subhabrata Sen , Yue M. Lu

In this paper, we consider the singular values and singular vectors of finite, low rank perturbations of large rectangular random matrices. Specifically, we prove almost sure convergence of the extreme singular values and appropriate…

Probability · Mathematics 2012-01-27 Florent Benaych-Georges , Raj Rao Nadakuditi

Describing the evolution of quantum systems by means of non-Hermitian generators opens a new avenue to explore the dynamical properties naturally emerging in such a picture, e.g. operation at the so-called exceptional points, preservation…

Quantum Physics · Physics 2023-12-01 Javid Naikoo , Ravindra W. Chhajlany , Jan Kolodynski

We consider the problem of estimating a low-rank signal matrix from noisy measurements under the assumption that the distribution of the data matrix belongs to an exponential family. In this setting, we derive generalized Stein's unbiased…

Statistics Theory · Mathematics 2017-10-03 Jérémie Bigot , Charles Deledalle , Delphine Féral

For a fixed symmetric matrix A and symmetric perturbation E we develop purely deterministic bounds on how invariant subspaces of A and A+E can differ when measured by a suitable "row-wise" metric rather than via traditional measures of…

Numerical Analysis · Mathematics 2020-06-22 Anil Damle , Yuekai Sun

We study the performance of estimators of a sparse nonrandom vector based on an observation which is linearly transformed and corrupted by additive white Gaussian noise. Using the reproducing kernel Hilbert space framework, we derive a new…

Statistics Theory · Mathematics 2010-09-20 Sebastian Schmutzhard , Alexander Jung , Franz Hlawatsch , Zvika Ben-Haim , Yonina C. Eldar

This paper establishes a variant of Stewart's theorem (Theorem~6.4 of Stewart, {\em SIAM Rev.}, 15:727--764, 1973) for the singular subspaces associated with the SVD of a matrix subject to perturbations. Stewart's original version uses both…

Numerical Analysis · Mathematics 2024-06-12 Ren-Cang Li , Ninoslav Truhar , Lei-Hong Zhang

In the pathwise stochastic calculus framework, the paper deals with the general study of equations driven by an additive Gaussian noise, with a drift function having an infinite limit at point zero. An ergodic theorem and the convergence of…

Probability · Mathematics 2019-01-16 Nicolas Marie