English
Related papers

Related papers: Singular vector and singular subspace distribution…

200 papers

We consider a square random matrix of size N of the form A + Y where A is deterministic and Y has iid entries with variance 1/N. Under mild assumptions, as N grows, the empirical distribution of the eigenvalues of A+Y converges weakly to a…

Probability · Mathematics 2014-11-04 Charles Bordenave , Mireille Capitaine

Estimating singular subspaces from noisy matrices is a fundamental problem with wide-ranging applications across various fields. Driven by the challenges of data integration and multi-view analysis, this study focuses on estimating shared…

Statistics Theory · Mathematics 2024-11-27 Zhengchi Ma , Rong Ma

In this paper, we derive the analytical behavior of the limiting spectral distribution of non-central covariance matrices of the "general information-plus-noise" type, as studied in [14]. Through the equation defining its Stieltjes…

Statistics Theory · Mathematics 2023-06-29 Huanchao Zhou , Jiang Hu , Zhidong Bai , Jack W. Silverstein

We consider the additive version of the matrix denoising problem, where a random symmetric matrix $S$ of size $n$ has to be inferred from the observation of $Y=S+Z$, with $Z$ an independent random matrix modeling a noise. For prior…

Disordered Systems and Neural Networks · Physics 2024-10-25 Guilhem Semerjian

Deconvolution is a statistical inverse problem to estimate the distribution of a random variable based on its noisy observations. Despite the extensive studies on the topic, deconvolution with unknown noise distribution remains as a…

Statistics Theory · Mathematics 2020-04-06 Devavrat Shah , Dogyoon Song

We consider the problem of estimating a low-rank signal matrix from noisy measurements under the assumption that the distribution of the data matrix belongs to an exponential family. In this setting, we derive generalized Stein's unbiased…

Statistics Theory · Mathematics 2017-10-03 Jérémie Bigot , Charles Deledalle , Delphine Féral

Despite the importance of denoising in modern machine learning and ample empirical work on supervised denoising, its theoretical understanding is still relatively scarce. One concern about studying supervised denoising is that one might not…

Machine Learning · Computer Science 2024-03-18 Chinmaya Kausik , Kashvi Srivastava , Rishi Sonthalia

We consider a class of sample covariance matrices of the form $Q=TXX^{*}T^*,$ where $X=(x_{ij})$ is an $M \times N$ rectangular matrix consisting of i.i.d entries and $T$ is a deterministic matrix satisfying $T^*T$ is diagonal. Assuming $M$…

Probability · Mathematics 2026-01-14 Xiucai Ding

We derive a minimalist but powerful deterministic denoising-diffusion model. While denoising diffusion has shown great success in many domains, its underlying theory remains largely inaccessible to non-expert users. Indeed, an understanding…

Graphics · Computer Science 2023-05-08 Eric Heitz , Laurent Belcour , Thomas Chambon

In this paper we consider a random variable $Y$ contamined by an independent additive noise $Z$. We assume that $Z$ has known distribution. Our purpose is to test the distribution of the unobserved random variable $Y$. We propose a data…

Statistics Theory · Mathematics 2009-01-28 Denys Pommeret

This work concerns noise reduction for one-dimensional spectra in the case that the signal is corrupted by an additive white noise. The proposed method starts with mapping the noisy spectrum to a partial circulant matrix. In virtue of…

Data Analysis, Statistics and Probability · Physics 2020-10-29 X. C. Chen , Yu. A. Litvinov , M. Wang , Q. Wang , Y. H. Zhang

In this paper, we consider the singular values and singular vectors of finite, low rank perturbations of large rectangular random matrices. Specifically, we prove almost sure convergence of the extreme singular values and appropriate…

Probability · Mathematics 2012-01-27 Florent Benaych-Georges , Raj Rao Nadakuditi

We consider the recovery of a low rank $M \times N$ matrix $S$ from its noisy observation $\tilde{S}$ in two different regimes. Under the assumption that $M$ is comparable to $N$, we propose two consistent estimators for $S$. Our analysis…

Statistics Theory · Mathematics 2019-04-24 Xiucai Ding

This work analyzes singular-value spectra of weight matrices in pretrained transformer models to understand how information is stored at both ends of the spectrum. Using Random Matrix Theory (RMT) as a zero information hypothesis, we…

Machine Learning · Computer Science 2025-11-07 Max Staats , Matthias Thamm , Bernd Rosenow

We introduce a random matrix model where the entries are dependent across both rows and columns. More precisely, we investigate matrices of the form $\X=(X_{(i-1)n+t})_{it}\in\R^{p\times n}$ derived from a linear process $X_t=\sum_j c_j…

Probability · Mathematics 2012-02-15 Oliver Pfaffel , Eckhard Schlemm

Let $ X_{n} $ be $ n\times N $ random complex matrices, $R_{n}$ and $T_{n}$ be non-random complex matrices with dimensions $n\times N$ and $n\times n$, respectively. We assume that the entries of $ X_{n} $ are independent and identically…

Statistics Theory · Mathematics 2022-01-31 Huanchao Zhou , Zhidong Bai , Jiang Hu

Within the hypothesis of the dark-matter origin of the excess in $B\to K M_X$ decays over the standard-model expectation, observed by Belle-II, we show that: (i) Scalar- and vector-medator scenarios may be unambiguously discriminated by…

High Energy Physics - Phenomenology · Physics 2026-05-06 Alexander Berezhnoy , Wolfgang Lucha , Dmitri Melikhov

We study the stationary probability distribution of a system driven by shot noise. We find that, both in the overdamped and underdamped regime, the coordinate distribution displays power-law singularities in its central part. For…

Mesoscale and Nanoscale Physics · Physics 2015-06-12 Akihisa Ichiki , Yukihiro Tadokoro , M. I. Dykman

In this paper, we consider the singular values and singular vectors of low rank perturbations of large rectangular random matrices, in the regime the matrix is "long": we allow the number of rows (columns) to grow polynomially in the number…

Probability · Mathematics 2021-10-22 Gérard Ben Arous , Daniel Zhengyu Huang , Jiaoyang Huang

Let $A\in\mathbb{R}^{m\times n}$ be a matrix of rank $r$ with singular value decomposition (SVD) $A=\sum_{k=1}^r\sigma_k (u_k\otimes v_k),$ where $\{\sigma_k, k=1,\ldots,r\}$ are singular values of $A$ (arranged in a non-increasing order)…

Probability · Mathematics 2015-06-10 Vladimir Koltchinskii , Dong Xia