English
Related papers

Related papers: Small singular values can increase in lower precis…

200 papers

We apply a method recently introduced to the statistical literature to directly estimate the precision matrix from an ensemble of samples drawn from a corresponding Gaussian distribution. Motivated by the observation that cosmological…

Instrumentation and Methods for Astrophysics · Physics 2016-05-25 Nikhil Padmanabhan , Martin White , Harrison H. Zhou , Ross O'Connell

We derive estimates for the largest and smallest singular values of sparse rectangular $N\times n$ random matrices, assuming $\lim_{N,n\to\infty}\frac nN=y\in(0,1)$. We consider a model with sparsity parameter $p_N$ such that $Np_N\sim…

Probability · Mathematics 2022-11-29 F. Götze , A. Tikhomirov

Covariances and variances of linear statistics of a point process can be written as integrals over the truncated two-point correlation function. When the point process consists of the eigenvalues of a random matrix ensemble, there are often…

Mathematical Physics · Physics 2022-05-04 Peter J. Forrester

We propose a new method of perturbing a major variable by adding noise such that results of regression analysis are unaffected. The extent of the perturbation can be controlled using a single parameter, which eases an actual perturbation…

Methodology · Statistics 2015-08-10 Yuzo Maruyama , Ryoko Tone , Yasushi Asami

With model trustworthiness being crucial for sensitive real-world applications, practitioners are putting more and more focus on improving the uncertainty calibration of deep neural networks. Calibration errors are designed to quantify the…

Machine Learning · Computer Science 2024-03-14 Sebastian G. Gruber , Florian Buettner

We explore unique considerations involved in fitting ML models to data with very high precision, as is often required for science applications. We empirically compare various function approximation methods and study how they scale with…

Machine Learning · Computer Science 2023-02-01 Eric J. Michaud , Ziming Liu , Max Tegmark

We consider the matrix completion problem where the aim is to esti-mate a large data matrix for which only a relatively small random subset of its entries is observed. Quite popular approaches to matrix completion problem are iterative…

Statistics Theory · Mathematics 2015-02-03 Olga Klopp

In this brief paper the probability density of a random real, complex and quaternion determinant is rederived using singular values. The behaviour of suitably rescaled random determinants is studied in the limit of infinite order of the…

Statistical Mechanics · Physics 2009-10-31 Giovanni M. Cicuta , Madan L. Mehta

Sparse representation over redundant dictionaries constitutes a good model for many classes of signals (e.g., patches of natural images, segments of speech signals, etc.). However, despite its popularity, very little is known about the…

Signal Processing · Electrical Eng. & Systems 2019-03-07 Rotem Mulayoff , Tomer Michaeli

We obtain an iterative formula that converges incrementally to the smallest singular value. Similarly, we obtain an iterative formula that converges decreasingly to the largest singular value.

Numerical Analysis · Mathematics 2022-05-30 Shun Xu

Classical matrix perturbation results, such as Weyl's theorem for eigenvalues and the Davis-Kahan theorem for eigenvectors, are general purpose. These classical bounds are tight in the worst case, but in many settings sub-optimal in the…

Machine Learning · Statistics 2017-06-21 Justin Eldridge , Mikhail Belkin , Yusu Wang

Let $A$ be an $n\times n$ random matrix with independent, identically distributed mean 0, variance 1 subgaussian entries. We prove that $$ \mathbb{P}(A\text{ has distinct singular values})\geq 1-e^{-cn} $$ for some $c>0$, confirming a…

Probability · Mathematics 2025-03-04 Yi Han

We show how positive unital linear maps can be used to obtain lower bounds for the maximum distance between the eigenvalues of two normal matrices. Some related bounds for the spread and condition number of Hermitian matrices are also…

Functional Analysis · Mathematics 2015-09-21 R. Sharma , R. Kumari

Perturbing a deterministic $n$-dimensional matrix with small Gaussian noise is a cornerstone of smoothed analysis of algorithms [Spielman and Teng, JACM 2004], as it reduces the condition number of the input to $O(n)$, and with it the…

Data Structures and Algorithms · Computer Science 2026-04-28 Shabarish Chenakkod , Michał Dereziński , Xiaoyu Dong , Mark Rudelson

Estimation of the population total of a variable can be improved by calibration on a set of auxiliary variables. It is difficult to establish that such a set of variables is sufficient, that estimation could not be improved by calibration…

Applications · Statistics 2026-03-02 Nicholas T. Longford

Consider the problem of estimating the entries of a large matrix, when the observed entries are noisy versions of a small random fraction of the original entries. This problem has received widespread attention in recent times, especially…

Statistics Theory · Mathematics 2014-12-31 Sourav Chatterjee

This work introduces the minimax Laplace transform method, a modification of the cumulant-based matrix Laplace transform method developed in "User-friendly tail bounds for sums of random matrices" (arXiv:1004.4389v6) that yields both upper…

Probability · Mathematics 2011-07-22 Alex Gittens , Joel A. Tropp

In a data-scarce field such as healthcare, where models often deliver predictions on patients with rare conditions, the ability to measure the uncertainty of a model's prediction could potentially lead to improved effectiveness of decision…

Machine Learning · Statistics 2020-05-26 Lotta Meijerink , Giovanni Cinà , Michele Tonutti

Adaptive nuclear-norm penalization is proposed for low-rank matrix approximation, by which we develop a new reduced-rank estimation method for the general high-dimensional multivariate regression problems. The adaptive nuclear norm of a…

Methodology · Statistics 2012-09-25 Kun Chen , Hongbo Dong , Kung-Sik Chan

Rigorous, non-asymptotic bounds for the Puiseux expansion of the eigenvalue at infinity are given. Error analysis is provided. Further, the expected value of the eigenvector condition number of a randomly perturbed matrix is estimated. The…

Numerical Analysis · Mathematics 2026-03-24 Hanna Blazhko , Michał Wojtylak