English
Related papers

Related papers: Average-Case Matrix Discrepancy: Asymptotics and O…

200 papers

We present and analyze an algorithm designed for addressing vector-valued regression problems involving possibly infinite-dimensional input and output spaces. The algorithm is a randomized adaptation of reduced rank regression, a technique…

Machine Learning · Computer Science 2024-01-01 Giacomo Turri , Vladimir Kostic , Pietro Novelli , Massimiliano Pontil

This paper derives exponential tail bounds and polynomial moment inequalities for the spectral norm deviation of a random matrix from its mean value. The argument depends on a matrix extension of Stein's method of exchangeable pairs for…

Probability · Mathematics 2013-05-06 Daniel Paulin , Lester Mackey , Joel A. Tropp

A method based on multicanonical Monte Carlo is applied to the calculation of large deviations in the largest eigenvalue of random matrices. The method is successfully tested with the Gaussian orthogonal ensemble (GOE), sparse random…

Statistical Mechanics · Physics 2013-05-29 Nen Saito , Yukito Iba , Koji Hukushima

We compute quantitative bounds for measuring the discrepancy between the distribution of two min-max statistics involving either pairs of Gaussian random matrices, or one Gaussian and one Gaussian-subordinated random matrix. In the fully…

Probability · Mathematics 2021-09-28 Giovanni Peccati , Nicola Turchi

Every sufficiently big matrix with small spectral norm has a nearby low-rank matrix if the distance is measured in the maximum norm (Udell & Townsend, SIAM J Math Data Sci, 2019). We use the Hanson--Wright inequality to improve the estimate…

Numerical Analysis · Mathematics 2025-04-09 Stanislav Budzinskiy

Let $A$ be an $n\times n$ random matrix whose entries are i.i.d. with mean $0$ and variance $1$. We present a deterministic polynomial time algorithm which, with probability at least $1-2\exp(-\Omega(\epsilon n))$ in the choice of $A$,…

Probability · Mathematics 2020-12-02 Vishesh Jain , Ashwin Sah , Mehtaab Sawhney

We revisit Matrix Balancing, a pre-conditioning task used ubiquitously for computing eigenvalues and matrix exponentials. Since 1960, Osborne's algorithm has been the practitioners' algorithm of choice and is now implemented in most…

Optimization and Control · Mathematics 2021-07-06 Jason M. Altschuler , Pablo A. Parrilo

Random matrix theory has become a cornerstone in modern statistics and data science, providing fundamental tools for understanding high-dimensional covariance structures. Within this framework, the Wishart matrix plays a central role in…

Statistics Theory · Mathematics 2025-11-26 Fengcheng Liu

Estimating covariance matrices is a problem of fundamental importance in multivariate statistics. In practice it is increasingly frequent to work with data matrices $X$ of dimension $n\times p$, where $p$ and $n$ are both large. Results…

Statistics Theory · Mathematics 2009-01-22 Noureddine El Karoui

A few matrix-vector multiplications with random vectors are often sufficient to obtain reasonably good estimates for the norm of a general matrix or the trace of a symmetric positive semi-definite matrix. Several such probabilistic…

Numerical Analysis · Mathematics 2020-08-11 Zvonimir Bujanović , Daniel Kressner

Recovery of the causal structure of dynamic networks from noisy measurements has long been a problem of interest across many areas of science and engineering. Many algorithms have been proposed, but there is little work that compares the…

Information Theory · Computer Science 2025-06-10 Xiaohan Kang , Bruce Hajek

We present a comparison between various algorithms of inference of covariance and precision matrices in small datasets of real vectors, of the typical length and dimension of human brain activity time series retrieved by functional Magnetic…

Statistical Mechanics · Physics 2023-02-07 Miguel Ibáñez-Berganza , Carlo Lucibello , Francesca Santucci , Tommaso Gili , Andrea Gabrielli

This paper investigates an upper bound of the operator norm for sub-Gaussian tailed random matrices. A lot of attention has been put on uniformly bounded sub-Gaussian tailed random matrices with independent coefficients. However, little has…

Probability · Mathematics 2019-01-23 Eric Benhamou , Jamal Atif , Rida Laraki

We describe an elementary method to get non-asymptotic estimates for the moments of Hermitian random matrices whose elements are Gaussian independent random variables. As the basic example, we consider the GUE matrices. Immediate…

Mathematical Physics · Physics 2007-05-23 O. Khorunzhiy

A popular technique for selecting and tuning machine learning estimators is cross-validation. Cross-validation evaluates overall model fit, usually in terms of predictive accuracy. In causal inference, the optimal choice of estimator…

Methodology · Statistics 2021-07-07 Dominik Rothenhäusler

State-of-the-art EfficientSCI loses 20.58 dB when its assumed forward operator deviates from physical reality in just eight parameters, yet no existing benchmark quantifies operator mismatch, the default condition in deployed compressive…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Chengshuai Yang , Xin Yuan

We consider the singular vectors of any $m \times n$ submatrix of a rectangular $M \times N$ Gaussian matrix and study their asymptotic overlaps with those of the full matrix, in the macroscopic regime where $N \,/\, M\,$, $m \,/\, M$ as…

Probability · Mathematics 2025-01-16 Elie Attal , Romain Allez

Matrix scaling is a simple to state, yet widely applicable linear-algebraic problem: the goal is to scale the rows and columns of a given non-negative matrix such that the rescaled matrix has prescribed row and column sums. Motivated by…

Quantum Physics · Physics 2021-10-01 Sander Gribling , Harold Nieuwboer

Many problems in computer science and applied mathematics require rounding a vector $\mathbf{w}$ of fractional values lying in the interval $[0,1]$ to a binary vector $\mathbf{x}$ so that, for a given matrix $\mathbf{A}$,…

Data Structures and Algorithms · Computer Science 2020-08-04 Lily Li , Aleksandar Nikolov

We study online convex optimization in the random order model, recently proposed by \citet{garber2020online}, where the loss functions may be chosen by an adversary, but are then presented to the online algorithm in a uniformly random…

Machine Learning · Computer Science 2021-06-30 Uri Sherman , Tomer Koren , Yishay Mansour