English
Related papers

Related papers: Small singular values can increase in lower precis…

200 papers

To recover a low rank structure from a noisy matrix, truncated singular value decomposition has been extensively used and studied. Recent studies suggested that the signal can be better estimated by shrinking the singular values. We pursue…

Methodology · Statistics 2014-11-25 Julie Josse , Sylvain Sardy

Perturbation analysis of Markov chains provides bounds on the effect that a change in a Markov transition matrix has on the corresponding stationary distribution. This paper compares and analyzes bounds found in the literature for finite…

Probability · Mathematics 2024-04-03 Karim Abbas , Joost Berkhout , Bernd Heidergott

In this text, based on elementary computations, we provide a perturbative expansion of the coordinates of the eigenvectors of a Hermitian matrix of large size perturbed by a random matrix with small operator norm whose entries in the…

Probability · Mathematics 2020-03-19 Florent Benaych-Georges , Nathanaël Enriquez , Alkéos Michaïl

We study a control system resembling a singularly perturbed system whose variables are decomposed into groups that change their values with rates of different orders of magnitude. We establish that the slow trajectories of this system are…

Optimization and Control · Mathematics 2023-09-07 Vladimir Gaitsgory , Ilya Shvartsman

We study largest singular values of large random matrices, each with mean of a fixed rank $K$. Our main result is a limit theorem as the number of rows and columns approach infinity, while their ratio approaches a positive constant. It…

Probability · Mathematics 2021-03-02 Wlodek Bryc , Jack W. Silverstein

Understanding how the optimal value of an optimisation problem changes when its input data is modified is an old question in mathematical optimisation. This paper investigates the computation of the optimal values of a family of (possibly…

Optimization and Control · Mathematics 2026-03-02 Guillaume Derval , Damien Ernst , Quentin Louveaux , Bardhyl Miftari

We extend probability estimates on the smallest singular value of random matrices with independent entries to a class of sparse random matrices. We show that one can relax a previously used condition of uniform boundedness of the variances…

Probability · Mathematics 2012-12-21 Alexander Litvak , Omar Rivasplata

The behavior of the leading singular values and vectors of noisy low-rank matrices is fundamental to many statistical and scientific problems. Theoretical understanding currently derives from asymptotic analysis under one of two regimes:…

Statistics Theory · Mathematics 2023-08-03 Michael J. Feldman

A defective eigenvalue is well documented to be hypersensitive to data perturbations and round-off? errors, making it a formidable challenge in numerical computation particularly when the matrix is known through approximate data. This paper…

Numerical Analysis · Mathematics 2021-03-05 Zhonggang Zeng

Variational inference has become one of the most widely used methods in latent variable modeling. In its basic form, variational inference employs a fully factorized variational distribution and minimizes its KL divergence to the posterior.…

Machine Learning · Statistics 2020-01-29 Robert Bamler , Cheng Zhang , Manfred Opper , Stephan Mandt

We consider perturbations of a large Jordan matrix, either random and small in norm or of small rank. In both cases we show that most of the eigenvalues of the perturbed matrix are very close to a circle with centre at the origin. In the…

Spectral Theory · Mathematics 2007-05-23 E B Davies , Mildred Hager

Discrete differential equations appear most prominently in planar map and lattice path enumeration. In this work we consider discrete differential equations with an additional parameter $x$, where the order of the equation is $1$ for $x=0$…

Combinatorics · Mathematics 2026-03-23 Michael Drmota , Eva-Maria Hainzl

We consider the eigenvalues and eigenvectors of finite, low rank perturbations of random matrices. Specifically, we prove almost sure convergence of the extreme eigenvalues and appropriate projections of the corresponding eigenvectors of…

Probability · Mathematics 2012-03-19 Florent Benaych-Georges , Raj Rao Nadakuditi

Given a prediction task, understanding when one can and cannot design a consistent convex surrogate loss, particularly a low-dimensional one, is an important and active area of machine learning research. The prediction task may be given as…

Machine Learning · Computer Science 2021-02-17 Jessie Finocchiaro , Rafael Frongillo , Bo Waggoner

Motivated by a real problem in steel production, we introduce and analyze a general class of singularly perturbed linear hybrid systems with both switches and impulses, in which the slow or fast nature of the variables can be…

Systems and Control · Computer Science 2017-06-16 Jihene Ben Rejeb , Irinel-Constantin Morărescu , Antoine Girard , Jamal Daafouz

This work concerns the distance in 2-norm from a matrix polynomial to a nearest polynomial with a specified number of its eigenvalues at specified locations in the complex plane. Perturbations are allowed only on the constant coefficient…

Numerical Analysis · Mathematics 2013-06-24 Michael Karow , Emre Mengi

We study $\textit{sparse singular value certificates}$ for random rectangular matrices. If $M$ is an $n \times d$ matrix with independent Gaussian entries, we give a new family of polynomial-time algorithms which can certify upper bounds on…

Data Structures and Algorithms · Computer Science 2024-12-31 Ilias Diakonikolas , Samuel B. Hopkins , Ankit Pensia , Stefan Tiegel

We assume that every element of a matrix has a small, individual error, and model it by an external number, which is the sum of a nonstandard real number and a neutrix, the latter being a convex (external) set having the group property. The…

Rings and Algebras · Mathematics 2019-07-31 Nam van Tran , Imme van den Berg

We consider a minimal realization of a rational matrix functions. We perturb the polynomial part and one of the constant matrices from the realization part. We derive explicit computable expressions of backward errors of approximate…

Numerical Analysis · Mathematics 2021-05-28 Namita Behera

We consider the problem of estimating the spectral norm of a matrix using only matrix-vector products. We propose a new Counterbalance estimator that provides upper bounds on the norm and derive probabilistic guarantees on its…

Numerical Analysis · Mathematics 2025-06-19 Alexey Naumov , Maxim Rakhuba , Denis Ryapolov , Sergey Samsonov