English
Related papers

Related papers: Matrix Perturbation: Davis-Kahan in the Infinity N…

200 papers

We consider the problem of approximating a $d \times d$ covariance matrix $M$ with a rank-$k$ matrix under $(\varepsilon,\delta)$-differential privacy. We present and analyze a complex variant of the Gaussian mechanism and obtain upper…

Data Structures and Algorithms · Computer Science 2025-02-12 Oren Mangoubi , Nisheeth K. Vishnoi

Perturbation bounds for singular spaces, in particular Wedin's $\sin \Theta$ theorem, are a fundamental tool in many fields including high-dimensional statistics, machine learning, and applied mathematics. In this paper, we establish…

Statistics Theory · Mathematics 2020-06-08 T. Tony Cai , Anru Zhang

Computing the first few singular vectors of a large matrix is a problem that frequently comes up in statistics and numerical analysis. Given the presence of noise, exact calculation is hard to achieve, and the following problem is of…

Numerical Analysis · Mathematics 2010-04-13 Van Vu

We analyze a class of estimators based on convex relaxation for solving high-dimensional matrix decomposition problems. The observations are noisy realizations of a linear transformation $\mathfrak{X}$ of the sum of an approximately) low…

Machine Learning · Statistics 2012-08-09 Alekh Agarwal , Sahand N. Negahban , Martin J. Wainwright

We develop new perturbation techniques for conducting convergence analysis of various first-order algorithms for a class of nonsmooth optimization problems. We consider the iteration scheme of an algorithm to construct a perturbed…

Optimization and Control · Mathematics 2018-10-25 Xiangfeng Wang , Jane Ye , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

This research creates a general class of "perturbation models" which are described by an underlying "null" model that accounts for most of the structure in data and a perturbation that accounts for possible small localized departures. The…

Statistics Theory · Mathematics 2007-06-13 Ramani S. Pilla , Catherine Loader

Disturbance noises are always bounded in a practical system, while fusion estimation is to best utilize multiple sensor data containing noises for the purpose of estimating a quantity--a parameter or process. However, few results are…

Systems and Control · Computer Science 2018-07-20 Bo Chen , Guoqiang Hu , Daniel W. C. Ho , Li Yu

Matrix completion is the problem of recovering a low rank matrix by observing a small fraction of its entries. A series of recent works [KOM12,JNS13,HW14] have proposed fast non-convex optimization based iterative algorithms to solve this…

Numerical Analysis · Computer Science 2014-11-06 Prateek Jain , Praneeth Netrapalli

Data informativity provides a theoretical foundation for determining whether collected data are sufficiently informative to achieve specific control objectives in data-driven control frameworks. In this study, we investigate the data…

Optimization and Control · Mathematics 2026-04-22 Taira Kaminaga , Hampei Sasahara

Perturbation theory in quantum mechanics studies how quantum systems interact with their environmental perturbations. Harmonic perturbation is a rare special case of time-dependent perturbations in which exact analysis exists. Some…

Quantum Physics · Physics 2008-01-01 Jie-Hong R. Jiang , Dah-Wei Chiou , Cheng-En Wu

This dissertation shows that careful injection of noise into sample data can substantially speed up Expectation-Maximization algorithms. Expectation-Maximization algorithms are a class of iterative algorithms for extracting maximum…

Machine Learning · Statistics 2014-11-26 Osonde Adekorede Osoba

We propose a new method to probe the learning mechanism of Deep Neural Networks (DNN) by perturbing the system using Noise Injection Nodes (NINs). These nodes inject uncorrelated noise via additional optimizable weights to existing…

Machine Learning · Computer Science 2023-05-03 Noam Levi , Itay Bloch , Marat Freytsis , Tomer Volansky

Variational Quantum Algorithms are among the most promising systems to implement quantum computing under the Noisy-Intermediate Scale Quantum (NISQ) technology. In variational quantum algorithm, wavefunction represented by a parametrized…

Quantum Physics · Physics 2023-01-02 H. Davoodi Yeganeh

Theoretical analysis of the error landscape of deep neural networks has garnered significant interest in recent years. In this work, we theoretically study the importance of noise in the trajectories of gradient descent towards optimal…

Machine Learning · Computer Science 2018-07-24 Adepu Ravi Sankar , Vishwak Srinivasan , Vineeth N Balasubramanian

In the present paper, we consider the problem of matrix completion with noise. Unlike previous works, we consider quite general sampling distribution and we do not need to know or to estimate the variance of the noise. Two new nuclear-norm…

Statistics Theory · Mathematics 2014-02-06 Olga Klopp

Precision matrix estimation is a fundamental topic in multivariate statistics and modern machine learning. This paper proposes an adversarially perturbed precision matrix estimation framework, motivated by recent developments in adversarial…

Methodology · Statistics 2026-03-25 Yiling Xie

An expansion method for perturbation of the zero temperature grand canonical density matrix is introduced. The method achieves quadratically convergent recursions that yield the response of the zero temperature density matrix upon variation…

Materials Science · Physics 2009-11-10 Anders M. N. Niklasson , Matt Challacombe

The eigenvalues and eigenvectors of nonnormal matrices can be unstable under perturbations of their entries. This renders an obstacle to the analysis of numerical algorithms for non-Hermitian eigenvalue problems. A recent technique to…

Probability · Mathematics 2026-04-14 Rikhav Shah , Nikhil Srivastava , Edward Zeng

The paper studies identification of linear systems with multiplicative noise from multiple-trajectory data. An algorithm based on the least-squares method and multiple-trajectory data is proposed for joint estimation of the nominal system…

Systems and Control · Electrical Eng. & Systems 2022-06-07 Yu Xing , Benjamin Gravell , Xingkang He , Karl Henrik Johansson , Tyler Summers

We revisit the input perturbations framework for differential privacy where noise is added to the input $A\in \mathcal{S}$ and the result is then projected back to the space of admissible datasets $\mathcal{S}$. Through this framework, we…

Machine Learning · Computer Science 2024-08-09 Vincent Cohen-Addad , Tommaso d'Orsi , Alessandro Epasto , Vahab Mirrokni , Peilin Zhong