English
Related papers

Related papers: Matrix Perturbation: Davis-Kahan in the Infinity N…

200 papers

A new class of disturbance covariance matrix estimators for radar signal processing applications is introduced following a geometric paradigm. Each estimator is associated with a given unitary invariant norm and performs the sample…

Applications · Statistics 2018-02-14 Augusto Aubry , Antonio De Maio , Luca Pallotta

A covariance matrix estimator using two bits per entry was recently developed by Dirksen, Maly and Rauhut [Annals of Statistics, 50(6), pp. 3538-3562]. The estimator achieves near minimax rate for general sub-Gaussian distributions, but…

Machine Learning · Statistics 2024-11-12 Junren Chen , Michael K. Ng

We consider the problem of reconstructing a function from a finite set of noise-corrupted samples. Two kernel algorithms are analyzed, namely kernel ridge regression and $\varepsilon$-support vector regression. By assuming the ground-truth…

Systems and Control · Electrical Eng. & Systems 2021-08-03 Emilio T. Maddalena , Paul Scharnhorst , Colin N. Jones

The original motivation for this paper was to provide an efficient quantitative analysis of convex infinite (or semi-infinite) inequality systems whose decision variables run over general infinite-dimensional (resp. finite-dimensional)…

Optimization and Control · Mathematics 2011-02-11 M. J. Cánovas , M. A. LóPez , B. S. Mordukhovich , J. Parra

Linear cosmological perturbation theory is pivotal to a theoretical understanding of current cosmological experimental data provided e.g. by cosmic microwave anisotropy probes. A key issue in that theory is to extract the gauge invariant…

General Relativity and Quantum Cosmology · Physics 2010-02-17 K. Giesel , S. Hofmann , T. Thiemann , O. Winkler

We study the problem of high-dimensional linear regression in a robust model where an $\epsilon$-fraction of the samples can be adversarially corrupted. We focus on the fundamental setting where the covariates of the uncorrupted samples are…

Machine Learning · Computer Science 2018-06-04 Ilias Diakonikolas , Weihao Kong , Alistair Stewart

Noisy matrix completion has attracted significant attention due to its applications in recommendation systems, signal processing and image restoration. Most existing works rely on (weighted) least squares methods under various low-rank…

Machine Learning · Statistics 2024-12-17 Ziyuan Chen , Fang Yao

This paper studies the Schatten-$q$ error of low-rank matrix estimation by singular value decomposition under perturbation. We specifically establish a perturbation bound on the low-rank matrix estimation via a perturbation projection error…

Numerical Analysis · Mathematics 2021-08-16 Yuetian Luo , Rungang Han , Anru R. Zhang

We study the statistical decision process of detecting the low-rank signal from various signal-plus-noise type data matrices, known as the spiked random matrix models. We first show that the principal component analysis can be improved by…

Statistics Theory · Mathematics 2023-01-18 Ji Hyung Jung , Hye Won Chung , Ji Oon Lee

An algorithm based on the interior-point methodology for solving continuous nonlinearly constrained optimization problems is proposed, analyzed, and tested. The distinguishing feature of the algorithm is that it presumes that only noisy…

Optimization and Control · Mathematics 2025-02-18 Frank E. Curtis , Shima Dezfulian , Andreas Waechter

This paper focuses on efficient computational approaches to compute approximate solutions of a linear inverse problem that is contaminated with mixed Poisson--Gaussian noise, and when there are additional outliers in the measured data. The…

Numerical Analysis · Mathematics 2018-01-22 Marie Kubínová , James G. Nagy

Disturbance observers have been attracting continuing research efforts and are widely used in many applications. Among them, the Kalman filter-based disturbance observer is an attractive one since it estimates both the state and the…

Systems and Control · Electrical Eng. & Systems 2023-10-31 Shilei Li , Dawei Shi , Yunjiang Lou , Wulin Zou , Ling Shi

We propose a data-driven approach to quantify the uncertainty of models constructed by kernel methods. Our approach minimizes the needed distributional assumptions, hence, instead of working with, for example, Gaussian processes or…

Machine Learning · Computer Science 2019-08-06 Balázs Csanád Csáji , Krisztián Balázs Kis

We study the multi-task linear regression problem in the presence of contaminated tasks. We address the setting where the unknown parameters of a majority of tasks are close in the $\ell_2$-norm, while a fraction of tasks are arbitrary…

Machine Learning · Statistics 2026-05-19 Seok-Jin Kim

Parameter estimation is of fundamental importance in areas from atomic spectroscopy and atomic clocks to gravitational wave detection. Entangled probes provide a significant precision gain over classical strategies in the absence of noise.…

Quantum Physics · Physics 2013-10-28 R. Chaves , J. B. Brask , M. Markiewicz , J. Kolodynski , A. Acin

Randomly perturbing networks during the training process is a commonly used approach to improving generalization performance. In this paper, we present a theoretical study of one particular way of random perturbation, which corresponds to…

Machine Learning · Computer Science 2021-02-16 Oussama Dhifallah , Yue M. Lu

In this paper, we propose a new robust analysis tool motivated by large-scale systems. The H infinity norm of a system measures its robustness by quantifying the worst-case behavior of a system perturbed by a unit-energy disturbance.…

Systems and Control · Computer Science 2015-07-10 Seungil You , Nikolai Matni

This paper studies noisy low-rank matrix completion: given partial and noisy entries of a large low-rank matrix, the goal is to estimate the underlying matrix faithfully and efficiently. Arguably one of the most popular paradigms to tackle…

Machine Learning · Statistics 2019-10-08 Yuxin Chen , Yuejie Chi , Jianqing Fan , Cong Ma , Yuling Yan

The ODE method has been a workhorse for algorithm design and analysis since the introduction of the stochastic approximation. It is now understood that convergence theory amounts to establishing robustness of Euler approximations for ODEs,…

Optimization and Control · Mathematics 2020-10-02 Shuhang Chen , Adithya Devraj , Andrey Bernstein , Sean Meyn

We prove a universality result that reduces the free energy of rank-one matrix estimation problems in the setting of mismatched prior and noise to the computation of the free energy for a modified Sherrington-Kirkpatrick spin glass. Our…

Probability · Mathematics 2025-01-07 Alice Guionnet , Justin Ko , Florent Krzakala , Lenka Zdeborová