English
Related papers

Related papers: High-probability bounds for the reconstruction err…

200 papers

We analyse the reconstruction error of principal component analysis (PCA) and prove non-asymptotic upper bounds for the corresponding excess risk. These bounds unify and improve existing upper bounds from the literature. In particular, they…

Statistics Theory · Mathematics 2019-04-01 Markus Reiß , Martin Wahl

Based on some new robust estimators of the covariance matrix, we propose stable versions of Principal Component Analysis (PCA) and we qualify it independently of the dimension of the ambient space. We first provide a robust estimator of the…

Statistics Theory · Mathematics 2015-11-20 Ilaria Giulini

Sparse Principal Component Analysis (PCA) is a prevalent tool across a plethora of subfields of applied statistics. While several results have characterized the recovery error of the principal eigenvectors, these are typically in spectral…

Statistics Theory · Mathematics 2022-02-09 Joshua Agterberg , Jeremias Sulam

We analyze the prediction error of principal component regression (PCR) and prove high probability bounds for the corresponding squared risk conditional on the design. Our first main result shows that PCR performs comparably to the oracle…

Statistics Theory · Mathematics 2024-01-03 Laura Hucker , Martin Wahl

We examine regular and irregular repeat-accumulate (RA) codes with repetition degrees which are all even. For these codes and with a particular choice of an interleaver, we give an upper bound on the decoding error probability of a…

Information Theory · Computer Science 2010-02-22 Idan Goldenberg , David Burshtein

Principal component analysis is an important pattern recognition and dimensionality reduction tool in many applications. Principal components are computed as eigenvectors of a maximum likelihood covariance $\widehat{\Sigma}$ that…

Statistics Theory · Mathematics 2017-10-30 Raphael Hauser , Raul Kangro , Jüri Lember , Heinrich Matzinger

We study sparse principal components analysis in the high-dimensional setting, where $p$ (the number of variables) can be much larger than $n$ (the number of observations). We prove optimal, non-asymptotic lower and upper bounds on the…

Machine Learning · Statistics 2012-02-07 Vincent Q. Vu , Jing Lei

The first order behavior of multivariate heavy-tailed random vectors above large radial thresholds is ruled by a limit measure in a regular variation framework. For a high dimensional vector, a reasonable assumption is that the support of…

Statistics Theory · Mathematics 2019-06-27 Holger Drees , Anne Sabourin

We derive inclusion regions for the eigenvalues of matrix polynomials expressed in a general polynomial basis, which can lead to significantly better results than traditional bounds. We present several applications to engineering problems.

Numerical Analysis · Mathematics 2016-05-31 Aaron Melman

We obtain bounds on the complex eigenvalues of non-self-adjoint Schr\"odinger operators with complex potentials, and also on the complex resonances of self-adjoint Schr\"odinger operators. Our bounds are compared with numerical results, and…

Spectral Theory · Mathematics 2025-10-20 A. A. Abramov , A. Aslanyan , E. B. Davies

We study principal components regression (PCR) in an asymptotic high-dimensional regression setting, where the number of data points is proportional to the dimension. We derive exact limiting formulas for the estimation and prediction…

Statistics Theory · Mathematics 2025-09-18 Alden Green , Elad Romanov

We provide an upper bound as a random variable for the functions of estimators in high dimensions. This upper bound may help establish the rate of convergence of functions in high dimensions. The upper bound random variable may converge…

Econometrics · Economics 2020-08-07 Mehmet Caner , Xu Han

The extremal values of multivariate trigonometric polynomials are of interest in fields ranging from control theory to filter design, but finding the extremal values of such a polynomial is generally NP-Hard. In this paper, we develop…

Signal Processing · Electrical Eng. & Systems 2018-08-07 Luke Pfister , Yoram Bresler

The paper addresses parametric inequality systems described by polynomial functions in finite dimensions, where state-dependent infinite parameter sets are given by finitely many polynomial inequalities and equalities. Such systems can be…

Optimization and Control · Mathematics 2015-09-15 G. Li , B. S. Mordukhovich , T. T. A. Nghia , T. S. Pham

During recent years the interest of optimization and machine learning communities in high-probability convergence of stochastic optimization methods has been growing. One of the main reasons for this is that high-probability complexity…

We obtain explicit upper bounds for the number of irreducible factors for a class of compositions of polynomials in several variables over a given field. In particular, some irreducibility criteria are given for this class of compositions…

Number Theory · Mathematics 2007-05-23 Anca Iuliana Bonciocat , Alexandru Zaharescu

We study the spectrum reconstruction technique. As is known to all, eigenvalues play an important role in many research fields and are foundation to many practical techniques such like PCA(Principal Component Analysis). We believe that…

Probability · Mathematics 2020-06-02 Zhibo Dai , Heinrich Matzinger , Ionel Popescu

This paper is concerned with the computable error estimates for the eigenvalue problem which is solved by the general conforming finite element methods on the general meshes. Based on the computable error estimate, we can give an…

Numerical Analysis · Mathematics 2016-06-21 Hehu Xie , Meiling Yue , Ning Zhang

We study the problem of estimating the leading eigenvectors of a high-dimensional population covariance matrix based on independent Gaussian observations. We establish a lower bound on the minimax risk of estimators under the $l_2$ loss, in…

Statistics Theory · Mathematics 2012-03-06 Aharon Birnbaum , Iain M. Johnstone , Boaz Nadler , Debashis Paul

In this paper, we compute the tightest possible bounds on the probability that the optimal value of a combinatorial optimization problem in maximization form with a random objective exceeds a given number, assuming only knowledge of the…

Optimization and Control · Mathematics 2022-11-24 Divya Padmanabhan , Selin Damla Ahipasaoglu , Arjun Ramachandra , Karthik Natarajan
‹ Prev 1 2 3 10 Next ›