English
Related papers

Related papers: A Note on Error Bounds for Pseudo Skeleton Approxi…

200 papers

Error bounds have been studied for more than seventy years, beginning with the seminal result of Hoffman (1952) [{\it J. Res. Natl. Bur. Standards}, 49 (1952), 263--265], which establishes an upper bound for the distance from an arbitrary…

Optimization and Control · Mathematics 2026-05-25 Zhou Wei , Michel Thera , Jen-Chih Yao

Linear Least Squares is a very well known technique for parameter estimation, which is used even when sub-optimal, because of its very low computational requirements and the fact that exact knowledge of the noise statistics is not required.…

Statistics Theory · Mathematics 2018-10-16 Michael Krikheli , Amir Leshem

We prove lower bounds for the worst case error of quadrature formulas that use given sample points $\X_n = \{ x_1, \dots , x_n \}$. We are mainly interested in optimal point sets $\X_n$, but also prove lower bounds that hold with high…

Numerical Analysis · Mathematics 2020-12-08 Aicke Hinrichs , David Krieg , Erich Novak , Jan Vybíral

Structured low-rank approximation is the problem of minimizing a weighted Frobenius distance to a given matrix among all matrices of fixed rank in a linear space of matrices. We study exact solutions to this problem by way of computational…

Optimization and Control · Mathematics 2017-02-23 Giorgio Ottaviani , Pierre-Jean Spaenlehauer , Bernd Sturmfels

We consider the problem of recovering a low-rank matrix from its clipped observations. Clipping is conceivable in many scientific areas that obstructs statistical analyses. On the other hand, matrix completion (MC) methods can recover a…

Machine Learning · Computer Science 2019-03-05 Takeshi Teshima , Miao Xu , Issei Sato , Masashi Sugiyama

We describe a general technique that yields the first {\em Statistical Query lower bounds} for a range of fundamental high-dimensional learning problems involving Gaussian distributions. Our main results are for the problems of (1) learning…

Machine Learning · Computer Science 2017-05-18 Ilias Diakonikolas , Daniel M. Kane , Alistair Stewart

Among randomized numerical linear algebra strategies, so-called sketching procedures are emerging as effective reduction means to accelerate the computation of Krylov subspace methods for, e.g., the solution of linear systems, eigenvalue…

Numerical Analysis · Mathematics 2024-08-02 Davide Palitta , Marcel Schweitzer , Valeria Simoncini

We consider the problem of recovering a lowrank matrix M from a small number of random linear measurements. A popular and useful example of this problem is matrix completion, in which the measurements reveal the values of a subset of the…

Information Theory · Computer Science 2009-10-05 Emmanuel J. Candes , Yaniv Plan

A novel algorithm for the recovery of low-rank matrices acquired via compressive linear measurements is proposed and analyzed. The algorithm, a variation on the iterative hard thresholding algorithm for low-rank recovery, is designed to…

Numerical Analysis · Mathematics 2018-10-30 Simon Foucart , Srinivas Subramanian

This paper is concerned with the solution of large-scale linear discrete ill-posed problems with error-contaminated data. Tikhonov regularization is a popular approach to determine meaningful approximate solutions of such problems. The…

Numerical Analysis · Mathematics 2016-02-11 Guangxin Huang , Silvia Noschese , Lothar Reichel

In this paper we obtain several informative error bounds on function approximation for the policy evaluation algorithm proposed by Basu et al. when the aim is to find the risk-sensitive cost represented using exponential utility. The main…

Machine Learning · Computer Science 2019-10-23 Prasenjit Karmakar , Shalabh Bhatnagar

Linear matrix inequalities (LMIs) are ubiquitous in modern control theory, as well as in a variety of other fields in science and engineering. Their analytic centers, i.e. the maximum determinant elements of the feasible set spanned by…

Optimization and Control · Mathematics 2022-02-28 Biel Roig-Solvas , Mario Sznaier

Practical model building processes are often time-consuming because many different models must be trained and validated. In this paper, we introduce a novel algorithm that can be used for computing the lower and the upper bounds of model…

Machine Learning · Statistics 2014-02-11 Yoshiki Suzuki , Kohei Ogawa , Yuki Shinmura , Ichiro Takeuchi

The paper addresses parametric inequality systems described by polynomial functions in finite dimensions, where state-dependent infinite parameter sets are given by finitely many polynomial inequalities and equalities. Such systems can be…

Optimization and Control · Mathematics 2015-09-15 G. Li , B. S. Mordukhovich , T. T. A. Nghia , T. S. Pham

In this paper, we derive new, nearly optimal bounds for the Gaussian approximation to scaled averages of $n$ independent high-dimensional centered random vectors $X_1,\dots,X_n$ over the class of rectangles in the case when the covariance…

Probability · Mathematics 2021-05-13 Victor Chernozhukov , Denis Chetverikov , Yuta Koike

The density matrices are positively semi-definite Hermitian matrices of unit trace that describe the state of a quantum system. The goal of the paper is to develop minimax lower bounds on error rates of estimation of low rank density…

Machine Learning · Statistics 2016-04-19 Vladimir Koltchinskii , Dong Xia

We propose two families of asymptotically local minimax lower bounds on parameter estimation performance. The first family of bounds applies to any convex, symmetric loss function that depends solely on the difference between the estimate…

Statistics Theory · Mathematics 2024-09-20 Neri Merhav

Random linear mappings are widely used in modern signal processing, compressed sensing and machine learning. These mappings may be used to embed the data into a significantly lower dimension while at the same time preserving useful…

Information Theory · Computer Science 2021-01-22 Halyun Jeong , Xiaowei Li , Yaniv Plan , Özgür Yılmaz

Optimization is important in machine learning problems, and quasi-Newton methods have a reputation as the most efficient numerical schemes for smooth unconstrained optimization. In this paper, we consider the explicit superlinear…

Optimization and Control · Mathematics 2022-09-13 Dachao Lin , Haishan Ye , Zhihua Zhang

The problem of approximating a matrix by a low-rank one has been extensively studied. This problem assumes, however, that the whole matrix has a low-rank structure. This assumption is often false for real-world matrices. We consider the…

Data Structures and Algorithms · Computer Science 2025-11-05 Martino Ciaperoni , Aristides Gionis , Heikki Mannila