English
Related papers

Related papers: Determinant-Based Error Bounds for CUR Matrix Appr…

200 papers

In this work, we analyze a sublinear-time algorithm for selecting a few rows and columns of a matrix for low-rank approximation purposes. The algorithm is based on an initial uniformly random selection of rows and columns, followed by a…

Numerical Analysis · Mathematics 2024-02-22 Alice Cortinovis , Lexing Ying

The computation of accurate low-rank matrix approximations is central to improving the scalability of various techniques in machine learning, uncertainty quantification, and control. Traditionally, low-rank approximations are constructed…

Numerical Analysis · Mathematics 2025-09-29 Nathaniel Pritchard , Taejun Park , Yuji Nakatsukasa , Per-Gunnar Martinsson

The low-rank quaternion matrix approximation has been successfully applied in many applications involving signal processing and color image processing. However, the cost of quaternion models for generating low-rank quaternion matrix…

Numerical Analysis · Mathematics 2024-03-01 Peng-Ling Wu , Kit Ian Kou , Hongmin Cai , Zhaoyuan Yu

Confidence measures for the generalization error are crucial when small training samples are used to construct classifiers. A common approach is to estimate the generalization error by resampling and then assume the resampled estimator…

Machine Learning · Computer Science 2012-06-18 Eric B. Laber , Susan A. Murphy

We study a relaxed version of the column-sampling problem for the Nystr\"om approximation of kernel matrices, where approximations are defined from multisets of landmark points in the ambient space; such multisets are referred to as…

Machine Learning · Statistics 2022-03-28 Matthew Hutchings , Bertrand Gauthier

This paper deals with the problem of robust matrix completion -- retrieving a low-rank matrix and a sparse matrix from the compressed counterpart of their superposition. Though seemingly not an unresolved issue, we point out that the…

Information Theory · Computer Science 2024-10-10 Yinjian Wang

Coherent lower previsions are general probabilistic models allowing incompletely specified probability distributions. However, for complete description of a coherent lower prevision -- even on finite underlying sample spaces -- an infinite…

Probability · Mathematics 2022-09-29 Damjan Škulj

Positive semi-definite matrices commonly occur as normal matrices of least squares problems in statistics or as kernel matrices in machine learning and approximation theory. They are typically large and dense. Thus algorithms to solve…

Numerical Analysis · Mathematics 2020-12-01 Markus Hegland , Frank deHoog

Symmetric positive semidefinite (SPSD) matrix approximation is an important problem with applications in kernel methods. However, existing SPSD matrix approximation methods such as the Nystr\"om method only have weak error bounds. In this…

Machine Learning · Computer Science 2016-05-23 Shusen Wang , Luo Luo , Zhihua Zhang

The CUR decomposition is a factorization of a low-rank matrix obtained by selecting certain column and row submatrices of it. We perform a thorough investigation of what happens to such decompositions in the presence of noise. Since CUR…

Numerical Analysis · Mathematics 2020-07-29 Keaton Hamm , Longxiu Huang

An a posteriori estimate for the error of a standard Krylov approximation to the matrix exponential is derived. The estimate is based on the defect (residual) of the Krylov approximation and is proven to constitute a rigorous upper bound on…

Numerical Analysis · Mathematics 2020-02-03 Tobias Jawecki , Winfried Auzinger , Othmar Koch

We extend the traditional framework for estimating subspace bases that maximize the preserved signal energy to additionally preserve the Cram\'er-Rao bound (CRB) of the biophysical parameters and, ultimately, improve accuracy and precision…

Medical Physics · Physics 2025-10-28 Andrew Mao , Sebastian Flassbeck , Cem Gultekin , Jakob Assländer

We propose a general error analysis related to the low-rank approximation of a given real matrix in both the spectral and Frobenius norms. First, we derive deterministic error bounds that hold with some minimal assumptions. Second, we…

Numerical Analysis · Mathematics 2022-06-22 Youssef Diouane , Selime Gürol , Alexandre Scotto Di Perrotolo , Xavier Vasseur

Recently proposed generative models for discrete data, such as Masked Diffusion Models (MDMs), exploit conditional independence approximations to reduce the computational cost of popular Auto-Regressive Models (ARMs), at the price of some…

Machine Learning · Statistics 2025-12-18 Hugo Lavenant , Giacomo Zanella

In this paper we shed more light on determinants of interval matrices. Computing the exact bounds on a determinant of an interval matrix is an NP-hard problem. Therefore, attention is first paid to approximations. NP-hardness of both…

Numerical Analysis · Mathematics 2018-09-12 Jaroslav Horáček , Milan Hladík , Josef Matějka

The manuscript describes efficient algorithms for the computation of the CUR and ID decompositions. The methods used are based on simple modifications to the classical truncated pivoted QR decomposition, which means that highly optimized…

Numerical Analysis · Mathematics 2016-10-20 Sergey Voronin , Per-Gunnar Martinsson

Large models and enormous data are essential driving forces of the unprecedented successes achieved by modern algorithms, especially in scientific computing and machine learning. Nevertheless, the growing dimensionality and model…

Machine Learning · Computer Science 2023-10-04 Yijun Dong

Solving high-dimensional dynamical systems in multi-query or real-time applications requires efficient surrogate modelling techniques, as e.g., achieved via model order reduction (MOR). If these systems are Hamiltonian systems their…

Numerical Analysis · Mathematics 2024-05-20 Robin Herkert , Patrick Buchfink , Bernard Haasdonk , Johannes Rettberg , Jörg Fehr

Let $X=C+\mathrm{E}$ with a deterministic matrix $C\in\R^{M\times M}$ and $\mathrm{E}$ some centered Gaussian $M\times M$-matrix whose entries are independent with variance $\sigma^2$. In the present work, the accuracy of reduced-rank…

Probability · Mathematics 2012-05-08 Angelika Rohde

In this paper, we derive a novel bound on the generalization error of Magnitude-Based pruning of overparameterized neural networks. Our work builds on the bounds in Arora et al. [2018] where the error depends on one, the approximation…

Machine Learning · Computer Science 2023-06-27 Etash Kumar Guha , Prasanjit Dubey , Xiaoming Huo