English
Related papers

Related papers: Best low-rank approximations and Kolmogorov n-widt…

200 papers

We solve the problem of best approximation by partial isometries of given rank to an arbitrary rectangular matrix, when the distance is measured in any unitarily invariant norm. In the case where the norm is strictly convex, we parametrize…

Functional Analysis · Mathematics 2016-11-08 Jorge Antezana , Eduardo Chiumiento

In the tensor space $\mathrm{Sym}^d {\mathbb R}^2$ of binary forms we study the best rank $k$ approximation problem. The critical points of the best rank $1$ approximation problem are the eigenvectors and it is known that they span a…

Algebraic Geometry · Mathematics 2017-07-18 Giorgio Ottaviani , Alicia Tocino

Within the framework of parameter dependent PDEs, we develop a constructive approach based on Deep Neural Networks for the efficient approximation of the parameter-to-solution map. The research is motivated by the limitations and drawbacks…

Numerical Analysis · Mathematics 2022-12-16 Nicola R. Franco , Andrea Manzoni , Paolo Zunino

In the numerical linear algebra community, it was suggested that to obtain nearly optimal bounds for various problems such as rank computation, finding a maximal linearly independent subset of columns (a basis), regression, or low-rank…

Data Structures and Algorithms · Computer Science 2021-11-04 Nadiia Chepurko , Kenneth L. Clarkson , Praneeth Kacham , David P. Woodruff

We study the $\ell_0$-Low Rank Approximation Problem, where the goal is, given an $m \times n$ matrix $A$, to output a rank-$k$ matrix $A'$ for which $\|A'-A\|_0$ is minimized. Here, for a matrix $B$, $\|B\|_0$ denotes the number of its…

Data Structures and Algorithms · Computer Science 2018-10-02 Karl Bringmann , Pavel Kolev , David P. Woodruff

In this article, we consider the following capacitated covering problem. We are given a set $P$ of $n$ points and a set $\mathcal{B}$ of balls from some metric space, and a positive integer $U$ that represents the capacity of each of the…

Data Structures and Algorithms · Computer Science 2017-12-13 Sayan Bandyapadhyay , Santanu Bhowmick , Tanmay Inamdar , Kasturi Varadarajan

Given a function $u\in L^2=L^2(D,\mu)$, where $D\subset \mathbb R^d$ and $\mu$ is a measure on $D$, and a linear subspace $V_n\subset L^2$ of dimension $n$, we show that near-best approximation of $u$ in $V_n$ can be computed from a…

Numerical Analysis · Mathematics 2021-09-14 Albert Cohen , Matthieu Dolbeault

Low-rank approximations are popular methods to reduce the high computational cost of algorithms involving large-scale kernel matrices. The success of low-rank methods hinges on the matrix rank of the kernel matrix, and in practice, these…

Numerical Analysis · Computer Science 2020-10-22 Ruoxi Wang , Yingzhou Li , Eric Darve

Integer data sets frequently appear in many applications in sciences and technology. To analyze these, integer low rank approximation has received much attention due to its capacity of representing the results in integers preserving the…

Numerical Analysis · Mathematics 2015-10-20 Bo Dong , Matthew M. Lin , Haesun Park

We consider the problem of approximating a subset $M$ of a Hilbert space $X$ by a low-dimensional manifold $M_n$, using samples from $M$. We propose a nonlinear approximation method where $M_n $ is defined as the range of a smooth nonlinear…

Numerical Analysis · Mathematics 2025-11-20 Antoine Bensalah , Anthony Nouy , Joel Soffo

In this paper, we derive entrywise error bounds for low-rank approximations of kernel matrices obtained using the truncated eigen-decomposition (or singular value decomposition). While this approximation is well-known to be optimal with…

Statistics Theory · Mathematics 2024-10-31 Alexander Modell

We propose and analyse a reduced-rank method for solving least-squares regression problems with infinite dimensional output. We derive learning bounds for our method, and study under which setting statistical performance is improved in…

Machine Learning · Statistics 2022-11-17 Luc Brogat-Motte , Alessandro Rudi , Céline Brouard , Juho Rousu , Florence d'Alché-Buc

Convergence guarantees for optimization over bounded-rank matrices are delicate to obtain because the feasible set is a non-smooth and non-convex algebraic variety. Existing techniques include projected gradient descent, fixed-rank…

Optimization and Control · Mathematics 2024-06-21 Quentin Rebjock , Nicolas Boumal

A convex envelope for the problem of finding the best approximation to a given matrix with a prescribed rank is constructed. This convex envelope allows the usage of traditional optimization techniques when additional constraints are added…

Functional Analysis · Mathematics 2016-08-30 Fredrik Andersson , Marcus Carlsson , Carl Olsson

In this paper we address the problem of recovering a matrix, with inherent low rank structure, from its lower dimensional projections. This problem is frequently encountered in wide range of areas including pattern recognition, wireless…

Numerical Analysis · Computer Science 2013-12-25 Anupriya Gogna , Ankita Shukla , Angshul Majumdar

We study the minimality of $n\times n$ Hermitian matrices $A$ respect to a $C^*$-subalgebra $\mathcal{B}$ of $M_n(\mathbb{C})$ in the spectral norm, that is \[\|A\|\leq \|A+B\|,\ \text{ for every } B\in \mathcal{B}.\] We generalize the…

Functional Analysis · Mathematics 2026-04-20 Tamara Bottazzi , Alejandro Varela

We address the problem of estimating a high-dimensional matrix from linear measurements, with a focus on designing optimal rank-adaptive algorithms. These algorithms infer the matrix by estimating its singular values and the corresponding…

Information Theory · Computer Science 2026-05-12 Frédéric Zheng , Yassir Jedra , Alexandre Proutiere

PDE solutions are numerically represented by basis functions. Classical methods employ pre-defined bases that encode minimum desired PDE properties, which naturally cause redundant computations. What are the best bases to numerically…

Numerical Analysis · Mathematics 2023-05-23 Shi Chen , Zhiyan Ding , Qin Li , Stephen J. Wright

We consider several classes of highly important semidefinite optimization problems that involve both a convex objective function (smooth or nonsmooth) and additional linear or nonlinear smooth and convex constraints, which are ubiquitous in…

Optimization and Control · Mathematics 2025-04-08 Dan Garber , Atara Kaplan

Given an $n$ by $n$ matrix $A$ and an $n$-vector $b$, along with a rational function $R(z) := D(z )^{-1} N(z)$, we show how to find the optimal approximation to $R(A) b$ from the Krylov space, $\mbox{span}( b, Ab, \ldots , A^{k-1} b)$,…

Numerical Analysis · Mathematics 2023-07-03 Tyler Chen , Anne Greenbaum , Natalie Wellen