English
Related papers

Related papers: Entropy-based convergence rates of greedy algorith…

200 papers

Considering the set cover problem, by modifying the approach that gives a logarithmic approximation guarantee for the greedy algorithm, we obtain an estimation of the greedy algorithm's accuracy for a particular input. We compare the…

Data Structures and Algorithms · Computer Science 2019-02-13 Alexander Prolubnikov

We show that a very simple modification of the Pure Greedy Algorithm for approximating functions by sparse sums from a dictionary in a Hilbert or more generally a Banach space has optimal convergence rates on the class of convex…

Numerical Analysis · Mathematics 2015-05-15 Guergana Petrova

We consider learning a convex combination of basis models, and present some new theoretical and empirical results that demonstrate the effectiveness of a greedy approach. Theoretically, we first consider whether we can use linear, instead…

Machine Learning · Computer Science 2020-05-05 Tan Nguyen , Nan Ye , Peter L. Bartlett

This work deals with tailored reduced order models for bifurcating nonlinear parametric partial differential equations, where multiple coexisting solutions arise for a given parametric instance. Approaches based on proper orthogonal…

Numerical Analysis · Mathematics 2025-05-14 Federico Pichi , Maria Strazzullo

Data-dependent greedy algorithms in kernel spaces are known to provide fast converging interpolants, while being extremely easy to implement and efficient to run. Despite this experimental evidence, no detailed theory has yet been…

Numerical Analysis · Mathematics 2022-10-31 Tizian Wenzel , Gabriele Santin , Bernard Haasdonk

We study sparse approximation by greedy algorithms. Our contribution is two-fold. First, we prove exact recovery with high probability of random $K$-sparse signals within $\lceil K(1+\e)\rceil$ iterations of the Orthogonal Matching Pursuit…

Numerical Analysis · Mathematics 2013-04-03 Eugene Livshitz , Vladimir Temlyakov

In this paper we study greedy approximation in Banach spaces. We discuss a modification of the Weak Chebyshev Greedy Algorithm, in which steps of the algorithm can be executed imprecisely. Such inaccuracies are represented by both absolute…

Functional Analysis · Mathematics 2021-06-07 Anton Dereventsov

We obtain Lebesgue-type inequalities for the greedy algorithm for arbitrary complete seminormalized biorthogonal systems in Banach spaces. The bounds are given only in terms of the upper democracy functions of the basis and its dual. We…

Functional Analysis · Mathematics 2017-09-18 P. M. Berná , O. Blasco , G. Garrigós , E. Hernández , T. Oikhberg

Greedy algorithms which use only function evaluations are applied to convex optimization in a general Banach space $X$. Along with algorithms that use exact evaluations, algorithms with approximate evaluations are treated. A priori upper…

Machine Learning · Statistics 2014-01-03 R. A. DeVore , V. N. Temlyakov

We consider meshless approximation for solutions of boundary value problems (BVPs) of elliptic Partial Differential Equations (PDEs) via symmetric kernel collocation. We discuss the importance of the choice of the collocation points, in…

Numerical Analysis · Mathematics 2025-04-29 Tizian Wenzel , Daniel Winkle , Gabriele Santin , Bernard Haasdonk

In this work we propose and analyze a weighted proper orthogonal decomposition method to solve elliptic partial differential equations depending on random input data, for stochastic problems that can be transformed into parametric systems.…

Numerical Analysis · Mathematics 2023-08-08 Luca Venturi , Francesco Ballarin , Gianluigi Rozza

Sparse approximation is important in many applications because of concise form of an approximant and good accuracy guarantees. The theory of compressed sensing, which proved to be very useful in the image processing and data sciences, is…

Numerical Analysis · Mathematics 2025-02-20 V. Temlyakov

Motivated by the successful use of greedy algorithms for Reduced Basis Methods, a greedy method is proposed that selects N input data in an asymptotically optimal way to solve well-posed operator equations using these N data. The operator…

Numerical Analysis · Mathematics 2019-03-28 Robert Schaback

In many prediction problems, it is not uncommon that the number of variables used to construct a forecast is of the same order of magnitude as the sample size, if not larger. We then face the problem of constructing a prediction in the…

Statistics Theory · Mathematics 2016-02-08 Alessio Sancetta

Greedy Sampling Methods (GSMs) are widely used to construct approximate solutions of Configuration Optimization Problems (COPs), where a loss functional is minimized over finite configurations of points in a compact domain. While effective…

Optimization and Control · Mathematics 2026-01-09 Evie Nielen , Oliver Tse

In this article, we present a greedy algorithm based on a tensor product decomposition, whose aim is to compute the global minimum of a strongly convex energy functional. We prove the convergence of our method provided that the gradient of…

Functional Analysis · Mathematics 2015-03-13 Eric Cances , Virginie Ehrlacher , Tony Lelievre

Reduced bases have been introduced for the approximation of parametrized PDEs in applications where many online queries are required. Their numerical efficiency for such problems has been theoretically confirmed in \cite{BCDDPW,DPW}, where…

Numerical Analysis · Mathematics 2020-02-20 Albert Cohen , Wolfgang Dahmen , Ronald DeVore

Greedy methods have recently been successfully applied to generalized kernel interpolation, or the recovery of a function from data stemming from the evaluation of linear functionals, including the approximation of solutions of linear PDEs…

Numerical Analysis · Mathematics 2026-01-29 Bernard Haasdonk , Gabriele Santin , Tizian Wenzel , Daniel Winkle

We study sparse approximate solutions to convex optimization problems. It is known that in many engineering applications researchers are interested in an approximate solution of an optimization problem as a linear combination of elements…

Machine Learning · Statistics 2012-06-05 V. N. Temlyakov

The frame algorithm uses a simple recursive formula to approximate an unknown vector from its frame coefficients. This note introduces an adaptive version of the frame algorithm that maximizes the error reduction between steps in terms of…

Functional Analysis · Mathematics 2025-06-24 Brody Dylan Johnson