English
Related papers

Related papers: Sparse approximation using new greedy-like bases i…

200 papers

Kernel based methods provide a way to reconstruct potentially high-dimensional functions from meshfree samples, i.e., sampling points and corresponding target values. A crucial ingredient for this to be successful is the distribution of the…

Numerical Analysis · Mathematics 2021-05-19 Tizian Wenzel , Gabriele Santin , Bernard Haasdonk

The frame algorithm uses a simple recursive formula to approximate an unknown vector from its frame coefficients. This note introduces an adaptive version of the frame algorithm that maximizes the error reduction between steps in terms of…

Functional Analysis · Mathematics 2025-06-24 Brody Dylan Johnson

Submodular maximization has been widely studied over the past decades, mostly because of its numerous applications in real-world problems. It is well known that the standard greedy algorithm guarantees a worst-case approximation factor of…

Data Structures and Algorithms · Computer Science 2020-02-12 Alfredo Torrico , Mohit Singh , Sebastian Pokutta

Greedy expansions with prescribed coefficients have been introduced by V. N. Temlyakov in the frame of Banach spaces. The idea is to choose a sequence of fixed (real) coefficients $\{c_n\}_{n=1}^\infty$ and a fixed set of elements…

Functional Analysis · Mathematics 2023-07-06 Alessandro Oliaro , Luca Tomatis , Albert R. Valiullin , Artur R. Valiullin

In this paper we develop a procedure to deal with a family of parameter-dependent ill-posed problems, for which the exact solution in general does not exist. The original problems are relaxed by considering corresponding approximate ones,…

Analysis of PDEs · Mathematics 2022-06-29 Martin Lazar , Enrique Zuazua

Since Tinhofer proposed the MinGreedy algorithm for maximum cardinality matching in 1984, several experimental studies found the randomized algorithm to perform excellently for various classes of random graphs and benchmark instances. In…

Data Structures and Algorithms · Computer Science 2015-05-19 Bert Besser , Matthias Poloczek

A major enterprise in compressed sensing and sparse approximation is the design and analysis of computationally tractable algorithms for recovering sparse, exact or approximate, solutions of underdetermined linear systems of equations. Many…

Information Theory · Computer Science 2010-04-13 Jeffrey D. Blanchard , Coralia Cartis , Jared Tanner , Andrew Thompson

In this paper we analyze approximation and recovery properties with respect to systems satisfying universal sampling discretization property and a special incoherence property. We apply a powerful nonlinear approximation method -- the Weak…

Numerical Analysis · Mathematics 2024-01-02 V. Temlyakov

Ensembles of independently trained neural networks are a state-of-the-art approach to estimate predictive uncertainty in Deep Learning, and can be interpreted as an approximation of the posterior distribution via a mixture of delta…

Machine Learning · Computer Science 2022-07-11 Aleksei Tiulpin , Matthew B. Blaschko

Motivated by a wide range of applications in data mining and machine learning, we consider the problem of maximizing a submodular function subject to supermodular cost constraints. In contrast to the well-understood setting of cardinality…

Data Structures and Algorithms · Computer Science 2026-02-19 Ajitesh Srivastava , Shanghua Teng

Greedy algorithms are central to sparse approximation and stage-wise learning methods such as matching pursuit and boosting. It is known that the Power-Relaxed Greedy Algorithm with step sizes $m^{-\alpha}$ may fail to converge when…

Machine Learning · Computer Science 2026-03-10 Pablo M. Berná

Partial differential equation parameter estimation is a mathematical and computational process used to estimate the unknown parameters in a partial differential equation model from observational data. This paper employs a greedy sampling…

Dynamical Systems · Mathematics 2024-05-15 Ali Forootani , Harshit Kapadia , Sridhar Chellappa , Pawan Goyal , Peter Benner

In dictionary selection, several atoms are selected from finite candidates that successfully approximate given data points in the sparse representation. We propose a novel efficient greedy algorithm for dictionary selection. Not only does…

Machine Learning · Computer Science 2018-09-10 Kaito Fujii , Tasuku Soma

This paper defines weak-$\alpha$-supermodularity for set functions. Many optimization objectives in machine learning and data mining seek to minimize such functions under cardinality constrains. We prove that such problems benefit from a…

Data Structures and Algorithms · Computer Science 2015-02-24 Christos Boutsidis , Edo Liberty , Maxim Sviridenko

For compressed sensing over arbitrarily connected networks, we consider the problem of estimating underlying sparse signals in a distributed manner. We introduce a new signal model that helps to describe inter-signal correlation among…

Information Theory · Computer Science 2013-10-29 Dennis Sundman , Saikat Chatterjee , Mikael Skoglund

We study minimum entropy submodular optimization, a common generalization of the minimum entropy set cover problem, studied earlier by Cardinal et al., and the submodular set cover problem. We give a general bound of the approximation…

Data Structures and Algorithms · Computer Science 2014-02-19 Cosmin Bonchiş , Gabriel Istrate

Local-search methods are widely employed in statistical applications, yet interestingly, their theoretical foundations remain rather underexplored, compared to other classes of estimators such as low-degree polynomials and spectral methods.…

Statistics Theory · Mathematics 2025-06-12 Max Lovig , Conor Sheehan , Konstantinos Tsirkas , Ilias Zadik

Compressive sampling has become a widely used approach to construct polynomial chaos surrogates when the number of available simulation samples is limited. Originally, these expensive simulation samples would be obtained at random locations…

Computation · Statistics 2018-07-04 Negin Alemazkoor , Hadi Meidani

The realisation of sensing modalities based on the principles of compressed sensing is often hindered by discrepancies between the mathematical model of its sensing operator, which is necessary during signal recovery, and its actual…

Information Theory · Computer Science 2018-02-21 Valerio Cambareri , Amirafshar Moshtaghpour , Laurent Jacques

The paper gives a systematic study of the approximate versions of three greedy-type algorithms that are widely used in convex optimization. By approximate version we mean the one where some of evaluations are made with an error. Importance…

Machine Learning · Statistics 2014-12-11 Vladimir Temlyakov