English
Related papers

Related papers: Sparse approximation using new greedy-like bases i…

200 papers

A $k$-submodular function naturally generalizes submodular functions by taking as input $k$ disjoint subsets, rather than a single subset. Unlike standard submodular maximization, which only requires selecting elements for the solution,…

Data Structures and Algorithms · Computer Science 2025-07-18 Chenhao Wang

Recently, it has been discovered that results on universal sampling discretization of the square norm are useful in sparse sampling recovery with error being measured in the square norm. It was established that a simple greedy type…

Numerical Analysis · Mathematics 2023-07-11 F. Dai , V. Temlyakov

We analyze the performance of the greedy algorithm, and also a discrete semi-gradient based algorithm, for maximizing the sum of a suBmodular and suPermodular (BP) function (both of which are non-negative monotone non-decreasing) under two…

Discrete Mathematics · Computer Science 2018-01-24 Wenruo Bai , Jeffrey A. Bilmes

This paper studies the estimation of the conditional density f (x, $\times$) of Y i given X i = x, from the observation of an i.i.d. sample (X i , Y i) $\in$ R d , i = 1,. .. , n. We assume that f depends only on r unknown components with…

Statistics Theory · Mathematics 2021-06-29 Minh-Lien Jeanne Nguyen , Claire Lacour , Vincent Rivoirard

We prove some results on the rate of convergence of greedy algorithms, which provide expansions. We consider both the case of Hilbert spaces and the more general case of Banach spaces. The new ingredient of the paper is that we bound the…

Numerical Analysis · Mathematics 2023-04-14 V. N. Temlyakov

In the context of Gaussian conditioning, greedy algorithms iteratively select the most informative measurements, given an observed Gaussian random variable. However, the convergence analysis for conditioning Gaussian random variables…

Statistics Theory · Mathematics 2025-02-18 Daniel Winkle , Ingo Steinwart , Bernard Haasdonk

This work provides performance guarantees for the greedy solution of experimental design problems. In particular, it focuses on A- and E-optimal designs, for which typical guarantees do not apply since the mean-square error and the maximum…

Machine Learning · Computer Science 2018-02-01 Luiz F. O. Chamon , Alejandro Ribeiro

In the field of uncertainty quantification, sparse polynomial chaos (PC) expansions are commonly used by researchers for a variety of purposes, such as surrogate modeling. Ideas from compressed sensing may be employed to exploit this…

Methodology · Statistics 2018-05-09 Paul Diaz , Alireza Doostan , Jerrad Hampton

Policy Gradient methods that explore directly in parameter space are among the most effective and robust direct policy search methods and have drawn a lot of attention lately. The basic method from this field, Policy Gradients with…

Machine Learning · Computer Science 2013-12-16 Frank Sehnke

Democracy functions of wavelet admissible bases are computed for weighted Orlicz Spaces in terms of its fundamental function. In particular, we prove that these bases are greedy if and only if the Orlicz space is a Lebesgue space. Also,…

History and Overview · Mathematics 2009-11-26 Maria de Natividade

Modern agentic systems operate in environments with extremely large action spaces, such as tool-augmented language models with thousands of available APIs or retrieval operations. Despite this scale, empirical evidence suggests that only a…

Artificial Intelligence · Computer Science 2026-01-14 Angshul Majumdar

Leveraging the wealth of unlabeled data produced in recent years provides great potential for improving supervised models. When the cost of acquiring labels is high, probabilistic active learning methods can be used to greedily select the…

Machine Learning · Statistics 2021-02-09 Robert Pinsler , Jonathan Gordon , Eric Nalisnick , José Miguel Hernández-Lobato

We show the potential of greedy recovery strategies for the sparse approximation of multivariate functions from a small dataset of pointwise evaluations by considering an extension of the orthogonal matching pursuit to the setting of…

Numerical Analysis · Mathematics 2019-05-06 Ben Adcock , Simone Brugiapaglia

Several convex formulation methods have been proposed previously for statistical estimation with structured sparsity as the prior. These methods often require a carefully tuned regularization parameter, often a cumbersome or heuristic…

Machine Learning · Statistics 2016-03-23 Sohail Bahmani , Petros T. Boufounos , Bhiksha Raj

We address the problems of minimizing and of maximizing the spectral radius overa compact family of non-negative matrices. Those problems being hard in generalcan be efficiently solved for some special families. We consider the so-called…

Optimization and Control · Mathematics 2020-05-19 Vladimir Yu. Protasov , Aleksandar Cvetković

We discuss a method for sparse signal approximation, which is based on the correlation of the target signal with a pseudo-random signal, and uses a modification of the greedy matching pursuit algorithm. We show that this approach provides…

Data Analysis, Statistics and Probability · Physics 2011-05-26 M. Andrecut

In many prediction problems, it is not uncommon that the number of variables used to construct a forecast is of the same order of magnitude as the sample size, if not larger. We then face the problem of constructing a prediction in the…

Statistics Theory · Mathematics 2016-02-08 Alessio Sancetta

We briefly discuss the greedy method and a couple of its more efficient variants for approximately maximizing monotone submodular functions.

Optimization and Control · Mathematics 2025-10-21 Alen Alexanderian

We describe the Greedy Sparse Subspace Clustering (GSSC) algorithm providing an efficient method for clustering data belonging to a few low-dimensional linear or affine subspaces from incomplete corrupted and noisy data. We provide…

Numerical Analysis · Mathematics 2013-04-17 Alexander Petukhov , Inna Kozlov

For the classical maximum coverage problem, the greedy algorithm achieves a worst-case $1-1/e$ approximation, which is optimal unless $\text{P} = \text{NP}$. The notion of coverage appears in a wide range of optimization tasks, where…

Data Structures and Algorithms · Computer Science 2026-04-29 Eric Balkanski , Jason Chatzitheodorou , Flore Sentenac