English
Related papers

Related papers: Revisiting Matching Pursuit: Beyond Approximate Su…

200 papers

We consider optimal sensor placement for a family of linear Bayesian inverse problems characterized by a deterministic hyper-parameter. The hyper-parameter describes distinct configurations in which measurements can be taken of the observed…

Numerical Analysis · Mathematics 2023-01-31 Nicole Aretz , Peng Chen , Denise Degen , Karen Veroy

We consider the problem of approximating a given element $f$ from a Hilbert space $\mathcal{H}$ by means of greedy algorithms and the application of such procedures to the regression problem in statistical learning theory. We improve on the…

Statistics Theory · Mathematics 2009-09-29 Andrew R. Barron , Albert Cohen , Wolfgang Dahmen , Ronald A. DeVore

We present an optimal, combinatorial 1-1/e approximation algorithm for monotone submodular optimization over a matroid constraint. Compared to the continuous greedy algorithm (Calinescu, Chekuri, Pal and Vondrak, 2008), our algorithm is…

Data Structures and Algorithms · Computer Science 2013-11-20 Yuval Filmus , Justin Ward

Greedy optimization methods such as Matching Pursuit (MP) and Frank-Wolfe (FW) algorithms regained popularity in recent years due to their simplicity, effectiveness and theoretical guarantees. MP and FW address optimization over the linear…

Machine Learning · Computer Science 2017-11-21 Francesco Locatello , Michael Tschannen , Gunnar Rätsch , Martin Jaggi

We study the problem of incorporating risk while making combinatorial decisions under uncertainty. We formulate a discrete submodular maximization problem for selecting a set using Conditional-Value-at-Risk (CVaR), a risk metric commonly…

Artificial Intelligence · Computer Science 2018-10-30 Lifeng Zhou , Pratap Tokekar

We consider the problem of maximizing non-negative non-decreasing set functions. Although most of the recent work focus on exploiting submodularity, it turns out that several objectives we encounter in practice are not submodular.…

Data Structures and Algorithms · Computer Science 2018-06-19 Gaurav Gupta , Sergio Pequito , Paul Bogdan

This article provides a comprehensive exploration of submodular maximization problems, focusing on those subject to uniform and partition matroids. Crucial for a wide array of applications in fields ranging from computer science to systems…

Data Structures and Algorithms · Computer Science 2025-01-03 Solmaz S. Kia

It is known that greedy methods perform well for maximizing monotone submodular functions. At the same time, such methods perform poorly in the face of non-monotonicity. In this paper, we show - arguably, surprisingly - that invoking the…

Machine Learning · Computer Science 2017-04-07 Moran Feldman , Christopher Harshaw , Amin Karbasi

In this paper, we address the sparse multiple measurement vector (MMV) problem where the objective is to recover a set of sparse nonzero row vectors or indices of a signal matrix from incomplete measurements. Ideally, regardless of the…

Information Theory · Computer Science 2016-01-27 Kyung Su Kim , Sae-Young Chung

Submodular function optimization has numerous applications in machine learning and data analysis, including data summarization which aims to identify a concise and diverse set of data points from a large dataset. It is important to…

Data Structures and Algorithms · Computer Science 2023-04-11 Shaojie Tang , Jing Yuan , Twumasi Mensah-Boateng

We study the problem of maximizing a non-monotone submodular function under multiple knapsack constraints. We propose a simple discrete greedy algorithm to approach this problem, and prove that it yields strong approximation guarantees for…

Machine Learning · Computer Science 2020-02-19 Vanja Doskoč , Tobias Friedrich , Andreas Göbel , Frank Neumann , Aneta Neumann , Francesco Quinzan

Submodular functions are an important class of functions in combinatorial optimization which satisfy the natural properties of decreasing marginal costs. The study of these functions has led to strong structural properties with applications…

Multiagent Systems · Computer Science 2009-11-13 Gagan Goel , Pushkar Tripathi , Lei Wang

We explore the problems of classification of composite object (images, speech signals) with low number of models per class. We study the question of improving recognition performance for medium-sized database (thousands of classes). The key…

Computer Vision and Pattern Recognition · Computer Science 2017-09-19 Andrey Savchenko

Submodular functions -- functions exhibiting diminishing returns -- are central to machine learning. When the objective is monotone and non-negative, the greedy algorithm achieves a tight $63\%$ approximation. But many practical objectives…

Machine Learning · Computer Science 2026-05-11 Yixin Chen , Alan Kuhnle

A flaw in the greedy approximation algorithm proposed by Zhang et al. for minimum connected set cover problem is corrected, and a stronger result on the approximation ratio of the modified greedy algorithm is established. The results are…

Data Structures and Algorithms · Computer Science 2015-03-19 Wei Ren , Qing Zhao

Meta-Learning has gained increasing attention in the machine learning and artificial intelligence communities. In this paper, we introduce and study an adaptive submodular meta-learning problem. The input of our problem is a set of items,…

Machine Learning · Computer Science 2021-03-26 Shaojie Tang , Jing Yuan

Sensor placement optimization methods have been studied extensively. They can be applied to a wide range of applications, including surveillance of known environments, optimal locations for 5G towers, and placement of missile defense…

Machine Learning · Computer Science 2024-05-22 Lukas Taus , Yen-Hsi Richard Tsai

We introduce the \emph{submodular objectives chasing problem}, which generalizes many natural and previously-studied problems: a sequence of constrained submodular maximization problems is revealed over time, with both the objective and…

Data Structures and Algorithms · Computer Science 2025-11-18 Niv Buchbinder , Joseph , Naor , David Wajc

This paper focuses on the development of novel greedy techniques for distributed learning under sparsity constraints. Greedy techniques have widely been used in centralized systems due to their low computational requirements and at the same…

Information Theory · Computer Science 2015-06-23 Symeon Chouvardas , Gerasimos Mileounis , Nicholas Kalouptsidis , Sergios Theodoridis

We study a linear quadratic regulation problem with a constraint where the control input can be nonzero only at a limited number of times. Given that this constraint leads to a combinational optimization problem, we adopt a greedy method to…

Systems and Control · Electrical Eng. & Systems 2024-03-26 Shumpei Nishida , Kunihisa Okano