English
Related papers

Related papers: On the Unreasonable Effectiveness of the Greedy Al…

200 papers

The maximum a posteriori (MAP) inference for determinantal point processes (DPPs) is crucial for selecting diverse items in many machine learning applications. Although DPP MAP inference is NP-hard, the greedy algorithm often finds…

Data Structures and Algorithms · Computer Science 2022-06-14 Shinichi Hemmi , Taihei Oki , Shinsaku Sakaue , Kaito Fujii , Satoru Iwata

Optimal experimental design (OED) concerns itself with identifying ideal methods of data collection, e.g.~via sensor placement. The \emph{greedy algorithm}, that is, placing one sensor at a time, in an iteratively optimal manner, stands as…

Optimization and Control · Mathematics 2025-10-15 Christian Aarset

Determinantal point processes (DPPs) are popular probabilistic models that arise in many machine learning tasks, where distributions of diverse sets are characterized by matrix determinants. In this paper, we develop fast algorithms to find…

Discrete Mathematics · Computer Science 2017-06-15 Insu Han , Prabhanjan Kambadur , Kyoungsoo Park , Jinwoo Shin

The study of greedy approximation in the context of convex optimization is becoming a promising research direction as greedy algorithms are actively being employed to construct sparse minimizers for convex functions with respect to given…

Numerical Analysis · Mathematics 2022-04-26 Anton Dereventsov , Vladimir Temlyakov

In the design of greedy algorithms for the maximum cardinality matching problem the utilization of degree information when selecting the next edge is a well established and successful approach. We define the class of "degree sensitive"…

Data Structures and Algorithms · Computer Science 2016-12-21 Bert Besser , Bastian Werth

We study the fundamental limits of matching pursuit, or the pure greedy algorithm, for approximating a target function $ f $ by a linear combination $f_n$ of $n$ elements from a dictionary. When the target function is contained in the…

Machine Learning · Statistics 2024-07-24 Jason M. Klusowski , Jonathan W. Siegel

We present a practical and powerful new framework for both unconstrained and constrained submodular function optimization based on discrete semidifferentials (sub- and super-differentials). The resulting algorithms, which repeatedly compute…

Data Structures and Algorithms · Computer Science 2013-08-13 Rishabh Iyer , Stefanie Jegelka , Jeff Bilmes

In this paper, we study the \underline{R}obust \underline{o}ptimization for \underline{se}quence \underline{Net}worked \underline{s}ubmodular maximization (RoseNets) problem. We interweave the robust optimization with the sequence networked…

Artificial Intelligence · Computer Science 2023-01-27 Qihao Shi , Bingyang Fu , Can Wang , Jiawei Chen , Sheng Zhou , Yan Feng , Chun Chen

The Submodular Welfare Maximization problem (SWM) captures an important subclass of combinatorial auctions and has been studied extensively from both computational and economic perspectives. In particular, it has been studied in a natural…

Data Structures and Algorithms · Computer Science 2018-11-20 Niv Buchbinder , Moran Feldman , Yuval Filmus , Mohit Garg

In many machine learning applications, one needs to interactively select a sequence of items (e.g., recommending movies based on a user's feedback) or make sequential decisions in a certain order (e.g., guiding an agent through a series of…

Machine Learning · Computer Science 2019-06-21 Marko Mitrovic , Ehsan Kazemi , Moran Feldman , Andreas Krause , Amin Karbasi

We propose a theoretical framework to capture incremental solutions to cardinality constrained maximization problems. The defining characteristic of our framework is that the cardinality/support of the solution is bounded by a value…

Discrete Mathematics · Computer Science 2018-04-18 Aaron Bernstein , Yann Disser , Martin Groß

We consider the maximization problem in the value oracle model of functions defined on $k$-tuples of sets that are submodular in every orthant and $r$-wise monotone, where $k\geq 2$ and $1\leq r\leq k$. We give an analysis of a…

Data Structures and Algorithms · Computer Science 2016-08-05 Justin Ward , Stanislav Zivny

A fundamental task underlying many important optimization problems, from influence maximization to sensor placement to content recommendation, is to select the optimal group of $k$ items from a larger set. Submodularity has been very…

Data Structures and Algorithms · Computer Science 2022-03-02 Jon Kleinberg , Emily Ryu , Éva Tardos

Most supervised learning models are trained for full automation. However, their predictions are sometimes worse than those by human experts on some specific instances. Motivated by this empirical observation, our goal is to design…

Machine Learning · Statistics 2021-03-16 Abir De , Nastaran Okati , Ali Zarezade , Manuel Gomez-Rodriguez

Kernel based methods provide a way to reconstruct potentially high-dimensional functions from meshfree samples, i.e., sampling points and corresponding target values. A crucial ingredient for this to be successful is the distribution of the…

Numerical Analysis · Mathematics 2021-05-19 Tizian Wenzel , Gabriele Santin , Bernard Haasdonk

We consider two greedy algorithms for minimizing a convex function in a bounded convex set: an algorithm by Jones [1992] and the Frank-Wolfe (FW) algorithm. We first consider approximate versions of these algorithms. For smooth convex…

Optimization and Control · Mathematics 2018-11-19 Nan Ye , Peter Bartlett

This paper introduces Rewired Sequential Greedy (ResQue Greedy), an enhanced approach for submodular maximization under cardinality constraints. By integrating a novel set curvature metric within a lattice-based framework, ResQue Greedy…

Discrete Mathematics · Computer Science 2025-05-21 Joan Vendrell Gallart , Alan Kuhnle , Solmaz Kia

We consider an optimization problem where the decision variable is a string of bounded length. For some time there has been an interest in bounding the performance of the greedy strategy for this problem. Here, we provide weakened…

Optimization and Control · Mathematics 2016-11-18 Yajing Liu , Edwin K. P. Chong , Ali Pezeshki

We study the optimization problem of choosing strings of finite length to maximize string submodular functions on string matroids, which is a broader class of problems than maximizing set submodular functions on set matroids. We provide a…

Data Structures and Algorithms · Computer Science 2023-09-08 Brandon Van Over , Bowen Li , Edwin K. P. Chong , Ali Pezeshki

We study the problem of estimating a random process from the observations collected by a network of sensors that operate under resource constraints. When the dynamics of the process and sensor observations are described by a state-space…

Signal Processing · Electrical Eng. & Systems 2018-07-24 Abolfazl Hashemi , Mahsa Ghasemi , Haris Vikalo , Ufuk Topcu