English
Related papers

Related papers: Black Box Submodular Maximization: Discrete and Co…

200 papers

Solving stochastic optimization problems under partial observability, where one needs to adaptively make decisions with uncertain outcomes, is a fundamental but notoriously difficult challenge. In this paper, we introduce the concept of…

Machine Learning · Computer Science 2017-12-07 Daniel Golovin , Andreas Krause

Over the last two decades, submodular function maximization has been the workhorse of many discrete optimization problems in machine learning applications. Traditionally, the study of submodular functions was based on binary function…

Machine Learning · Computer Science 2022-05-18 Loay Mualem , Moran Feldman

In this paper, we study the problem of maximizing $k$-submodular functions subject to a knapsack constraint. For monotone objective functions, we present a $\frac{1}{2}(1-e^{-2})\approx 0.432$ greedy approximation algorithm. For the…

Data Structures and Algorithms · Computer Science 2023-09-18 Hao Xiao , Qian Liu , Yang Zhou , Min Li

In this paper, we study the black box optimization problem under the Polyak--Lojasiewicz (PL) condition, assuming that the objective function is not just smooth, but has higher smoothness. By using "kernel-based" approximation instead of…

Optimization and Control · Mathematics 2023-11-29 Aleksandr Lobanov , Alexander Gasnikov , Fedor Stonyakin

We consider the problem of optimizing a grey-box objective function, i.e., nested function composed of both black-box and white-box functions. A general formulation for such grey-box problems is given, which covers the existing grey-box…

Machine Learning · Computer Science 2023-08-03 Wenjie Xu , Yuning Jiang , Bratislav Svetozarevic , Colin N. Jones

Time-Varying Bayesian Optimization (TVBO) is the go-to framework for optimizing a time-varying, expensive, noisy black-box function $f$. However, most of the asymptotic guarantees offered by TVBO algorithms rely on the assumption that…

Machine Learning · Statistics 2025-10-21 Anthony Bardou , Patrick Thiran

For a wide range of applications the structure of systems like Neural Networks or complex simulations, is unknown and approximation is costly or even impossible. Black-box optimization seeks to find optimal (hyper-) parameters for these…

Machine Learning · Computer Science 2023-09-06 Janina Schreiber , Damar Wicaksono , Michael Hecht

Submodular functions are a broad class of set functions, which naturally arise in diverse areas. Many algorithms have been suggested for the maximization of these functions. Unfortunately, once the function deviates from submodularity, the…

Discrete Mathematics · Computer Science 2017-07-17 Lin Chen , Moran Feldman , Amin Karbasi

We propose and analyze a model-based derivative-free (DFO) algorithm for solving bound-constrained optimization problems where the objective function is the composition of a smooth function and a vector of black-box functions. We assume…

Optimization and Control · Mathematics 2024-01-03 Frank E. Curtis , Shima Dezfulian , Andreas Wächter

Continuous DR-submodular functions are a class of functions that satisfy the Diminishing Returns (DR) property, which implies that they are concave along non-negative directions. Existing works have studied monotone continuous DR-submodular…

Machine Learning · Computer Science 2022-05-31 Omid Sadeghi , Maryam Fazel

We study the problem of incorporating risk while making combinatorial decisions under uncertainty. We formulate a discrete submodular maximization problem for selecting a set using Conditional-Value-at-Risk (CVaR), a risk metric commonly…

Robotics · Computer Science 2022-03-21 Lifeng Zhou , Pratap Tokekar

We study the problem of maximizing a non-negative monotone submodular objective $f$ subject to the intersection of $k$ arbitrary matroid constraints. The natural greedy algorithm guarantees $(k+1)$-approximation for this problem, and the…

Data Structures and Algorithms · Computer Science 2026-05-11 Moran Feldman , Justin Ward

We study the maximum capture problem in facility location under random utility models, i.e., the problem of seeking to locate new facilities in a competitive market such that the captured user demand is maximized, assuming that each…

Optimization and Control · Mathematics 2022-03-29 Tien Thanh Dam , Thuy Anh Ta , Tien Mai

We consider the maximization problem in the value oracle model of functions defined on $k$-tuples of sets that are submodular in every orthant and $r$-wise monotone, where $k\geq 2$ and $1\leq r\leq k$. We give an analysis of a…

Data Structures and Algorithms · Computer Science 2016-08-05 Justin Ward , Stanislav Zivny

We investigate the convergence properties of a class of iterative algorithms designed to minimize a potentially non-smooth and noisy objective function, which may be algebraically intractable and whose values may be obtained as the output…

Computation · Statistics 2025-12-04 Christophe Andrieu , Nicolas Chopin , Ettore Fincato , Mathieu Gerber

In this paper, we provide the first deterministic algorithm that achieves the tight $1-1/e$ approximation guarantee for submodular maximization under a cardinality (size) constraint while making a number of queries that scales only linearly…

Data Structures and Algorithms · Computer Science 2022-04-13 Wenxin Li , Moran Feldman , Ehsan Kazemi , Amin Karbasi

Chance constraints are frequently used to limit the probability of constraint violations in real-world optimization problems where the constraints involve stochastic components. We study chance-constrained submodular optimization problems,…

Optimization and Control · Mathematics 2023-09-27 Xiankun Yan , Anh Viet Do , Feng Shi , Xiaoyu Qin , Frank Neumann

Submodular maximization is a general optimization problem with a wide range of applications in machine learning (e.g., active learning, clustering, and feature selection). In large-scale optimization, the parallel running time of an…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Vahab Mirrokni , Morteza Zadimoghaddam

Motivated by practical applications, recent works have considered maximization of sums of a submodular function $g$ and a linear function $\ell$. Almost all such works, to date, studied only the special case of this problem in which $g$ is…

Data Structures and Algorithms · Computer Science 2022-04-08 Kobi Bodek , Moran Feldman

In this work, we study the Stochastic Budgeted Multi-round Submodular Maximization (SBMSm) problem, where we aim to adaptively maximize the sum, over multiple rounds, of a monotone and submodular objective function defined on subsets of…

Data Structures and Algorithms · Computer Science 2024-09-26 Vincenzo Auletta , Diodato Ferraioli , Cosimo Vinci