English
Related papers

Related papers: Submodular Minimax Optimization: Finding Effective…

200 papers

Which ads should we display in sponsored search in order to maximize our revenue? How should we dynamically rank information sources to maximize the value of the ranking? These applications exhibit strong diminishing returns: Redundancy…

Machine Learning · Computer Science 2014-07-07 Daniel Golovin , Andreas Krause , Matthew Streeter

In this paper, we focus on applications in machine learning, optimization, and control that call for the resilient selection of a few elements, e.g. features, sensors, or leaders, against a number of adversarial denial-of-service attacks or…

Optimization and Control · Mathematics 2017-11-01 Vasileios Tzoumas , Konstantinos Gatsis , Ali Jadbabaie , George J. Pappas

Submodular function minimization is well studied, and existing algorithms solve it exactly or up to arbitrary accuracy. However, in many applications, such as structured sparse learning or batch Bayesian optimization, the objective function…

Machine Learning · Computer Science 2022-03-10 Marwa El Halabi , Stefanie Jegelka

Constrained submodular set function maximization problems often appear in multi-agent decision-making problems with a discrete feasible set. A prominent example is the problem of multi-agent mobile sensor placement over a discrete domain.…

Optimization and Control · Mathematics 2021-08-02 Navid Rezazadeh , Solmaz S. Kia

Mini-batch gradient descent based methods are the de facto algorithms for training neural network architectures today. We introduce a mini-batch selection strategy based on submodular function maximization. Our novel submodular formulation…

Machine Learning · Computer Science 2019-06-21 K J Joseph , Vamshi Teja R , Krishnakant Singh , Vineeth N Balasubramanian

The study of combinatorial optimization problems with a submodular objective has attracted much attention in recent years. Such problems are important in both theory and practice because their objective functions are very general. Obtaining…

Data Structures and Algorithms · Computer Science 2016-11-11 Niv Buchbinder , Moran Feldman

Submodular optimization is a special class of combinatorial optimization arising in several machine learning problems, but also in cooperative control of complex systems. In this paper, we consider agents in an asynchronous, unreliable and…

Systems and Control · Computer Science 2018-12-17 Andrea Testa , Ivano Notarnicola , Giuseppe Notarstefano

The goal of a sequential decision making problem is to design an interactive policy that adaptively selects a group of items, each selection is based on the feedback from the past, in order to maximize the expected utility of selected…

Data Structures and Algorithms · Computer Science 2022-09-13 Shaojie Tang

Consider the following problem: given a set system (U,I) and an edge-weighted graph G = (U, E) on the same universe U, find the set A in I such that the Steiner tree cost with terminals A is as large as possible: "which set in I is the most…

Data Structures and Algorithms · Computer Science 2011-02-25 Anupam Gupta , Viswanath Nagarajan , R. Ravi

In the problem of Submodular Max-Min Allocation, we are given a set of items, a set of players, and monotone submodular valuation functions that represent the satisfaction of a player with a certain subset of items. The goal is to find an…

Data Structures and Algorithms · Computer Science 2026-04-15 Kimon Boehmer

Many prediction domains, such as ad placement, recommendation, trajectory prediction, and document summarization, require predicting a set or list of options. Such lists are often evaluated using submodular reward functions that measure…

Machine Learning · Computer Science 2013-05-14 Stephane Ross , Jiaji Zhou , Yisong Yue , Debadeepta Dey , J. Andrew Bagnell

We design and analyze minimax-optimal algorithms for online linear optimization games where the player's choice is unconstrained. The player strives to minimize regret, the difference between his loss and the loss of a post-hoc benchmark…

Machine Learning · Computer Science 2013-02-12 H. Brendan McMahan

Submodular optimization has received significant attention in both practice and theory, as a wide array of problems in machine learning, auction theory, and combinatorial optimization have submodular structure. In practice, these problems…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-10-04 Paul Liu , Jan Vondrak

Optimal sensing nodes selection (SNS) in dynamic systems is a combinatorial optimization problem that has been thoroughly studied in the recent literature. This problem can be formulated within the context of set optimization. For…

Optimization and Control · Mathematics 2025-03-12 Mohamad H. Kazma , Ahmad F. Taha

We study online convex optimization under stochastic sub-gradient observation faults, where we introduce adaptive algorithms with minimax optimal regret guarantees. We specifically study scenarios where our sub-gradient observations can be…

Machine Learning · Computer Science 2019-04-23 Hakan Gokcesu , Suleyman S. Kozat

The min-max optimization problem, also known as the saddle point problem, is a classical optimization problem which is also studied in the context of zero-sum games. Given a class of objective functions, the goal is to find a value for the…

Optimization and Control · Mathematics 2021-08-11 Meisam Razaviyayn , Tianjian Huang , Songtao Lu , Maher Nouiehed , Maziar Sanjabi , Mingyi Hong

We develop an approach for estimating models described via conditional moment restrictions, with a prototypical application being non-parametric instrumental variable regression. We introduce a min-max criterion function, under which the…

Econometrics · Economics 2020-06-15 Nishanth Dikkala , Greg Lewis , Lester Mackey , Vasilis Syrgkanis

In this paper, we show that the optimal receive antenna subset selection problem for maximizing the mutual information in a point-to-point MIMO system is sub-modular. Consequently, a greedy step-wise optimization approach, where at each…

Information Theory · Computer Science 2011-12-15 Rahul Vaze , Harish Ganapathy

Submodular functions are a special class of set functions which naturally model the notion of representativeness, diversity, coverage etc. and have been shown to be computationally very efficient. A lot of past work has applied submodular…

Machine Learning · Computer Science 2022-02-24 Vishal Kaushal , Ganesh Ramakrishnan , Rishabh Iyer

Submodular functions play a key role in the area of optimization as they allow to model many real-world problems that face diminishing returns. Evolutionary algorithms have been shown to obtain strong theoretical performance guarantees for…