English
Related papers

Related papers: Continuous DR-submodular Maximization: Structure a…

200 papers

We present a practical and powerful new framework for both unconstrained and constrained submodular function optimization based on discrete semidifferentials (sub- and super-differentials). The resulting algorithms, which repeatedly compute…

Data Structures and Algorithms · Computer Science 2013-08-13 Rishabh Iyer , Stefanie Jegelka , Jeff Bilmes

We study the problem of maximizing constrained non-monotone submodular functions and provide approximation algorithms that improve existing algorithms in terms of either the approximation factor or simplicity. Our algorithms combine…

Data Structures and Algorithms · Computer Science 2016-03-01 Salman Fadaei , MohammadAmin Fazli , MohammadAli Safari

The problem of maximizing non-negative submodular functions has been studied extensively in the last few years. However, most papers consider submodular set functions. Recently, several advances have been made for the more general case of…

Discrete Mathematics · Computer Science 2016-11-29 Corinna Gottschalk , Britta Peis

Minimax optimization has been central in addressing various applications in machine learning, game theory, and control theory. Prior literature has thus far mainly focused on studying such problems in the continuous domain, e.g.,…

Optimization and Control · Mathematics 2021-11-03 Arman Adibi , Aryan Mokhtari , Hamed Hassani

Submodular function minimization is a fundamental optimization problem that arises in several applications in machine learning and computer vision. The problem is known to be solvable in polynomial time, but general purpose algorithms have…

Machine Learning · Computer Science 2015-02-10 Alina Ene , Huy L. Nguyen

A number of discrete and continuous optimization problems in machine learning are related to convex minimization problems under submodular constraints. In this paper, we deal with a submodular function with a directed graph structure, and…

Machine Learning · Computer Science 2013-09-27 Kiyohito Nagano , Yoshinobu Kawahara

Majorization-minimization algorithms consist of successively minimizing a sequence of upper bounds of the objective function so that along the iterations the objective function decreases. Such a simple principle allows to solve a large…

Optimization and Control · Mathematics 2025-03-04 Ion Necoara , Daniela Lupu

Submodular functions, defined on continuous or discrete domains, arise in numerous applications. We study the minimization of the difference of two submodular (DS) functions, over both domains, extending prior work restricted to set…

Optimization and Control · Mathematics 2025-11-05 George Orfanides , Tim Hoheisel , Marwa El Halabi

The optimization of submodular functions on the integer lattice has received much attention recently, but the objective functions of many applications are non-submodular. We provide two approximation algorithms for maximizing a…

Data Structures and Algorithms · Computer Science 2018-05-21 Alan Kuhnle , J. David Smith , Victoria G. Crawford , My T. Thai

The subspace selection problem seeks a subspace that maximizes an objective function under some constraint. This problem includes several important machine learning problems such as the principal component analysis and sparse dictionary…

Data Structures and Algorithms · Computer Science 2018-05-22 So Nakashima , Takanori Maehara

We study the problem of maximizing a non-monotone submodular function under multiple knapsack constraints. We propose a simple discrete greedy algorithm to approach this problem, and prove that it yields strong approximation guarantees for…

Machine Learning · Computer Science 2020-02-19 Vanja Doskoč , Tobias Friedrich , Andreas Göbel , Frank Neumann , Aneta Neumann , Francesco Quinzan

Maximizing a submodular function has a wide range of applications in machine learning and data mining. One such application is data summarization whose goal is to select a small set of representative and diverse data items from a large…

Machine Learning · Computer Science 2023-03-10 Jing Yuan , Shaojie Tang

In this paper, we study the problem of \textit{constrained} and \textit{stochastic} continuous submodular maximization. Even though the objective function is not concave (nor convex) and is defined in terms of an expectation, we develop a…

Optimization and Control · Mathematics 2017-11-07 Aryan Mokhtari , Hamed Hassani , Amin Karbasi

Maximizing monotone submodular functions under cardinality constraints is a classic optimization task with several applications in data mining and machine learning. In this paper we study this problem in a dynamic environment with…

Data Structures and Algorithms · Computer Science 2024-05-31 Paul Dütting , Federico Fusco , Silvio Lattanzi , Ashkan Norouzi-Fard , Morteza Zadimoghaddam

As the scales of data sets expand rapidly in some application scenarios, increasing efforts have been made to develop fast submodular maximization algorithms. This paper presents a currently the most efficient algorithm for maximizing…

Data Structures and Algorithms · Computer Science 2018-11-20 Teng Li , Hyo-Sang Shin , Antonios Tsourdos

This paper considers stochastic optimization problems for a large class of objective functions, including convex and continuous submodular. Stochastic proximal gradient methods have been widely used to solve such problems; however, their…

Optimization and Control · Mathematics 2018-11-13 Aryan Mokhtari , Hamed Hassani , Amin Karbasi

Submodular maximization is one of the central topics in combinatorial optimization. It has found numerous applications in the real world. In the past decades, a series of algorithms have been proposed for this problem. However, most of the…

Data Structures and Algorithms · Computer Science 2023-04-03 Xiaoming Sun , Jialin Zhang , Shuo Zhang , Zhijie Zhang

In this paper, we consider the problem of black box continuous submodular maximization where we only have access to the function values and no information about the derivatives is provided. For a monotone and continuous DR-submodular…

Machine Learning · Computer Science 2020-03-03 Lin Chen , Mingrui Zhang , Hamed Hassani , Amin Karbasi

Dynamic Mode Decomposition (DMD) has emerged as a powerful tool for analyzing the dynamics of non-linear systems from experimental datasets. Recently, several attempts have extended DMD to the context of low-rank approximations. This…

Machine Learning · Statistics 2018-05-18 Patrick Héas , Cédric Herzet

Submodular functions and their optimization have found applications in diverse settings ranging from machine learning and data mining to game theory and economics. In this work, we consider the constrained maximization of a submodular…

Data Structures and Algorithms · Computer Science 2025-07-15 Moran Feldman , Alan Kuhnle