English
Related papers

Related papers: On Unconstrained Quasi-Submodular Function Optimiz…

200 papers

We consider the problem of maximizing non-negative non-decreasing set functions. Although most of the recent work focus on exploiting submodularity, it turns out that several objectives we encounter in practice are not submodular.…

Data Structures and Algorithms · Computer Science 2018-06-19 Gaurav Gupta , Sergio Pequito , Paul Bogdan

DR-submodular continuous functions are important objectives with wide real-world applications spanning MAP inference in determinantal point processes (DPPs), and mean-field inference for probabilistic submodular models, amongst others.…

Machine Learning · Computer Science 2019-05-27 An Bian , Kfir Y. Levy , Andreas Krause , Joachim M. Buhmann

Quasi-convex optimization acts a pivotal part in many fields including economics and finance; the subgradient method is an effective iterative algorithm for solving large-scale quasi-convex optimization problems. In this paper, we…

Optimization and Control · Mathematics 2019-10-25 Yaohua Hu , Jiawen Li , Carisa Kwok Wai Yu

In machine learning and big data, the optimization objectives based on set-cover, entropy, diversity, influence, feature selection, etc. are commonly modeled as submodular functions. Submodular (function) maximization is generally NP-hard,…

Data Structures and Algorithms · Computer Science 2022-12-13 Haotian Zhang , Rao Li , Zewei Wu , Guodong Sun

The problem of maximizing nonnegative monotone submodular functions under a certain constraint has been intensively studied in the last decade, and a wide range of efficient approximation algorithms have been developed for this problem.…

Data Structures and Algorithms · Computer Science 2020-06-30 Akbar Rafiey , Yuichi Yoshida

Stochastic optimization of continuous objectives is at the heart of modern machine learning. However, many important problems are of discrete nature and often involve submodular objectives. We seek to unleash the power of stochastic…

Machine Learning · Computer Science 2017-11-07 Mohammad Reza Karimi , Mario Lucic , Hamed Hassani , Andreas Krause

Many large-scale machine learning problems--clustering, non-parametric learning, kernel machines, etc.--require selecting a small yet representative subset from a large dataset. Such problems can often be reduced to maximizing a submodular…

Machine Learning · Computer Science 2016-06-28 Baharan Mirzasoleiman , Amin Karbasi , Rik Sarkar , Andreas Krause

Maximizing monotone submodular functions under a matroid constraint is a classic algorithmic problem with multiple applications in data mining and machine learning. We study this classic problem in the fully dynamic setting, where elements…

Data Structures and Algorithms · Computer Science 2025-05-26 Paul Dütting , Federico Fusco , Silvio Lattanzi , Ashkan Norouzi-Fard , Morteza Zadimoghaddam

Submodular function minimization is a key problem in a wide variety of applications in machine learning, economics, game theory, computer vision, and many others. The general solver has a complexity of $O(n^3 \log^2 n . E +n^4 {\log}^{O(1)}…

Data Structures and Algorithms · Computer Science 2017-01-25 Srikumar Ramalingam , Chris Russell , Lubor Ladicky , Philip H. S. Torr

We define a new class of set functions that in addition to being monotone and subadditive, also admit a very limited form of submodularity defined over a permutation of the ground set. We refer to this permutation as a submodular order.…

Optimization and Control · Mathematics 2024-03-01 Rajan Udwani

Maximizing a submodular function has a wide range of applications in machine learning and data mining. One such application is data summarization whose goal is to select a small set of representative and diverse data items from a large…

Machine Learning · Computer Science 2023-03-10 Jing Yuan , Shaojie Tang

A function $f: \mathbb{Z}_+^E \rightarrow \mathbb{R}_+$ is DR-submodular if it satisfies $f({\bf x} + \chi_i) -f ({\bf x}) \ge f({\bf y} + \chi_i) - f({\bf y})$ for all ${\bf x}\le {\bf y}, i\in E$. Recently, the problem of maximizing a…

Data Structures and Algorithms · Computer Science 2018-05-29 Alina Ene , Huy L. Nguyen

This paper considers the minimization of a general objective function $f(X)$ over the set of rectangular $n\times m$ matrices that have rank at most $r$. To reduce the computational burden, we factorize the variable $X$ into a product of…

Information Theory · Computer Science 2018-07-04 Zhihui Zhu , Qiuwei Li , Gongguo Tang , Michael B. Wakin

We show that there is a largely unexplored class of functions (positive polymatroids) that can define proper discrete metrics over pairs of binary vectors and that are fairly tractable to optimize over. By exploiting submodularity, we are…

Data Structures and Algorithms · Computer Science 2015-11-09 Jennifer Gillenwater , Rishabh Iyer , Bethany Lusch , Rahul Kidambi , Jeff Bilmes

We present an efficient algorithm to find non-empty minimizers of a symmetric submodular function over any family of sets closed under inclusion. This for example includes families defined by a cardinality constraint, a knapsack constraint,…

Data Structures and Algorithms · Computer Science 2013-10-08 Michel X. Goemans , José A. Soto

Submodular functions, as well as the sub-class of decomposable submodular functions, and their optimization appear in a wide range of applications in machine learning, recommendation systems, and welfare maximization. However, optimization…

Data Structures and Algorithms · Computer Science 2024-06-04 Akbar Rafiey

We present a lattice algorithm specifically designed for some classical applications of lattice reduction. The applications are for lattice bases with a generalized knapsack-type structure, where the target vectors are boundably short. For…

Symbolic Computation · Computer Science 2010-02-04 Mark Van Hoeij , Andrew Novocin

Submodular optimization plays a key role in many real-world problems. In many real-world scenarios, it is also necessary to handle uncertainty, and potentially disruptive events that violate constraints in stochastic settings need to be…

Machine Learning · Computer Science 2019-11-27 Benjamin Doerr , Carola Doerr , Aneta Neumann , Frank Neumann , Andrew M. Sutton

A variety of large-scale machine learning problems can be cast as instances of constrained submodular maximization. Existing approaches for distributed submodular maximization have a critical drawback: The capacity - number of instances…

Machine Learning · Statistics 2016-06-01 Mario Lucic , Olivier Bachem , Morteza Zadimoghaddam , Andreas Krause

Submodular maximization subject to matroid constraints is a central problem with many applications in machine learning. As algorithms are increasingly used in decision-making over datapoints with sensitive attributes such as gender or race,…

Data Structures and Algorithms · Computer Science 2026-01-16 Sepideh Mahabadi , Sherry Sarkar , Jakub Tarnawski