English
Related papers

Related papers: Learning and Optimization with Submodular Function…

200 papers

Robust optimization is becoming increasingly important in machine learning applications. In this paper, we study a unified framework of robust submodular optimization. We study this problem both from a minimization and maximization…

Machine Learning · Computer Science 2021-03-22 Rishabh Iyer

We consider the problem of maximizing a monotone nondecreasing set function under multiple constraints, where the constraints are also characterized by monotone nondecreasing set functions. We propose two greedy algorithms to solve the…

Optimization and Control · Mathematics 2023-05-09 Lintao Ye , Zhi-Wei Liu , Ming Chi , Vijay Gupta

We consider a class of sparsity-inducing regularization terms based on submodular functions. While previous work has focused on non-decreasing functions, we explore symmetric submodular functions and their \lova extensions. We show that the…

Machine Learning · Computer Science 2011-06-13 Francis Bach

We extend the work of Narasimhan and Bilmes [30] for minimizing set functions representable as a difference between submodular functions. Similar to [30], our new algorithms are guaranteed to monotonically reduce the objective function at…

Data Structures and Algorithms · Computer Science 2013-08-27 Rishabh Iyer , Jeff Bilmes

This work explores the novel idea of learning a submodular scoring function to improve the specificity/selectivity of existing feature attribution methods. Submodular scores are natural for attribution as they are known to accurately model…

Machine Learning · Computer Science 2022-02-23 Piyushi Manupriya , Tarun Ram Menta , J. Saketha Nath , Vineeth N Balasubramanian

Symmetric submodular functions are an important family of submodular functions capturing many interesting cases including cut functions of graphs and hypergraphs. Maximization of such functions subject to various constraints receives little…

Data Structures and Algorithms · Computer Science 2016-04-19 Moran Feldman

Submodular function maximization has been studied extensively in recent years under various constraints and models. The problem plays a major role in various disciplines. We study a natural online variant of this problem in which elements…

Data Structures and Algorithms · Computer Science 2015-01-26 Niv Buchbinder , Moran Feldman , Roy Schwartz

We develop a framework for the distributed minimization of submodular functions. Submodular functions are a discrete analog of convex functions and are extensively used in large-scale combinatorial optimization problems. While there has…

Optimization and Control · Mathematics 2018-01-23 Hassan Jaleel , Jeff Shamma

Many sequential decision making problems can be formulated as an adaptive submodular maximization problem. However, most of existing studies in this field focus on pool-based setting, where one can pick items in any order, and there have…

Artificial Intelligence · Computer Science 2022-08-18 Shaojie Tang , Jing Yuan

Optimization problems often involve vector norms, which has led to extensive research on developing algorithms that can handle objectives beyond the $\ell_p$ norms. Our work introduces the concept of submodular norms, which are a versatile…

Data Structures and Algorithms · Computer Science 2023-10-10 Kalen Patton , Matteo Russo , Sahil Singla

We demonstrate the usefulness of submodularity in statistics as a characterization of the difficulty of the \emph{search} problem of feature selection. The search problem is the ability of a procedure to identify an informative set of…

Statistics Theory · Mathematics 2016-05-16 Kory D. Johnson , Robert A. Stine , Dean P. Foster

Submodular function maximization has found a wealth of new applications in machine learning models during the past years. The related supermodular maximization models (submodular minimization) also offer an abundance of applications, but…

Data Structures and Algorithms · Computer Science 2020-06-25 Mehrdad Ghadiri , Richard Santiago , Bruce Shepherd

Submodularity is a key property in discrete optimization. Submodularity has been widely used for analyzing the greedy algorithm to give performance bounds and providing insight into the construction of valid inequalities for mixed-integer…

Optimization and Control · Mathematics 2022-05-24 Temitayo Ajayi , Taewoo Lee , Andrew Schaefer

In Constraint Programming, constraints are usually represented as predicates allowing or forbidding combinations of values. However, some algorithms exploit a finer representation: error functions. Their usage comes with a price though: it…

Artificial Intelligence · Computer Science 2023-03-09 Florian Richoux , Jean-François Baffier

Submodular functions are at the core of many machine learning and data mining tasks. The underlying submodular functions for many of these tasks are decomposable, i.e., they are sum of several simple submodular functions. In many data…

Data Structures and Algorithms · Computer Science 2022-01-20 Akbar Rafiey , Yuichi Yoshida

Statistical decision problems lie at the heart of statistical machine learning. The simplest problems are binary and multiclass classification and class probability estimation. Central to their definition is the choice of loss function,…

Machine Learning · Computer Science 2023-08-21 Robert C. Williamson , Zac Cranko

Many prediction domains, such as ad placement, recommendation, trajectory prediction, and document summarization, require predicting a set or list of options. Such lists are often evaluated using submodular reward functions that measure…

Machine Learning · Computer Science 2013-05-14 Stephane Ross , Jiaji Zhou , Yisong Yue , Debadeepta Dey , J. Andrew Bagnell

Recent developments in set optimization are surveyed and extended including various set relations as well as fundamental constructions of a convex analysis for set- and vector-valued functions, and duality for set optimization problems.…

Optimization and Control · Mathematics 2024-01-26 Andreas H. Hamel , Frank Heyde , Andreas Löhne , Birgit Rudloff , Carola Schrage

Training a Neural Network (NN) with lots of parameters or intricate architectures creates undesired phenomena that complicate the optimization process. To address this issue we propose a first modular approach to NN design, wherein the NN…

Machine Learning · Computer Science 2019-02-26 David Castillo-Bolado , Cayetano Guerra-Artal , Mario Hernandez-Tejera

In this paper, vector optimization is considered in the framework of decision making and optimization in general spaces. Interdependencies between domination structures in decision making and domination sets in vector optimization are…

Optimization and Control · Mathematics 2017-12-06 Petra Weidner