English
Related papers

Related papers: Submodular Functions: Extensions, Distributions, a…

200 papers

We propose a general method for optimization with semi-infinite constraints that involve a linear combination of functions, focusing on the case of the exponential function. Each function is lower and upper bounded on sub-intervals by…

Optimization and Control · Mathematics 2014-01-13 Bogdan Dumitrescu , Bogdan C. Sicleru , Florin Avram

We extend the work of Narasimhan and Bilmes [30] for minimizing set functions representable as a dierence between submodular functions. Similar to [30], our new algorithms are guaranteed to monotonically reduce the objective function at…

Machine Learning · Computer Science 2014-08-12 Rishabh Iyer , Jeff A. Bilmes

$k$-submodular functions, introduced by Huber and Kolmogorov, are functions defined on $\{0, 1, 2, \dots, k\}^n$ satisfying certain submodular-type inequalities. $k$-submodular functions typically arise as relaxations of NP-hard problems,…

Optimization and Control · Mathematics 2016-09-12 Hiroshi Hirai , Yuni Iwamasa

In this note we provide a full conjugacy and subdifferential calculus for convex convex-composite functions in finite-dimensional space. Our approach, based on infimal convolution and cone-convexity, is straightforward and yields the…

Optimization and Control · Mathematics 2019-08-22 James V. Burke , Tim Hoheisel , Quang V. Nguyen

Optimization algorithms can be interpreted through the lens of dynamical systems as the interconnection of linear systems and a set of subgradient nonlinearities. This dynamical systems formulation allows for the analysis and synthesis of…

Optimization and Control · Mathematics 2026-03-27 Jared Miller , Carsten Scherer , Fabian Jakob , Andrea Iannelli

The subspace selection problem seeks a subspace that maximizes an objective function under some constraint. This problem includes several important machine learning problems such as the principal component analysis and sparse dictionary…

Data Structures and Algorithms · Computer Science 2018-05-22 So Nakashima , Takanori Maehara

Inspired by regularization techniques in statistics and machine learning, we study complementary composite minimization in the stochastic setting. This problem corresponds to the minimization of the sum of a (weakly) smooth function endowed…

Machine Learning · Computer Science 2024-01-24 Alexandre d'Aspremont , Cristóbal Guzmán , Clément Lezane

Submodular maximization constitutes a prominent research topic in combinatorial optimization and theoretical computer science, with extensive applications across diverse domains. While substantial advancements have been achieved in…

Data Structures and Algorithms · Computer Science 2026-03-17 Shengminjie Chen , Yiwei Gao , Kaifeng Lin , Xiaoming Sun , Jialin Zhang

There are many problems in machine learning and data mining which are equivalent to selecting a non-redundant, high "quality" set of objects. Recommender systems, feature selection, and data summarization are among many applications of…

Machine Learning · Computer Science 2019-04-19 Mehrdad Ghadiri , Mark Schmidt

We study a stochastic variant of monotone submodular maximization problem as follows. We are given a monotone submodular function as an objective function and a feasible domain defined on a finite set, and our goal is to find a feasible…

Data Structures and Algorithms · Computer Science 2020-06-29 Takanori Maehara , Yutaro Yamaguchi

Composite minimization is a powerful framework in large-scale convex optimization, based on decoupling of the objective function into terms with structurally different properties and allowing for more flexible algorithmic design. We…

Optimization and Control · Mathematics 2023-02-17 Jelena Diakonikolas , Cristóbal Guzmán

Real continuous submodular functions, as a generalization of the corresponding discrete notion to the continuous domain, gained considerable attention recently. The analog notion for entropy functions requires additional properties: a real…

Optimization and Control · Mathematics 2021-02-12 Laszlo Csirmaz

The simplex algorithm for linear programming is based on the fact that any local optimum with respect to the polyhedral neighborhood is also a global optimum. We show that a similar result carries over to submodular maximization. In…

Data Structures and Algorithms · Computer Science 2017-12-01 Simon Bruggmann , Rico Zenklusen

Constrained submodular set function maximization problems often appear in multi-agent decision-making problems with a discrete feasible set. A prominent example is the problem of multi-agent mobile sensor placement over a discrete domain.…

Optimization and Control · Mathematics 2020-12-01 Navid Rezazadeh , Solmaz S. Kia

Submodular maximization under matroid and cardinality constraints are classical problems with a wide range of applications in machine learning, auction theory, and combinatorial optimization. In this paper, we consider these problems in the…

Data Structures and Algorithms · Computer Science 2023-12-27 Kiarash Banihashem , Leyla Biabani , Samira Goudarzi , MohammadTaghi Hajiaghayi , Peyman Jabbarzade , Morteza Monemizadeh

We consider minimization problems with bisubmodular objective functions. We propose valid inequalities, namely the poly-bimatroid inequalities, and provide a complete linear description of the convex hull of the epigraph of a bisubmodular…

Optimization and Control · Mathematics 2020-09-30 Qimeng Yu , Simge Kucukyavuz

In machine learning and big data, the optimization objectives based on set-cover, entropy, diversity, influence, feature selection, etc. are commonly modeled as submodular functions. Submodular (function) maximization is generally NP-hard,…

Data Structures and Algorithms · Computer Science 2022-12-13 Haotian Zhang , Rao Li , Zewei Wu , Guodong Sun

A popular approach in combinatorial optimization is to model problems as integer linear programs. Ideally, the relaxed linear program would have only integer solutions, which happens for instance when the constraint matrix is totally…

Data Structures and Algorithms · Computer Science 2009-09-29 Christoph Durr , Mathilde Hurand

Continuous DR-submodular functions are a class of functions that satisfy the Diminishing Returns (DR) property, which implies that they are concave along non-negative directions. Existing works have studied monotone continuous DR-submodular…

Machine Learning · Computer Science 2022-05-31 Omid Sadeghi , Maryam Fazel

We consider the problem of minimizing a function represented as a sum of submodular terms. We assume each term allows an efficient computation of {\em exchange capacities}. This holds, for example, for terms depending on a small number of…

Data Structures and Algorithms · Computer Science 2012-06-12 Vladimir Kolmogorov