English
Related papers

Related papers: Polyhedral aspects of Submodularity, Convexity and…

200 papers

We extend the work of Narasimhan and Bilmes [30] for minimizing set functions representable as a dierence between submodular functions. Similar to [30], our new algorithms are guaranteed to monotonically reduce the objective function at…

Machine Learning · Computer Science 2014-08-12 Rishabh Iyer , Jeff A. Bilmes

In this paper, we consider a class of constrained multiobjective optimization problems, where each objective function can be expressed by adding a possibly nonsmooth nonconvex function and a differentiable function with Lipschitz continuous…

Optimization and Control · Mathematics 2026-01-01 Nguyen Van Tuyen , Minh N. Dao , Tran Van Nghi

Assume that f is a strict convex function with a unique minimum in R^n. We divide the vector of n-variables to d groups of vector subvariables with d at least two. We assume that we can find the partial minimum of f with respect to each…

Optimization and Control · Mathematics 2019-06-06 Shmuel Friedland

Submodular width is a central structural measure governing the complexity of conjunctive query evaluation. In this paper we recast submodular width in geometric terms. We how that submodular width can be approximated, up to a factor $3/2$,…

Data Structures and Algorithms · Computer Science 2026-04-27 Matthias Lanzinger

In this manuscript, we offer a gentle review of submodularity and supermodularity and their properties. We offer a plethora of submodular definitions; a full description of a number of example submodular functions and their generalizations;…

Machine Learning · Computer Science 2022-10-05 Jeff Bilmes

Level proximal subdifferential was introduced by Rockafellar recently for studying proximal mappings of possibly nonconvex functions. In this paper a systematic study of level proximal subdifferential is given. We characterize variational…

Optimization and Control · Mathematics 2026-04-22 Honglin Luo , Xianfu Wang , Ziyuan Wang , Xinmin Yang

We provide new insight into a {\em generalized conditional subgradient} algorithm and a {\em generalized mirror descent} algorithm for the convex minimization problem \[ \min_x \; \{f(Ax) + h(x)\}.\] As Bach showed in [{\em SIAM J. Optim.},…

Optimization and Control · Mathematics 2019-06-04 Javier Pena

For a function defined on a convex set in a Euclidean space, midpoint convexity is the property requiring that the value of the function at the midpoint of any line segment is not greater than the average of its values at the endpoints of…

Metric Geometry · Mathematics 2019-05-20 Satoko Moriguchi , Kazuo Murota , Akihisa Tamura , Fabio Tardella

A function is exponentially concave if its exponential is concave. We consider exponentially concave functions on the unit simplex. In a previous paper we showed that gradient maps of exponentially concave functions provide solutions to a…

Probability · Mathematics 2017-06-01 Soumik Pal , Ting-Kam Leonard Wong

For a real-valued non-negative and log-concave function we introduce a notion of difference function; the difference function represents a functional analog on the difference body of a convex body. We prove a sharp inequality which bounds…

Metric Geometry · Mathematics 2007-05-23 Andrea Colesanti

In this paper, we present an algorithm for minimizing the difference between two submodular functions using a variational framework which is based on (an extension of) the concave-convex procedure [17]. Because several commonly used metrics…

Machine Learning · Computer Science 2012-07-09 Mukund Narasimhan , Jeff A. Bilmes

Subset selection tasks, arise in recommendation systems and search engines and ask to select a subset of items that maximize the value for the user. The values of subsets often display diminishing returns, and hence, submodular functions…

Machine Learning · Computer Science 2023-05-05 Anay Mehrotra , Nisheeth K. Vishnoi

The MaxCut SDP is one of the most well-known semidefinite programs, and it has many favorable properties. One of its nicest geometric/duality properties is the fact that the vertices of its feasible region correspond exactly to the cuts of…

Optimization and Control · Mathematics 2018-06-05 Marcel K. de Carli Silva , Levent Tunçel

In model selection problems for machine learning, the desire for a well-performing model with meaningful structure is typically expressed through a regularized optimization problem. In many scenarios, however, the meaningful structure is…

Optimization and Control · Mathematics 2022-11-09 Jonathan Bunton , Paulo Tabuada

A subequation on an open subset $X\subset \mathbb R^n$ is a subset $F$ of the space of $2$-jets on $X$ with certain properties. A smooth function is said to be $F$-subharmonic if all of its $2$-jets lie in $F$, and using the viscosity…

Analysis of PDEs · Mathematics 2021-05-13 Julius Ross , David Witt Nyström

We provide a simple proof for the Fenchel duality between strong convexity and Lipschitz continuous gradient. To this end, we first establish equivalent conditions of convexity for a general function that may not be differentiable. By…

Optimization and Control · Mathematics 2018-03-20 Xingyu Zhou

We consider a class of sparsity-inducing regularization terms based on submodular functions. While previous work has focused on non-decreasing functions, we explore symmetric submodular functions and their \lova extensions. We show that the…

Machine Learning · Computer Science 2011-06-13 Francis Bach

Sparse methods for supervised learning aim at finding good linear predictors from as few variables as possible, i.e., with small cardinality of their supports. This combinatorial selection problem is often turned into a convex optimization…

Machine Learning · Computer Science 2010-11-15 Francis Bach

For a matrix $W \in \mathbb{Z}^{m \times n}$, $m \leq n$, and a convex function $g: \mathbb{R}^m \rightarrow \mathbb{R}$, we are interested in minimizing $f(x) = g(Wx)$ over the set $\{0,1\}^n$. We will study separable convex functions and…

Optimization and Control · Mathematics 2022-08-18 Christoph Hunkenschröder , Sebastian Pokutta , Robert Weismantel

Submodular maximization generalizes many fundamental problems in discrete optimization, including Max-Cut in directed/undirected graphs, maximum coverage, maximum facility location and marketing over social networks. In this paper we…

Data Structures and Algorithms · Computer Science 2011-01-18 Ariel Kulik , Hadas Shachnai , Tami Tamir