English
Related papers

Related papers: Discrete and Continuous Difference of Submodular M…

200 papers

The objective of a two-stage submodular maximization problem is to reduce the ground set using provided training functions that are submodular, with the aim of ensuring that optimizing new objective functions over the reduced ground set…

Data Structures and Algorithms · Computer Science 2023-11-03 Shaojie Tang

We study the complexity of approximate representation and learning of submodular functions over the uniform distribution on the Boolean hypercube $\{0,1\}^n$. Our main result is the following structural theorem: any submodular function is…

Machine Learning · Computer Science 2013-04-03 Vitaly Feldman , Pravesh Kothari , Jan Vondrak

This article explores distributed convex optimization with globally-coupled constraints, where the objective function is a general nonsmooth convex function, the constraints include nonlinear inequalities and affine equalities, and the…

Optimization and Control · Mathematics 2025-03-14 Zixuan Liu , Xuyang Wu , Dandan Wang , Jie Lu

The Douglas-Rachford algorithm (DRA) is a powerful optimization method for minimizing the sum of two convex (not necessarily smooth) functions. The vast majority of previous research dealt with the case when the sum has at least one…

Optimization and Control · Mathematics 2020-07-10 Heinz H. Bauschke , Walaa M. Moursi

Differential computation (DC) is a highly general incremental computation/view maintenance technique that can maintain the output of an arbitrary and possibly recursive dataflow computation upon changes to its base inputs. As such, it is a…

Databases · Computer Science 2022-08-02 Khaled Ammar , Siddhartha Sahu , Semih Salihoglu , M. Tamer Ozsu

The aim of decentralized gradient descent (DGD) is to minimize a sum of $n$ functions held by interconnected agents. We study the stability of DGD in open contexts where agents can join or leave the system, resulting each time in the…

Optimization and Control · Mathematics 2020-09-14 Julien M. Hendrickx , Michael G. Rabbat

We consider mesh functions which are discrete convex in the sense that their central second order directional derivatives are positive. Analogous to the case of a uniformly bounded sequence of convex functions, we prove that the uniform…

Numerical Analysis · Mathematics 2019-11-01 Gerard Awanou

Dataset condensation (DC) learns a compact synthetic dataset that enables models to match the performance of full-data training, prioritising utility over distributional fidelity. While typically explored for computational efficiency, DC…

We introduce several generalizations of classical computer science problems obtained by replacing simpler objective functions with general submodular functions. The new problems include submodular load balancing, which generalizes load…

Data Structures and Algorithms · Computer Science 2010-06-02 Zoya Svitkina , Lisa Fleischer

Submodular functions and their optimization have found applications in diverse settings ranging from machine learning and data mining to game theory and economics. In this work, we consider the constrained maximization of a submodular…

Data Structures and Algorithms · Computer Science 2025-07-15 Moran Feldman , Alan Kuhnle

In this paper, we propose a novel Dual Inexact Splitting Algorithm (DISA) for distributed convex composite optimization problems, where the local loss function consists of a smooth term and a possibly nonsmooth term composed with a linear…

Optimization and Control · Mathematics 2023-04-25 Luyao Guo , Xinli Shi , Shaofu Yang , Jinde Cao

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with ordering constraints…

Machine Learning · Computer Science 2017-07-31 Francis Bach

In this paper we develop general formulas for the subdifferential of the pointwise supremum of convex functions, which cover and unify both the compact continuous and the non-compact non-continuous settings. From the non-continuous to the…

Optimization and Control · Mathematics 2020-04-03 Rafael Correa , Abderrahim Hantoute , Marco Antonio López

Objective: Overlapping measures are often utilized to quantify the similarity between two binary regions. However, modern segmentation algorithms output a probability or confidence map with continuous values in the zero-to-one interval.…

Computer Vision and Pattern Recognition · Computer Science 2019-06-27 Reuben R Shamir , Yuval Duchin , Jinyoung Kim , Guillermo Sapiro , Noam Harel

We consider the problem of minimizing the sum of submodular set functions assuming minimization oracles of each summand function. Most existing approaches reformulate the problem as the convex minimization of the sum of the corresponding…

Machine Learning · Computer Science 2019-05-28 K S Sesh Kumar , Francis Bach , Thomas Pock

This paper studies the cosine as basis function for the approximation of univariate and continuous functions without memory. This work studies a supervised learning to obtain the approximation coefficients, instead of using the Discrete…

Signal Processing · Electrical Eng. & Systems 2024-05-28 Ana I. Pérez-Neira , Marc Martinez-Gost , Miguel Ángel Lagunas

In this work, we propose some new Douglas-Rashford splitting algorithms for solving a class of generalized DC (difference of convex functions) in real Hilbert spaces. The proposed methods leverage the proximal properties of the nonsmooth…

Optimization and Control · Mathematics 2024-04-24 Yonghong Yao , Lateef O. Jolaoso , Yekini Shehu , Jen-Chih Yao

We propose an algorithm for optimizing the parameters of single hidden layer neural networks. Specifically, we derive a blockwise difference-of-convex (DC) functions representation of the objective function. Based on the latter, we propose…

Machine Learning · Computer Science 2024-01-17 Daniel Tschernutter , Mathias Kraus , Stefan Feuerriegel

We propose a novel decomposition framework for the distributed optimization of Difference Convex (DC)-type nonseparable sum-utility functions subject to coupling convex constraints. A major contribution of the paper is to develop for the…

Information Theory · Computer Science 2013-09-23 Alberth Alvarado , Gesualdo Scutari , Jong-Shi Pang

Submodular set functions are undoubtedly among the most important building blocks of combinatorial optimization. Somewhat surprisingly, continuous counterparts of such functions have also appeared in an analytic line of research where they…

Combinatorics · Mathematics 2024-06-10 Kristóf Bérczi , Boglárka Gehér , András Imolay , László Lovász , Tamás Schwarcz