English
Related papers

Related papers: Bregman Monotone Operator Splitting

200 papers

We develop a fast and reliable method for solving large-scale optimal transport (OT) problems at an unprecedented combination of speed and accuracy. Built on the celebrated Douglas-Rachford splitting technique, our method tackles the…

Optimization and Control · Mathematics 2021-10-25 Vien V. Mai , Jacob Lindbäck , Mikael Johansson

We investigate frugal splitting operators for finite sum monotone inclusion problems. These operators utilize exactly one direct or resolvent evaluation of each operator of the sum, and the splitting operator's output is dictated by linear…

Optimization and Control · Mathematics 2023-10-02 Martin Morin , Sebastian Banert , Pontus Giselsson

Monotone inclusions have a wide range of applications, including minimization, saddle-point, and equilibria problems. We introduce new stochastic algorithms, with or without variance reduction, to estimate a root of the expectation of…

Optimization and Control · Mathematics 2024-05-24 Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

In this paper, we provide different splitting methods for solving distributionally robust optimization problems in cases where the uncertainties are described by discrete distributions. The first method involves computing the proximity…

Optimization and Control · Mathematics 2024-10-30 Luis Briceño-Arias , Sergio López-Rivera , Emilio Vilches

Recent work has shown a variety of ways in which machine learning can be used to accelerate the solution of constrained optimization problems. Increasing demand for real-time decision-making capabilities in applications such as artificial…

Machine Learning · Computer Science 2024-04-02 Ethan King , James Kotary , Ferdinando Fioretto , Jan Drgona

When minimizing a multiobjective optimization problem (MOP) using multiobjective gradient descent methods, the imbalances among objective functions often decelerate the convergence. In response to this challenge, we propose two types of the…

Optimization and Control · Mathematics 2023-08-10 Jian Chen , Liping Tang , Xinmin Yang

In this paper we propose two different primal-dual splitting algorithms for solving inclusions involving mixtures of composite and parallel-sum type monotone operators which rely on an inexact Douglas-Rachford splitting method, however…

Optimization and Control · Mathematics 2012-12-04 Radu Ioan Bot , Christopher Hendrich

Many statistical learning problems can be posed as minimization of a sum of two convex functions, one typically a composition of non-smooth and linear functions. Examples include regression under structured sparsity assumptions. Popular…

Machine Learning · Statistics 2021-07-19 Seyoon Ko , Donghyeon Yu , Joong-Ho Won

We introduce a generalization of the linearized Alternating Direction Method of Multipliers to optimize a real-valued function $f$ of multiple arguments with potentially multiple constraints $g_\circ$ on each of them. The function $f$ may…

Optimization and Control · Mathematics 2019-01-28 Fred Moolekamp , Peter Melchior

We propose a novel algorithmic framework of Variable Metric Over-Relaxed Hybrid Proximal Extra-gradient (VMOR-HPE) method with a global convergence guarantee for the maximal monotone operator inclusion problem. Its iteration complexities…

Optimization and Control · Mathematics 2019-06-03 Li Shen , Peng Sun , Yitong Wang , Wei Liu , Tong Zhang

The Multi-Objective Shortest-Path (MOS) problem finds a set of Pareto-optimal solutions from a start node to a destination node in a multi-attribute graph. The literature explores multi-objective A*-style algorithmic approaches to solving…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-04-16 Leo Gold , Adam Bienkowski , David Sidoti , Krishna Pattipati , Omer Khan

In this paper, a convex optimization-based method is proposed for numerically solving dynamic programs in continuous state and action spaces. The key idea is to approximate the output of the Bellman operator at a particular state by the…

Optimization and Control · Mathematics 2020-10-23 Insoon Yang

Bregman divergences play a central role in the design and analysis of a range of machine learning algorithms. This paper explores the use of Bregman divergences to establish reductions between such algorithms and their analyses. We present…

Machine Learning · Computer Science 2016-07-04 Richard Nock , Aditya Krishna Menon , Cheng Soon Ong

This paper proposes an accelerated proximal point method for maximally monotone operators. The proof is computer-assisted via the performance estimation problem approach. The proximal point method includes various well-known convex…

Optimization and Control · Mathematics 2021-03-25 Donghwan Kim

Frugal resolvent splittings are a class of fixed point algorithms for finding a zero in the sum of the sum of finitely many set-valued monotone operators, where the fixed point operator uses only vector addition, scalar multiplication and…

Optimization and Control · Mathematics 2023-06-06 Matthew K. Tam

We consider the problem of covariance matrix estimation in the presence of latent variables. Under suitable conditions, it is possible to learn the marginal covariance matrix of the observed variables via a tractable convex program, where…

Machine Learning · Statistics 2011-10-17 Gui-Bo Ye , Yuanfeng Wang , Yifei Chen , Xiaohui Xie

In this paper we provide an algorithm for solving constrained composite primal-dual monotone inclusions, i.e., monotone inclusions in which a priori information on primal-dual solutions is represented via closed convex sets. The proposed…

Optimization and Control · Mathematics 2018-05-31 Luis Briceño-Arias , Sergio López Rivera

In this paper, we address variational inequalities (VI) with a finite-sum structure. We introduce a novel single-loop stochastic variance-reduced algorithm, incorporating the Bregman distance function, and establish an optimal convergence…

Optimization and Control · Mathematics 2025-07-22 Zeinab Alizadeh , Erfan Yazdandoost Hamedani , Afrooz Jalilzadeh

Mobile edge computing (MEC) can enhance the computing capability of mobile devices, and non-orthogonal multiple access (NOMA) can provide high data rates. Combining these two technologies can effectively benefit the network with spectrum…

Information Theory · Computer Science 2019-04-30 Fang Fang , Yanqing Xu , Zhiguo Ding , Chao Shen , Mugen Peng , George K. Karagiannidis

In this work, we address a class of nonconvex nonsmooth optimization problems where the objective function is the sum of two smooth functions (one of which is proximable) and two nonsmooth functions (one proper, closed and proximable, and…

Optimization and Control · Mathematics 2025-03-26 Jan Harold Alcantara , Ching-pei Lee , Akiko Takeda