English
Related papers

Related papers: Linear convergence of the generalized PPA and seve…

200 papers

We give a number of approximation metatheorems for monotone maximization problems expressible in the first-order logic, in substantially more general settings than the previously known. We obtain * constant-factor approximation algorithm in…

Discrete Mathematics · Computer Science 2021-10-12 Zdeněk Dvořák

With the unprecedented growth of signal processing and machine learning application domains, there has been a tremendous expansion of interest in distributed optimization methods to cope with the underlying large-scale problems.…

Optimization and Control · Mathematics 2022-10-25 Hansi Abeynanda , Chathuranga Weeraddana , G. H. J. Lanel , Carlo Fischione

Many statistical learning problems can be posed as minimization of a sum of two convex functions, one typically a composition of non-smooth and linear functions. Examples include regression under structured sparsity assumptions. Popular…

Machine Learning · Statistics 2021-07-19 Seyoon Ko , Donghyeon Yu , Joong-Ho Won

Operator splitting schemes have been successfully used in computational sciences to reduce complex problems into a series of simpler subproblems. Since 1950s, these schemes have been widely used to solve problems in PDE and control.…

Optimization and Control · Mathematics 2015-04-07 Damek Davis , Wotao Yin

A new stochastic primal--dual algorithm for solving a composite optimization problem is proposed. It is assumed that all the functions/operators that enter the optimization problem are given as statistical expectations. These expectations…

Optimization and Control · Mathematics 2020-06-23 Pascal Bianchi , Walid Hachem , Adil Salim

In this paper, we develop a new type of accelerated algorithms to solve some classes of maximally monotone equations as well as monotone inclusions. Instead of using Nesterov's accelerating approach, our methods rely on a so-called…

Optimization and Control · Mathematics 2021-12-08 Quoc Tran-Dinh , Yang Luo

We consider the monotone inclusion problem with a sum of 3 operators, in which 2 are monotone and 1 is monotone-Lipschitz. The classical Douglas--Rachford and Forward-backward-forward methods respectively solve the monotone inclusion…

Optimization and Control · Mathematics 2019-10-17 Ernest K. Ryu , Bang Cong Vu

We introduce and analyze an algorithm for the minimization of convex functions that are the sum of differentiable terms and proximable terms composed with linear operators. The method builds upon the recently developed smoothed gap…

Optimization and Control · Mathematics 2017-06-20 Quang Van Nguyen , Olivier Fercoq , Volkan Cevher

Spingarn's method of partial inverses and the progressive decoupling algorithm address inclusion problems involving the sum of an operator and the normal cone of a linear subspace, known as linkage problems. Despite their success, existing…

Optimization and Control · Mathematics 2025-04-02 Brecht Evens , Puya Latafat , Panagiotis Patrinos

Operator splitting techniques have recently gained popularity in convex optimization problems arising in various control fields. Being fixed-point iterations of nonexpansive operators, such methods suffer many well known downsides, which…

Optimization and Control · Mathematics 2020-04-01 Andreas Themelis , Panagiotis Patrinos

We propose a new class of primal-dual Fejer monotone algorithms for solving systems of com- posite monotone inclusions. Our construction is inspired by a framework used by Eckstein and Svaiter for the basic problem of finding a zero of the…

Optimization and Control · Mathematics 2014-10-07 Abdullah Alotaibi , Patrick L. Combettes , N. Shahzad

In this work, we propose some new Douglas-Rashford splitting algorithms for solving a class of generalized DC (difference of convex functions) in real Hilbert spaces. The proposed methods leverage the proximal properties of the nonsmooth…

Optimization and Control · Mathematics 2024-04-24 Yonghong Yao , Lateef O. Jolaoso , Yekini Shehu , Jen-Chih Yao

In this paper, we propose several graph-based extensions of the Douglas-Rachford splitting (DRS) method to solve monotone inclusion problems involving the sum of $N$ maximal monotone operators. Our construction is based on a two-layer…

Optimization and Control · Mathematics 2022-11-10 Kristian Bredies , Enis Chenchene , Emanuele Naldi

In this paper, we provide different splitting methods for solving distributionally robust optimization problems in cases where the uncertainties are described by discrete distributions. The first method involves computing the proximity…

Optimization and Control · Mathematics 2024-10-30 Luis Briceño-Arias , Sergio López-Rivera , Emilio Vilches

The three operator splitting scheme was recently proposed by [Davis and Yin, 2015] as a method to optimize composite objective functions with one convex smooth term and two convex (possibly non-smooth) terms for which we have access to…

Machine Learning · Statistics 2021-06-29 Fabian Pedregosa

The article is devoted to the development of numerical methods for solving saddle point problems and variational inequalities with simplified requirements for the smoothness conditions of functionals. Recently there were proposed some…

Optimization and Control · Mathematics 2023-11-22 Alexander Titov , Fedor Stonyakin , Mohammad Alkousa , Alexander Gasnikov

We propose and analyze the convergence of a novel stochastic forward-backward splitting algorithm for solving monotone inclusions given by the sum of a maximal monotone operator and a single-valued maximal monotone cocoercive operator. This…

Optimization and Control · Mathematics 2015-02-23 Lorenzo Rosasco , Silvia Villa , Bang Công Vũ

The Douglas-Rachford splitting algorithm is a classical optimization method that has found many applications. When specialized to two normal cone operators, it yields an algorithm for finding a point in the intersection of two convex sets.…

Optimization and Control · Mathematics 2013-12-24 Heinz H. Bauschke , J. Y. Bello Cruz , Tran T. A. Nghia , Hung M. Phan , Xianfu Wang

We present a new primal-dual splitting algorithm for structured monotone inclusions in Hilbert spaces and analyze its asymptotic behavior. A novelty of our framework, which is motivated by image recovery applications, is to consider…

Optimization and Control · Mathematics 2014-12-15 Stephen Becker , Patrick L. Combettes

Operator splitting methods tailored to coupled linear port-Hamiltonian systems are developed. We present algorithms that are able to exploit scalar coupling, as well as multirate potential of these coupled systems. The obtained algorithms…

Numerical Analysis · Mathematics 2025-01-14 Jan Lorenz , Tom Zwerschke , Michael Günther , Kevin Schäfers