English
Related papers

Related papers: A Three-Operator Splitting Scheme and its Optimiza…

200 papers

The obstacle problem is a class of free boundary problems which finds applications in many disciplines such as porous media, financial mathematics and optimal control. In this paper, we propose two operator-splitting methods to solve the…

Numerical Analysis · Mathematics 2023-02-08 Hao Liu , Dong Wang

Operator splitting methods solve composite optimization problems by breaking them into smaller sub-problems that can be solved sequentially or in parallel. In this paper, we propose a unified framework for certifying both linear and…

Optimization and Control · Mathematics 2019-10-25 Han Wang , Mahyar Fazlyab , Shaoru Chen , Victor M. Preciado

Primal-dual splitting schemes are a class of powerful algorithms that solve complicated monotone inclusions and convex optimization problems that are built from many simpler pieces. They decompose problems that are built from sums, linear…

Optimization and Control · Mathematics 2015-07-31 Damek Davis

We present a method for constructing numerical schemes with up to 3rd strong convergence order for solution of a class of stochastic differential equations, including equations of the Langevin type. The construction proceeds in two stages.…

High Energy Physics - Lattice · Physics 2025-04-08 Andrey Shkerin , Sergey Sibiryakov

Finding a zero of a sum of maximally monotone operators is a fundamental problem in modern optimization and nonsmooth analysis. Assuming that resolvents of the operators are available, this problem can be tackled with the Douglas-Rachford…

Optimization and Control · Mathematics 2021-09-24 Heinz H. Bauschke , Shambhavi Singh , Xianfu Wang

Analyzing the worst-case performance of deep neural networks against input perturbations amounts to solving a large-scale non-convex optimization problem, for which several past works have proposed convex relaxations as a promising…

Machine Learning · Computer Science 2022-07-11 Shaoru Chen , Eric Wong , J. Zico Kolter , Mahyar Fazlyab

In this paper we provide a generalization of the Douglas-Rachford splitting (DRS) and the primal-dual algorithm (Vu 2013, Condat 2013) for solving monotone inclusions in a real Hilbert space involving a general linear operator. The proposed…

Optimization and Control · Mathematics 2021-09-22 Luis M. Briceño-Arias , Fernando Roldán

Three Operator Splitting (TOS) (Davis & Yin, 2017) can minimize the sum of multiple convex functions effectively when an efficient gradient oracle or proximal operator is available for each term. This requirement often fails in machine…

Optimization and Control · Mathematics 2022-02-21 Alp Yurtsever , Alex Gu , Suvrit Sra

Operator splitting is a popular divide-and-conquer strategy for solving differential equations. Typically, the right-hand side of the differential equation is split into a number of parts that are then integrated separately. Many methods…

Numerical Analysis · Mathematics 2023-08-14 Raymond J. Spiteri , Arash Tavassoli , Siqi Wei , Andrei Smolyakov

In this paper, we propose a primal-dual splitting algorithm for a broad class of structured composite monotone inclusions that involve finitely many set-valued operators, compositions of set-valued operators with bounded linear operators,…

Optimization and Control · Mathematics 2026-05-14 Minh N. Dao , Hung M. Phan , Matthew K. Tam , Thang D. Truong

Splitting schemes are a class of powerful algorithms that solve complicated monotone inclusions and convex optimization problems that are built from many simpler pieces. They give rise to algorithms in which the simple pieces of the…

Optimization and Control · Mathematics 2015-05-19 Damek Davis , Wotao Yin

Operator splitting methods allow to split the operator describing a complex dynamical system into a sequence of simpler subsystems and treat each part independently. In the modeling of dynamical problems, systems of (possibly coupled)…

Dynamical Systems · Mathematics 2023-09-01 Andreas Bartel , Malak Diab , Andreas Frommer , Michael Günther

The Douglas-Rachford algorithm is a classical and powerful splitting method for minimizing the sum of two convex functions and, more generally, finding a zero of the sum of two maximally monotone operators. Although this algorithm is well…

Optimization and Control · Mathematics 2020-04-14 Minh N. Dao , Hung M. Phan

We shed light on the structure of the "three-operator" version of the forward-Douglas--Rachford splitting algorithm for finding a zero of a sum of maximally monotone operators $A + B + C$, where $B$ is cocoercive, involving only the…

Optimization and Control · Mathematics 2018-05-02 Hugo Raguet

In recent years, several convergent multi-block variants of the alternating direction method of multipliers (ADMM) have been proposed for solving the convex quadratic semidefinite programming via its dual, which is naturally a 3-block…

Optimization and Control · Mathematics 2018-07-06 Xiaokai Chang , Liang Chen , Sanyang Liu

Splitting schemes are a class of powerful algorithms that solve complicated monotone inclusion and convex optimization problems that are built from many simpler pieces. They give rise to algorithms in which the simple pieces of the…

Optimization and Control · Mathematics 2015-05-04 Damek Davis , Wotao Yin

We propose an abstract stochastic scheme for solving a broad range of monotone operator inclusion problems in Hilbert spaces. This framework allows for the introduction of stochasticity at several levels in monotone operator splitting…

Optimization and Control · Mathematics 2026-02-13 Patrick L. Combettes , Javier I. Madariaga

We study frugal splitting algorithms with minimal lifting for solving monotone inclusion problems involving sums of maximal monotone and cocoercive operators. Building on a foundational result by Ryu, we fully characterize all methods that…

Optimization and Control · Mathematics 2025-04-16 Anton Åkerman , Enis Chenchene , Pontus Giselsson , Emanuele Naldi

This work introduces and rigorously analyzes a novel operator-splitting finite element scheme for approximating viscosity solutions of a broad class of constrained second-order partial differential equations. By decoupling the primary PDE…

Numerical Analysis · Mathematics 2025-07-01 Po-Yi Wu

The Douglas-Rachford splitting method is a classical and widely used algorithm for solving monotone inclusions involving the sum of two maximally monotone operators. It was recently shown to be the unique frugal, no-lifting…

Optimization and Control · Mathematics 2025-12-12 Max Nilsson , Anton Åkerman , Pontus Giselsson