English
Related papers

Related papers: Three Operator Splitting with a Nonconvex Loss Fun…

200 papers

Three Operator Splitting (TOS) (Davis & Yin, 2017) can minimize the sum of multiple convex functions effectively when an efficient gradient oracle or proximal operator is available for each term. This requirement often fails in machine…

Optimization and Control · Mathematics 2022-02-21 Alp Yurtsever , Alex Gu , Suvrit Sra

In this work, we address a class of nonconvex nonsmooth optimization problems where the objective function is the sum of two smooth functions (one of which is proximable) and two nonsmooth functions (one proper, closed and proximable, and…

Optimization and Control · Mathematics 2025-03-26 Jan Harold Alcantara , Ching-pei Lee , Akiko Takeda

The three operator splitting scheme was recently proposed by [Davis and Yin, 2015] as a method to optimize composite objective functions with one convex smooth term and two convex (possibly non-smooth) terms for which we have access to…

Machine Learning · Statistics 2021-06-29 Fabian Pedregosa

Operator splitting methods solve composite optimization problems by breaking them into smaller sub-problems that can be solved sequentially or in parallel. In this paper, we propose a unified framework for certifying both linear and…

Optimization and Control · Mathematics 2019-10-25 Han Wang , Mahyar Fazlyab , Shaoru Chen , Victor M. Preciado

This work presents a new three-operator splitting method to handle monotone inclusion and convex optimization problems. The proposed splitting serves as another natural extension of the Douglas-Rachford splitting technique to problems…

Optimization and Control · Mathematics 2025-10-03 Anshika Anshika , Jiaxing Li , Debdas Ghosh , Xiangxiong Zhang

Sparsity regularization has been largely applied in many fields, such as signal and image processing and machine learning. In this paper, we mainly consider nonconvex minimization problems involving three terms, for the applications such…

Optimization and Control · Mathematics 2020-06-17 Fengmiao Bian , Xiaoqun Zhang

We propose and analyze an adaptive step-size variant of the Davis-Yin three operator splitting. This method can solve optimization problems composed by a sum of a smooth term for which we have access to its gradient and an arbitrary number…

Optimization and Control · Mathematics 2018-08-02 Fabian Pedregosa , Gauthier Gidel

This paper studies a class of monotone inclusion problems in a real Hilbert space involving the sum of three operators, where two are maximal monotone and the third is cocoercive. The Davis--Yin three-operator splitting method extends the…

Optimization and Control · Mathematics 2026-05-14 Maoran Wang , Zijun Xia , Xingju Cai

Radiation therapy (RT) aims to deliver tumoricidal doses with minimal radiation-induced normal-tissue toxicity. Compared to conventional RT (of conventional dose rate), FLASH-RT (of ultra-high dose rate) can provide additional normal tissue…

Optimization and Control · Mathematics 2023-11-27 Fengmiao Bian , Jiulong Liu , Xiaoqun Zhang , Hao Gao , Jian-Feng Cai

In this paper, we consider a class of structured nonconvex nonsmooth optimization problems whose objective function is the sum of three nonconvex functions, one of which is expressed in a difference-of-convex (DC) form. This problem class…

Optimization and Control · Mathematics 2025-06-10 Minh N. Dao , Tan Nhat Pham , Phan Thanh Tung

In this work, we propose a modification of Ryu's splitting algorithm for minimizing the sum of three functions, where two of them are convex with Lipschitz continuous gradients, and the third is an arbitrary proper closed function that is…

Optimization and Control · Mathematics 2025-09-09 Jan Harold Alcantara , Felipe Atenas

We propose a stochastic optimization method for the minimization of the sum of three convex functions, one of which has Lipschitz continuous gradient as well as restricted strong convexity. Our approach is most suitable in the setting where…

Optimization and Control · Mathematics 2017-02-01 Alp Yurtsever , Bang Cong Vu , Volkan Cevher

Operator splitting methods have been successfully used in computational sciences, statistics, learning and vision areas to reduce complex problems into a series of simpler subproblems. However, prevalent splitting schemes are mostly…

Computer Vision and Pattern Recognition · Computer Science 2018-05-01 Risheng Liu , Shichao Cheng , Yi He , Xin Fan , Zhongxuan Luo

In this work we propose a stochastic primal-dual three-operator splitting algorithm (TOS-SPDHG) for solving a class of convex three-composite optimization problems. Our proposed scheme is a direct three-operator splitting extension of the…

Optimization and Control · Mathematics 2025-03-18 Junqi Tang , Matthias Ehrhardt , Carola-Bibiane Schönlieb

We consider minimizing the sum of three convex functions, where the first one F is smooth, the second one is nonsmooth and proximable and the third one is the composition of a nonsmooth proximable function with a linear operator L. This…

Optimization and Control · Mathematics 2022-07-27 Adil Salim , Laurent Condat , Konstantin Mishchenko , Peter Richtárik

The three-operators splitting algorithm is a popular operator splitting method for finding the zeros of the sum of three maximally monotone operators, with one of which is cocoercive operator. In this paper, we propose a class of inertial…

Optimization and Control · Mathematics 2019-08-30 Fuying Cui , Yuchao Tang , Yang Yang

The aim of this paper is to study the weak convergence analysis of sequence of iterates generated by a three-operator splitting method of Davis and Yin incorporated with two-step inertial extrapolation for solving monotone inclusion problem…

Optimization and Control · Mathematics 2024-10-03 Olaniyi S. Iyiola , Lateef O. Jolaoso , Yekini Shehu

We propose the shadow Davis-Yin three-operator splitting method to solve nonconvex optimisation problems. Its convergence analysis is based on a merit function resembling the Moreau envelope. We explore variational analysis properties…

Optimization and Control · Mathematics 2025-12-24 Felipe Atenas

Operator splitting schemes have been successfully used in computational sciences to reduce complex problems into a series of simpler subproblems. Since 1950s, these schemes have been widely used to solve problems in PDE and control.…

Optimization and Control · Mathematics 2015-04-07 Damek Davis , Wotao Yin

The Douglas-Rachford splitting method is a classical and widely used algorithm for solving monotone inclusions involving the sum of two maximally monotone operators. It was recently shown to be the unique frugal, no-lifting…

Optimization and Control · Mathematics 2025-12-12 Max Nilsson , Anton Åkerman , Pontus Giselsson
‹ Prev 1 2 3 10 Next ›