English
Related papers

Related papers: A new splitting method for solving composite monot…

200 papers

In this paper, we propose a randomized intertial block-coordinate primaldual fixed point algorithm to solve a wide array of monotone inclusion problems base on the modification of the heavy ball method of Nesterov. These methods rely on a…

Optimization and Control · Mathematics 2016-11-17 Meng Wen , Shigang Yue , Yuchao Tan , Jigen Peng

In this work, we propose a new algorithm for finding a zero in the sum of two monotone operators where one is assumed to be single-valued and Lipschitz continuous. This algorithm naturally arises from a non-standard discretization of a…

Optimization and Control · Mathematics 2020-06-17 Ernö Robert Csetnek , Yura Malitsky , Matthew K. Tam

Within the unmanageably large class of nonconvex optimization, we consider the rich subclass of nonsmooth problems that have composite objectives---this already includes the extensively studied convex, composite objective problems as a…

Optimization and Control · Mathematics 2012-09-18 Suvrit Sra

This paper presents a stochastic block-coordinate proximal Newton method for minimizing the sum of a blockwise Lipschitz-continuously differentiable function and a separable nonsmooth convex function. At each iteration, the method randomly…

Optimization and Control · Mathematics 2026-03-25 Hong Zhu , Xun Qian

This paper introduces the generalized forward-backward splitting algorithm for minimizing convex functions of the form $F + \sum_{i=1}^n G_i$, where $F$ has a Lipschitz-continuous gradient and the $G_i$'s are simple in the sense that their…

Optimization and Control · Mathematics 2014-02-11 Hugo Raguet , Jalal Fadili , Gabriel Peyré

The aim of this paper is to study the weak convergence analysis of sequence of iterates generated by a three-operator splitting method of Davis and Yin incorporated with two-step inertial extrapolation for solving monotone inclusion problem…

Optimization and Control · Mathematics 2024-10-03 Olaniyi S. Iyiola , Lateef O. Jolaoso , Yekini Shehu

In this paper, we introduce two parallel extragradient-proximal methods for solving split equilibrium problems. The algorithms combine the extragradient method, the proximal method and the hybrid (outer approximation) method. The weak and…

Optimization and Control · Mathematics 2015-11-10 Dang Van Hieu

We develop a novel unified randomized block-coordinate primal-dual algorithm to solve a class of nonsmooth constrained convex optimization problems, which covers different existing variants and model settings from the literature. We prove…

Optimization and Control · Mathematics 2021-10-29 Quoc Tran-Dinh , Deyi Liu

Operator splitting algorithms are a cornerstone of modern first-order optimization, relying critically on proximal operators as their fundamental building blocks. However, explicit formulas for proximal operators are available only for…

Optimization and Control · Mathematics 2025-09-17 Nicholas Di , Eric C. Chi , Samy Wu Fung

We study the non-smooth optimization problems in machine learning, where both the loss function and the regularizer are non-smooth functions. Previous studies on efficient empirical loss minimization assume either a smooth loss function or…

Machine Learning · Computer Science 2013-07-29 Tianbao Yang , Mehrdad Mahdavi , Rong Jin , Shenghuo Zhu

The proximity operator of a convex function is a natural extension of the notion of a projection operator onto a convex set. This tool, which plays a central role in the analysis and the numerical solution of convex optimization problems,…

Optimization and Control · Mathematics 2010-05-19 Patrick L. Combettes , Jean-Christophe Pesquet

We develop a new inexact interior-point Lagrangian decomposition method to solve a wide range class of constrained composite convex optimization problems. Our method relies on four techniques: Lagrangian dual decomposition, self-concordant…

Optimization and Control · Mathematics 2019-04-22 Deyi Liu , Quoc Tran-Dinh

We introduce a first order method for solving very large convex cone programs. The method uses an operator splitting method, the alternating directions method of multipliers, to solve the homogeneous self-dual embedding, an equivalent…

Optimization and Control · Mathematics 2016-07-27 Brendan O'Donoghue , Eric Chu , Neal Parikh , Stephen Boyd

In this paper, by using tools of second-order variational analysis, we study the popular forward-backward splitting method with Beck-Teboulle's line-search for solving convex optimization problem where the objective function can be split…

Optimization and Control · Mathematics 2018-06-19 Yunier Bello-Cruz , G. Li , T. T. A. Nghia

In the paper, we introduce several accelerate iterative algorithms for solving the multiple-set split common fixed-point problem of quasi-nonexpansive operators in real Hilbert space. Based on primal-dual method, we construct several…

Optimization and Control · Mathematics 2023-06-08 Chenzheng Guo , Jing Zhao

In this paper we propose and analyze two dual methods based on inexact gradient information and averaging that generate approximate primal solutions for smooth convex optimization problems. The complicating constraints are moved into the…

Optimization and Control · Mathematics 2013-02-14 Ion Necoara , Valentin Nedelcu

The problem of finding the zeros of the sum of two maximally monotone operators is of fundamental importance in optimization and variational analysis. In this paper, we systematically study Attouch-Th\'era duality for this problem. We…

Optimization and Control · Mathematics 2011-10-24 Heinz H. Bauschke , Radu I. Bot , Warren L. Hare , Walaa M. Moursi

Operator splitting methods tailored to coupled linear port-Hamiltonian systems are developed. We present algorithms that are able to exploit scalar coupling, as well as multirate potential of these coupled systems. The obtained algorithms…

Numerical Analysis · Mathematics 2025-01-14 Jan Lorenz , Tom Zwerschke , Michael Günther , Kevin Schäfers

Composite optimization problems, where the sum of a smooth and a merely lower semicontinuous function has to be minimized, are often tackled numerically by means of proximal gradient methods as soon as the lower semicontinuous part of the…

Optimization and Control · Mathematics 2022-07-05 Christian Kanzow , Patrick Mehlitz

In this paper, we propose a distributed first-order algorithm with backtracking linesearch for solving multi-agent minimisation problems, where each agent handles a local objective involving nonsmooth and smooth components. Unlike existing…

Optimization and Control · Mathematics 2025-05-14 Felipe Atenas , Minh N. Dao , Matthew K. Tam