English
Related papers

Related papers: Convergence analysis of a variable metric forward-…

200 papers

We propose and analyze a versatile and general algorithm called nonlinear forward-backward splitting (NOFOB). The algorithm consists of two steps; first an evaluation of a nonlinear forward-backward map followed by a relaxed projection onto…

Optimization and Control · Mathematics 2021-01-25 Pontus Giselsson

The objective of this paper is to develop methods for solving image recovery problems subject to constraints on the solution. More precisely, we will be interested in problems which can be formulated as the minimization over a closed convex…

Optimization and Control · Mathematics 2012-12-12 Caroline Chaux , Jean-Christophe Pesquet , Nelly Pustelnik

Properties of compositions and convex combinations of averaged nonexpansive operators are investigated and applied to the design of new fixed point algorithms in Hilbert spaces. An extended version of the forward-backward splitting…

Functional Analysis · Mathematics 2014-10-09 Patrick L. Combettes , Isao Yamada

In this article, we study two methods for solving monotone inclusions in real Hilbert spaces involving the sum of a maximally monotone operator, a monotone-Lipschitzian operator, a cocoercive operator, and a normal cone to a vector…

Optimization and Control · Mathematics 2024-05-13 Fernando Roldán

The principle underlying this paper is the basic observation that the problem of simultaneously solving a large class of composite monotone inclusions and their duals can be reduced to that of finding a zero of the sum of a maximally…

Optimization and Control · Mathematics 2010-11-29 L. Briceno-Arias , P. L. Combettes

Non-differentiable and constrained optimization play a key role in machine learning, signal and image processing, communications, and beyond. For high-dimensional minimization problems involving large datasets or many unknowns, the…

Numerical Analysis · Computer Science 2016-12-30 Tom Goldstein , Christoph Studer , Richard Baraniuk

This paper studies a recovery task of finding a low multilinear-rank tensor that fulfills some linear constraints in the general settings, which has many applications in computer vision and graphics. This problem is named as the low…

Optimization and Control · Mathematics 2013-10-08 Lei Yang , Zheng-Hai Huang , Yufan Li

In recent years, a distributed Douglas-Rachford splitting method (DDRSM) has been proposed to tackle multi-block separable convex optimization problems. This algorithm offers relatively easier subproblems and greater efficiency for…

Optimization and Control · Mathematics 2024-11-19 Leyu Hu , Jiaxin Xie , Xingju Cai , Deren Han

This paper presents a modified iterative approach to solve the variational inequality problem using the double inertial technique in the context of a real Hilbert space. Our iterative technique involves a projection onto a generalized…

Functional Analysis · Mathematics 2026-03-19 Watanjeet Singh , Sumit Chandok

We consider the primal problem of finding the zeros of the sum of a maximally monotone operator with the composition of another maximally monotone operator with a linear continuous operator and a corresponding dual problem formulated by…

Optimization and Control · Mathematics 2012-06-27 Radu Ioan Bot , Ernö Robert Csetnek , Andre Heinrich

We present a novel matrix-parametrized frugal splitting algorithm which finds the zero of a sum of maximal monotone and cocoercive operators composed with linear selection operators. We also develop a semidefinite programming framework for…

Optimization and Control · Mathematics 2025-07-29 Peter Barkley , Robert L. Bassett

The article is devoted to the development of numerical methods for solving variational inequalities with relatively strongly monotone operators. We consider two classes of variational inequalities related to some analogs of the Lipschitz…

Optimization and Control · Mathematics 2022-05-25 F. S. Stonyakin , A. A. Titov , D. V. Makarenko , M. S. Alkousa

In this article, we study the convergence of algorithms for solving monotone inclusions in the presence of adjoint mismatch. The adjoint mismatch arises when the adjoint of a linear operator is replaced by an approximation, due to…

Optimization and Control · Mathematics 2023-11-10 Emilie Chouzenoux , Jean-Christophe Pesquet , Fernando Roldán

In this article we propose a method for solving unconstrained optimization problems with convex and Lipschitz continuous objective functions. By making use of the Moreau envelopes of the functions occurring in the objective, we smooth the…

Optimization and Control · Mathematics 2012-07-16 Radu Ioan Bot , Christopher Hendrich

We propose stochastic variance reduced algorithms for solving convex-concave saddle point problems, monotone variational inequalities, and monotone inclusions. Our framework applies to extragradient, forward-backward-forward, and…

Optimization and Control · Mathematics 2022-06-14 Ahmet Alacaoglu , Yura Malitsky

We consider a variable metric and inexact version of the FISTA-type algorithm considered in (Chambolle, Pock, 2016, Calatroni, Chambolle, 2019) for the minimization of the sum of two (possibly strongly) convex functions. The proposed…

Optimization and Control · Mathematics 2021-01-12 Simone Rebegoldi , Luca Calatroni

We study stochastic monotone inclusion problems, which widely appear in machine learning applications, including robust regression and adversarial learning. We propose novel variants of stochastic Halpern iteration with recursive variance…

Optimization and Control · Mathematics 2023-01-10 Xufeng Cai , Chaobing Song , Cristóbal Guzmán , Jelena Diakonikolas

The paper investigates two inertial extragradient algorithms for seeking a common solution to a variational inequality problem involving a monotone and Lipschitz continuous mapping and a fixed point problem with a demicontractive mapping in…

Optimization and Control · Mathematics 2023-08-08 Bing Tan , Liya Liu , Xiaolong Qin

Low rank matrix approximation is a popular topic in machine learning. In this paper, we propose a new algorithm for this topic by minimizing the least-squares estimation over the Riemannian manifold of fixed-rank matrices. The algorithm is…

Machine Learning · Computer Science 2022-02-15 Qianqian Song

A recent innovation in projective splitting algorithms for monotone operator inclusions has been the development of a procedure using two forward steps instead of the customary proximal steps for operators that are Lipschitz continuous.…

Optimization and Control · Mathematics 2020-02-19 Patrick R. Johnstone , Jonathan Eckstein