English
Related papers

Related papers: Penalty schemes with inertial effects for monotone…

200 papers

Monotone inclusions have a wide range of applications, including minimization, saddle-point, and equilibria problems. We introduce new stochastic algorithms, with or without variance reduction, to estimate a root of the expectation of…

Optimization and Control · Mathematics 2024-05-24 Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

In this paper we investigate the convergence behavior of a primal-dual splitting method for solving monotone inclusions involving mixtures of composite, Lipschitzian and parallel sum type operators proposed by Combettes and Pesquet in [7].…

Optimization and Control · Mathematics 2012-11-09 Radu Ioan Bot , Christopher Hendrich

We develop a general equality-constrained nonlinear optimization algorithm based on a smooth penalty function proposed by Fletcher (1970). Although it was historically considered to be computationally prohibitive in practice, we demonstrate…

Optimization and Control · Mathematics 2020-07-03 Ron Estrin , Michael P. Friedlander , Dominique Orban , Michael A. Saunders

In this paper, we propose an adaptive forward-backward-forward splitting algorithm for finding a zero of a pseudo-monotone operator which is split as a sum of three operators: the first is continuous single-valued, the second is…

Optimization and Control · Mathematics 2025-03-04 Flavia Chorobura , Ion Necoara , Jean-Christophe Pesquet

This article introduces a novel approach to learning monotone neural networks through a newly defined penalization loss. The proposed method is particularly effective in solving classes of variational problems, specifically monotone…

Optimization and Control · Mathematics 2025-03-07 Younes Belkouchi , Jean-Christophe Pesquet , Audrey Repetti , Hugues Talbot

This paper presents a general convergence theory of penalty based numerical methods for elliptic constrained inequality problems, including variational inequalities, hemivariational inequalities, and variational-hemivariational…

Numerical Analysis · Mathematics 2019-12-18 Weimin Han , Mircea Sofonea

In this article, we study two methods for solving monotone inclusions in real Hilbert spaces involving the sum of a maximally monotone operator, a monotone-Lipschitzian operator, a cocoercive operator, and a normal cone to a vector…

Optimization and Control · Mathematics 2024-05-13 Fernando Roldán

In this paper, we approach the problem of finding the zeros of the sum of a maximally monotone operator and a monotone and Lipschitz continuous one in a real Hilbert space via an implicit forward-backward-forward dynamical system with…

Optimization and Control · Mathematics 2015-04-23 Sebastian Banert , Radu Ioan Bot

We propose in this paper a unifying scheme for several algorithms from the literature dedicated to the solving of monotone inclusion problems involving compositions with linear continuous operators in infinite dimensional Hilbert spaces. We…

Optimization and Control · Mathematics 2017-05-08 Radu Ioan Bot , Ernö Robert Csetnek

We build upon Estrin et al. (2019) to develop a general constrained nonlinear optimization algorithm based on a smooth penalty function proposed by Fletcher (1970, 1973b). Although Fletcher's approach has historically been considered…

Optimization and Control · Mathematics 2020-07-03 Ron Estrin , Michael Friedlander , Dominique Orban , Michael Saunders

The main contributions of this paper are the proposition and the convergence analysis of a class of inertial projection-type algorithm for solving variational inequality problems in real Hilbert spaces where the underline operator is…

Optimization and Control · Mathematics 2021-01-25 Yekini Shehu , Olaniyi. S. Iyiola , Xiao-Huan Li , Qiao-Li Dong

We propose an abstract stochastic scheme for solving a broad range of monotone operator inclusion problems in Hilbert spaces. This framework allows for the introduction of stochasticity at several levels in monotone operator splitting…

Optimization and Control · Mathematics 2026-02-13 Patrick L. Combettes , Javier I. Madariaga

The goal of this paper is to present two algorithms for solving systems of inclusion problems, with all component of the systems being a sum of two maximal monotone operators. The algorithms are variants of the forward-backward splitting…

Optimization and Control · Mathematics 2018-05-28 R. Díaz Millán

We focus on the linear convergence of generalized proximal point algorithms for solving monotone inclusion problems. Under the assumption that the associated monotone operator is metrically subregular or that the inverse of the monotone…

Optimization and Control · Mathematics 2022-03-29 Hui Ouyang

We address the problem of finding the zeros of the sum of a maximally monotone operator and a cocoercive operator. Our approach introduces a modification to the forward-backward method by integrating an inertial/momentum term alongside a…

Optimization and Control · Mathematics 2023-12-20 Radu Ioan Bot , Dang-Khoa Nguyen , Chunxiang Zong

In this paper, we consider the problem of minimizing a smooth function, given as finite sum of black-box functions, over a convex set. In order to advantageously exploit the structure of the problem, for instance when the terms of the…

Optimization and Control · Mathematics 2026-03-13 Francesco Cecere , Matteo Lapucci , Davide Pucci , Marco Sciandrone

In this work we study a constrained monotone inclusion involving the normal cone to a closed vector subspace and a priori information on primal solutions. We model this information by imposing that solutions belongs to the fixed point set…

Optimization and Control · Mathematics 2021-11-02 Luis Briceño-Arias , Julio Deride , Sergio López-Rivera , Francisco J. Silva

We propose stochastic splitting algorithms for solving large-scale composite inclusion problems involving monotone and linear operators. They activate at each iteration blocks of randomly selected resolvents of monotone operators and,…

Optimization and Control · Mathematics 2025-08-07 Patrick L. Combettes , Javier I. Madariaga

Constrained optimization with multiple functional inequality constraints has significant applications in machine learning. This paper examines a crucial subset of such problems where both the objective and constraint functions are weakly…

Machine Learning · Computer Science 2026-02-09 Ming Yang , Gang Li , Quanqi Hu , Qihang Lin , Tianbao Yang

We consider mixed-integer optimal control problems with combinatorial constraints that couple over time such as minimum dwell times. We analyze a lifting and decomposition approach into a mixed-integer optimal control problem without…

Optimization and Control · Mathematics 2021-04-21 Simone Göttlich , Falk M. Hante , Andreas Potschka , Lars Schewe