English
Related papers

Related papers: Inertial, corrected, primal-dual proximal splittin…

200 papers

This paper derives new inexact variants of the Douglas-Rachford splitting method for maximal monotone operators and the alternating direction method of multipliers (ADMM) for convex optimization. The analysis is based on a new inexact…

Optimization and Control · Mathematics 2019-04-25 M. Marques Alves , Jonathan Eckstein , Marina Geremia , Jefferson Melo

We propose a doubly stochastic primal-dual coordinate optimization algorithm for empirical risk minimization, which can be formulated as a bilinear saddle-point problem. In each iteration, our method randomly samples a block of coordinates…

Machine Learning · Computer Science 2017-04-13 Adams Wei Yu , Qihang Lin , Tianbao Yang

We propose a primal-dual splitting algorithm for solving monotone inclusions involving a mixture of sums, linear compositions, and parallel sums of set-valued and Lipschitzian operators. An important feature of the algorithm is that the…

Optimization and Control · Mathematics 2011-08-09 Patrick L. Combettes , Jean-Christophe Pesquet

The aim of this paper is to study the weak convergence analysis of sequence of iterates generated by a three-operator splitting method of Davis and Yin incorporated with two-step inertial extrapolation for solving monotone inclusion problem…

Optimization and Control · Mathematics 2024-10-03 Olaniyi S. Iyiola , Lateef O. Jolaoso , Yekini Shehu

In this work, in the context of Linear and Quadratic Programming, we interpret Primal Dual Regularized Interior Point Methods (PDR-IPMs) in the framework of the Proximal Point Method. The resulting Proximal Stabilized IPM (PS-IPM) is…

Optimization and Control · Mathematics 2022-05-05 Stefano Cipolla , Jacek Gondzio

In this paper we investigate the applicability of a recently introduced primal-dual splitting method in the context of solving portfolio optimization problems which assume the minimization of risk measures associated to different convex…

Optimization and Control · Mathematics 2013-04-30 Radu Ioan Bot , Christopher Hendrich

In this paper, we propose two algorithms for solving linear inverse problems when the observations are corrupted by Poisson noise. A proper data fidelity term (log-likelihood) is introduced to reflect the Poisson statistics of the noise. On…

Applications · Statistics 2011-03-14 François-Xavier Dupé , Jalal Fadili , Jean-Luc Starck

Consider the minimization of a nonconvex differentiable function over a polyhedron. A popular primal-dual first-order method for this problem is to perform a gradient projection iteration for the augmented Lagrangian function and then…

Optimization and Control · Mathematics 2020-08-05 Jiawei Zhang , Zhi-Quan Luo

We provide an overview of primal-dual algorithms for nonsmooth and non-convex-concave saddle-point problems. This flows around a new analysis of such methods, using Bregman divergences to formulate simplified conditions for convergence.

Optimization and Control · Mathematics 2021-08-03 Tuomo Valkonen

In this work we study a constrained monotone inclusion involving the normal cone to a closed vector subspace and a priori information on primal solutions. We model this information by imposing that solutions belongs to the fixed point set…

Optimization and Control · Mathematics 2021-11-02 Luis Briceño-Arias , Julio Deride , Sergio López-Rivera , Francisco J. Silva

We develop an inexact primal-dual first-order smoothing framework to solve a class of non-bilinear saddle point problems with primal strong convexity. Compared with existing methods, our framework yields a significant improvement over the…

Optimization and Control · Mathematics 2023-07-25 Le Thi Khanh Hien , Renbo Zhao , William B. Haskell

In the context of convex optimization problems in Hilbert spaces, we induce inertial effects into the classical ADMM numerical scheme and obtain in this way so-called inertial ADMM algorithms, the convergence properties of which we…

Optimization and Control · Mathematics 2014-04-18 Radu Ioan Bot , Ernö Robert Csetnek

We propose a primal-dual smoothing framework for finding a near-stationary point of a class of non-smooth non-convex optimization problems with max-structure. We analyze the primal and dual gradient complexities of the framework via two…

Optimization and Control · Mathematics 2023-07-19 Renbo Zhao

We propose a proximal approach to deal with a class of convex variational problems involving nonlinear constraints. A large family of constraints, proven to be effective in the solution of inverse problems, can be expressed as the lower…

Numerical Analysis · Computer Science 2014-03-21 Giovanni Chierchia , Nelly Pustelnik , Jean-Christophe Pesquet , Béatrice Pesquet-Popescu

We introduce an efficient first-order primal-dual method for the solution of nonsmooth PDE-constrained optimization problems. We achieve this efficiency through not solving the PDE or its linearisation on each iteration of the optimization…

Optimization and Control · Mathematics 2024-06-11 Bjørn Jensen , Tuomo Valkonen

A trajectory-following primal--dual interior-point method solves nonlinear optimization problems with inequality and equality constraints by approximately finding points satisfying perturbed Karush--Kuhn--Tucker optimality conditions for a…

Optimization and Control · Mathematics 2025-07-03 Pim Heeman , Anders Forsgren

This paper develops a continuous-time primal-dual accelerated method with an increasing damping coefficient for a class of convex optimization problems with affine equality constraints. This paper analyzes critical values for parameters in…

Optimization and Control · Mathematics 2022-02-16 Xianlin Zeng , Jinlong Lei , Jie Chen

In this paper, we introduce some adaptive methods for solving variational inequalities with relatively strongly monotone operators. Firstly, we focus on the modification of the recently proposed, in smooth case [1], adaptive numerical…

Optimization and Control · Mathematics 2022-11-01 A. A. Titov , S. S. Ablaev , M. S. Alkousa , F. S. Stonyakin , A. V. Gasnikov

With a view on bilevel and PDE-constrained optimisation, we develop iterative estimates $\widetilde{F'}(x^k)$ of $F'(x^k)$ for composite functions $F :=J \circ S$, where $S$ is the solution mapping of the inner optimisation problem or PDE.…

Optimization and Control · Mathematics 2026-04-02 Neil Dizon , Tuomo Valkonen

Online optimisation facilitates the solution of dynamic inverse problems, such as image stabilisation, fluid flow monitoring, and dynamic medical imaging. In this paper, we improve upon previous work on predictive online primal-dual methods…

Optimization and Control · Mathematics 2025-02-28 Neil Dizon , Jyrki Jauhiainen , Tuomo Valkonen