English
Related papers

Related papers: An Inexact Spingarn's Partial Inverse Method with …

200 papers

This paper presents a novel restarted version of Nesterov's accelerated gradient method and establishes its optimal iteration-complexity for solving convex smooth composite optimization problems. The proposed restart accelerated gradient…

Optimization and Control · Mathematics 2025-01-09 Jiaming Liang

In this paper, we present a convergence rate analysis for the inexact Krasnosel'skii-Mann iteration built from nonexpansive operators. Our results include two main parts: we first establish global pointwise and ergodic iteration-complexity…

Optimization and Control · Mathematics 2015-09-17 Jingwei Liang , Jalal Fadili , Gabriel Peyré

This paper is concerned with finding an optimal algorithm for minimizing a composite convex objective function. The basic setting is that the objective is the sum of two convex functions: the first function is smooth with up to the d-th…

Optimization and Control · Mathematics 2020-04-20 Bo Jiang , Haoyue Wang , Shuzhong Zhang

This paper proposes and establishes the iteration-complexity of an inexact proximal accelerated augmented Lagrangian (IPAAL) method for solving linearly constrained smooth nonconvex composite optimization problems. Each IPAAL iteration…

Optimization and Control · Mathematics 2020-06-16 Jefferson G. Melo , Renato D. C. Monteiro , Hairong Wang

In this paper we present a variant of the proximal forward-backward splitting iteration for solving nonsmooth optimization problems in Hilbert spaces, when the objective function is the sum of two nondifferentiable convex functions. The…

Optimization and Control · Mathematics 2016-01-13 Jose Yunier Bello Cruz

The paper considers a split inverse problem involving component equilibrium problems in Hilbert spaces. This problem therefore is called the split equilibrium problem (SEP). It is known that almost solution methods for solving problem (SEP)…

Optimization and Control · Mathematics 2019-04-17 Dang Van Hieu

This paper studies a class of double-loop (inner-outer) algorithms for convex composite optimization. For unconstrained problems, we develop a restarted accelerated composite gradient method that attains the optimal first-order complexity…

Optimization and Control · Mathematics 2026-02-23 Matthew X. Burns , Jiaming Liang

The classical Krasnoselskii-Mann iteration is broadly used for approximating fixed points of nonexpansive operators. To accelerate the convergence of the Krasnoselskii-Mann iteration, the inertial methods were received much attention in…

Functional Analysis · Mathematics 2020-01-09 Fuying Cui , Yang Yang , Yuchao Tang , Chuanxi Zhu

We propose a new relative-error inexact version of the alternating direction method of multipliers (ADMM) for convex optimization. We prove the asymptotic convergence of our main algorithm as well as pointwise and ergodic…

Optimization and Control · Mathematics 2024-09-17 M. Marques Alves , M. Geremia

A Halpern-type relaxed inertial inexact progressive hedging algorithm (PHA) is proposed for solving multi-stage stochastic variational inequalities in general probability spaces. The subproblems in this algorithm are allowed to be…

Optimization and Control · Mathematics 2024-12-10 Jiaxin Chen , Zunjie Huang , Haisen Zhang

In this paper we analyze several inexact fast augmented Lagrangian methods for solving linearly constrained convex optimization problems. Mainly, our methods rely on the combination of excessive-gap-like smoothing technique developed in…

Optimization and Control · Mathematics 2015-05-14 Andrei Patrascu , Ion Necoara , Quoc Tran-Dinh

We propose and analyze an inexact gradient method based on incremental proper orthogonal decomposition (iPOD) to address the data storage difficulty in time-dependent PDE-constrained optimization, particularly for a data assimilation…

Optimization and Control · Mathematics 2024-08-02 Xuejian Li , John R. Singler , Xiaoming He

In this paper, we propose an algorithm combining the forward-backward splitting method and the alternative projection method for solving the system of splitting inclusion problem. We want to find a point in the interception of a finite…

Optimization and Control · Mathematics 2016-04-08 R. Díaz Millán

We consider the problem of optimizing the sum of a smooth convex function and a non-smooth convex function via the inexact accelerated proximal gradient (APG) method. A key limitation of existing inexact APG methods is their reliance on…

Optimization and Control · Mathematics 2026-02-12 Lei Yang , Meixia Lin

In this paper, we investigate the trade-off between convergence rate and computational cost when minimizing a composite functional with proximal-gradient methods, which are popular optimisation tools in machine learning. We consider the…

Machine Learning · Computer Science 2012-10-23 Pierre Machart , Sandrine Anthoine , Luca Baldassarre

In this paper, we develop a new type of accelerated algorithms to solve some classes of maximally monotone equations as well as monotone inclusions. Instead of using Nesterov's accelerating approach, our methods rely on a so-called…

Optimization and Control · Mathematics 2021-12-08 Quoc Tran-Dinh , Yang Luo

Decomposition techniques for linear programming are difficult to extend to conic optimization problems with general non-polyhedral convex cones because the conic inequalities introduce an additional nonlinear coupling between the variables.…

Optimization and Control · Mathematics 2013-06-04 Yifan Sun , Martin S. Andersen , Lieven Vandenberghe

We study a general convex optimization problem, which covers various classic problems in different areas and particularly includes many optimal transport related problems arising in recent years. To solve this problem, we revisit the…

Optimization and Control · Mathematics 2022-05-18 Lei Yang , Kim-Chuan Toh

In machine learning research, the proximal gradient methods are popular for solving various optimization problems with non-smooth regularization. Inexact proximal gradient methods are extremely important when exactly solving the proximal…

Machine Learning · Computer Science 2018-09-11 Bin Gu , De Wang , Zhouyuan Huo , Heng Huang

An algorithm for solving nonconvex smooth optimization problems is proposed, analyzed, and tested. The algorithm is an extension of the Trust Region Algorithm with Contractions and Expansions (TRACE) [Math. Prog. 162(1):132, 2017]. In…

Optimization and Control · Mathematics 2022-04-26 Frank E. Curtis , Qi Wang