English
Related papers

Related papers: Activity Identification and Local Linear Convergen…

200 papers

We consider a variable metric and inexact version of the FISTA-type algorithm considered in (Chambolle, Pock, 2016, Calatroni, Chambolle, 2019) for the minimization of the sum of two (possibly strongly) convex functions. The proposed…

Optimization and Control · Mathematics 2021-01-12 Simone Rebegoldi , Luca Calatroni

This paper provides a set of sensitivity analysis and activity identification results for a class of convex functions with a strong geometric structure, that we coined "mirror-stratifiable". These functions are such that there is a…

Optimization and Control · Mathematics 2018-06-06 Jalal Fadili , Jérôme Malick , Gabriel Peyré

Accelerated proximal gradient methods, which are also called fast iterative shrinkage-thresholding algorithms (FISTA) are known to be efficient for many applications. Recently, Tanabe et al. proposed an extension of FISTA for multiobjective…

Optimization and Control · Mathematics 2023-06-02 Yuki Nishimura , Ellen H. Fukuda , Nobuo Yamashita

We introduce FB-LISA, a forward-backward (FB) generalization of a recently proposed line-search-based stochastic gradient algorithm to address the imaging problem of volumetric reconstruction in Computed Tomography, a substantially high…

Numerical Analysis · Mathematics 2026-05-13 Tatiana A. Bubba , Elena Morotti , Federica Porta , Valeria Ruggiero , Ilaria Trombini

Many large-scale optimization problems can be expressed as composite optimization models. Accelerated first-order methods such as the fast iterative shrinkage-thresholding algorithm (FISTA) have proven effective for numerous large composite…

Optimization and Control · Mathematics 2023-08-01 Casey Garner , Shuzhong Zhang

In this paper, by using tools of second-order variational analysis, we study the popular forward-backward splitting method with Beck-Teboulle's line-search for solving convex optimization problem where the objective function can be split…

Optimization and Control · Mathematics 2018-06-19 Yunier Bello-Cruz , G. Li , T. T. A. Nghia

The so-called Forward-Forward Algorithm (FFA) has recently gained momentum as an alternative to the conventional back-propagation algorithm for neural network learning, yielding competitive performance across various modeling tasks. By…

Machine Learning · Computer Science 2025-01-10 Erik B. Terres-Escudero , Javier Del Ser , Pablo Garcia Bringas

The forward-backward splitting algorithm is a popular operator-splitting method for solving monotone inclusion of the sum of a maximal monotone operator and a cocoercive operator. In this paper, we present a new convergence analysis of a…

Functional Analysis · Mathematics 2019-08-30 Fuying Cui , Yuchao Tang , Chuanxi Zhu

One of the most popular and important first-order iterations that provides optimal complexity of the classical proximal gradient method (PGM) is the "Fast Iterative Shrinkage/Thresholding Algorithm" (FISTA). In this paper, two inexact…

Optimization and Control · Mathematics 2020-05-11 Yunier Bello-Cruz , Max L. N. Gonçalves , Nathan Krislock

We study the variable metric forward-backward splitting algorithm for convex minimization problems without the standard assumption of the Lipschitz continuity of the gradient. In this setting, we prove that, by requiring only mild…

Optimization and Control · Mathematics 2017-05-02 Saverio Salzo

The most popular first-order accelerated black-box methods for solving large-scale convex optimization problems are the Fast Gradient Method (FGM) and the Fast Iterative Shrinkage Thresholding Algorithm (FISTA). FGM requires that the…

Optimization and Control · Mathematics 2021-09-29 Mihai I. Florea , Sergiy A. Vorobyov

Inverse problems are essential to imaging applications. In this paper, we propose a model-based deep learning network, named FISTA-Net, by combining the merits of interpretability and generality of the model-based Fast Iterative…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Jinxi Xiang , Yonggui Dong , Yunjie Yang

In this paper, we revisit the class of iterative shrinkage-thresholding algorithms (ISTA) for solving the linear inverse problem with sparse representation, which arises in signal and image processing. It is shown in the numerical…

Optimization and Control · Mathematics 2023-01-18 Bowen Li , Bin Shi , Ya-xiang Yuan

We consider a combined restarting and adaptive backtracking strategy for the popular Fast Iterative Shrinking-Thresholding Algorithm frequently employed for accelerating the convergence speed of large-scale structured convex optimization…

Optimization and Control · Mathematics 2023-07-27 Jean-François Aujol , Luca Calatroni , Charles Dossal , Hippolyte Labarrière , Aude Rondepierre

FISTA is a popular convex optimisation algorithm which is known to converge at an optimal rate whenever a minimiser is contained in a suitable Hilbert space. We propose a modified algorithm where each iteration is performed in a subset…

Optimization and Control · Mathematics 2022-10-06 Antonin Chambolle , Robert Tovey

In this paper we focus on the convergence analysis of the forward-backward splitting method for solving nonsmooth optimization problems in Hilbert spaces when the objective function is the sum of two convex functions. Assuming that one of…

Optimization and Control · Mathematics 2016-10-17 J. Y. Bello Cruz , T. T. A. Nghia

The ``fast iterative shrinkage-thresholding algorithm'', a.k.a. FISTA, is one of the most widely used algorithms in the literature. However, despite its optimal theoretical $O(1/k^2)$ convergence rate guarantee, oftentimes in practice its…

Optimization and Control · Mathematics 2018-07-12 Jingwei Liang , Carola-Bibiane Schönlieb

In this note, we propose a FISTA-type first order algorithm, VAR-FISTA, to solve a composite optimization problem. A distinctive feature of VAR-FISTA is its ability to exploit the convexity of the function in the problem, resulting in an…

Optimization and Control · Mathematics 2020-08-25 Chee-Khian Sim

Convex-composite optimization, which minimizes an objective function represented by the sum of a differentiable function and a convex one, is widely used in machine learning and signal/image processing. Fast Iterative Shrinkage Thresholding…

Optimization and Control · Mathematics 2022-05-12 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita

For first-order smooth optimization, the research on the acceleration phenomenon has a long-time history. Until recently, the mechanism leading to acceleration was not successfully uncovered by the gradient correction term and its…

Optimization and Control · Mathematics 2022-11-04 Bowen Li , Bin Shi , Ya-xiang Yuan