English
Related papers

Related papers: Avoiding Communication in Proximal Methods for Con…

200 papers

This paper provides a new way of developing the fast iterative shrinkage/thresholding algorithm (FISTA) that is widely used for minimizing composite convex functions with a nonsmooth term such as the $\ell_1$ regularizer. In particular,…

Optimization and Control · Mathematics 2019-06-14 Donghwan Kim , Jeffrey A. Fessler

In this paper, we address the problem of distributed sparse recovery of signals acquired via compressed measurements in a sensor network. We propose a new class of distributed algorithms to solve Lasso regression problems, when the…

Information Theory · Computer Science 2013-10-15 Chiara Ravazzi , Sophie M. Fosson , Enrico Magli

The "fast iterative shrinkage-thresholding algorithm", a.k.a. FISTA, is one of the most well-known first-order optimisation scheme in the literature, as it achieves the worst-case $O(1/k^2)$ optimal convergence rate in terms of objective…

Optimization and Control · Mathematics 2021-01-21 Jingwei Liang , Tao Luo , Carola-Bibiane Schönlieb

Fast Iterative Shrinking-Threshold Algorithm (FISTA) is a popular fast gradient descent method (FGM) in the field of large scale convex optimization problems. However, it can exhibit undesirable periodic oscillatory behaviour in some…

Optimization and Control · Mathematics 2019-12-30 Teodoro Alamo , Pablo Krupa , Daniel Limon

In this paper, we propose a novel accelerated forward-backward splitting algorithm for minimizing convex composite functions, written as the sum of a smooth function and a (possibly) nonsmooth function. When the objective function is…

Optimization and Control · Mathematics 2025-09-19 Kansei Ushiyama

The purpose of this technical report is to review the main properties of an accelerated composite gradient (ACG) method commonly referred to as the Fast Iterative Shrinkage-Thresholding Algorithm (FISTA). In addition, we state a version of…

Optimization and Control · Mathematics 2021-07-06 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

Motivated by the limitation of analyzing oscillatory signals composed of multiple components with fast-varying instantaneous frequency, we approach the time-frequency analysis problem by optimization. Based on the proposed adaptive harmonic…

Numerical Analysis · Mathematics 2016-03-22 Matthieu Kowalski , Adrien Meynard , Hau-tieng Wu

The ``fast iterative shrinkage-thresholding algorithm'', a.k.a. FISTA, is one of the most widely used algorithms in the literature. However, despite its optimal theoretical $O(1/k^2)$ convergence rate guarantee, oftentimes in practice its…

Optimization and Control · Mathematics 2018-07-12 Jingwei Liang , Carola-Bibiane Schönlieb

One of the most popular and important first-order iterations that provides optimal complexity of the classical proximal gradient method (PGM) is the "Fast Iterative Shrinkage/Thresholding Algorithm" (FISTA). In this paper, two inexact…

Optimization and Control · Mathematics 2020-05-11 Yunier Bello-Cruz , Max L. N. Gonçalves , Nathan Krislock

In [19], a general, inexact, efficient proximal quasi-Newton algorithm for composite optimization problems has been proposed and a sublinear global convergence rate has been established. In this paper, we analyze the convergence properties…

Numerical Analysis · Computer Science 2017-10-18 Hiva Ghanbari , Katya Scheinberg

The adaptive Iterative Soft-Thresholding Algorithm (ISTA) has been a popular algorithm for finding a desirable solution to the LASSO problem without explicitly tuning the regularization parameter $\lambda$. Despite that the adaptive ISTA is…

Machine Learning · Statistics 2025-07-04 Yining Feng , Ivan Selesnick

We consider the iterative shrinkage/thresholding algorithm (ISTA) applied to a cost function composed of a data fidelity term and a penalty term. The penalty is non-convex but the concavity of the penalty is accounted for by the data…

Optimization and Control · Mathematics 2016-04-20 Ilker Bayram

We consider a variable metric and inexact version of the FISTA-type algorithm considered in (Chambolle, Pock, 2016, Calatroni, Chambolle, 2019) for the minimization of the sum of two (possibly strongly) convex functions. The proposed…

Optimization and Control · Mathematics 2021-01-12 Simone Rebegoldi , Luca Calatroni

Accelerated proximal gradient methods, which are also called fast iterative shrinkage-thresholding algorithms (FISTA) are known to be efficient for many applications. Recently, Tanabe et al. proposed an extension of FISTA for multiobjective…

Optimization and Control · Mathematics 2023-06-02 Yuki Nishimura , Ellen H. Fukuda , Nobuo Yamashita

In this note, we propose a FISTA-type first order algorithm, VAR-FISTA, to solve a composite optimization problem. A distinctive feature of VAR-FISTA is its ability to exploit the convexity of the function in the problem, resulting in an…

Optimization and Control · Mathematics 2020-08-25 Chee-Khian Sim

We consider a combined restarting and adaptive backtracking strategy for the popular Fast Iterative Shrinking-Thresholding Algorithm frequently employed for accelerating the convergence speed of large-scale structured convex optimization…

Optimization and Control · Mathematics 2023-07-27 Jean-François Aujol , Luca Calatroni , Charles Dossal , Hippolyte Labarrière , Aude Rondepierre

Sparse coding is a core building block in many data analysis and machine learning pipelines. Typically it is solved by relying on generic optimization techniques, such as the Iterative Soft Thresholding Algorithm and its accelerated version…

Machine Learning · Statistics 2017-06-06 Thomas Moreau , Joan Bruna

FISTA is a popular convex optimisation algorithm which is known to converge at an optimal rate whenever a minimiser is contained in a suitable Hilbert space. We propose a modified algorithm where each iteration is performed in a subset…

Optimization and Control · Mathematics 2022-10-06 Antonin Chambolle , Robert Tovey

In this note, we consider a special instance of the scaled, inexact and adaptive generalised Fast Iterative Soft-Thresholding Algorithm (SAGE-FISTA) recently proposed in (Rebegoldi, Calatroni, '21) for the efficient solution of strongly…

Optimization and Control · Mathematics 2021-04-02 Luca Calatroni , Simone Rebegoldi

Compressed sensing has shown great potentials in accelerating magnetic resonance imaging. Fast image reconstruction and high image quality are two main issues faced by this new technology. It has been shown that, redundant image…

Medical Physics · Physics 2016-01-27 Yunsong Liu , Zhifang Zhan , Jian-Feng Cai , Di Guo , Zhong Chen , Xiaobo Qu
‹ Prev 1 2 3 10 Next ›