English
Related papers

Related papers: Projected Iterative Soft-thresholding Algorithm fo…

200 papers

In this paper, we propose a novel accelerated forward-backward splitting algorithm for minimizing convex composite functions, written as the sum of a smooth function and a (possibly) nonsmooth function. When the objective function is…

Optimization and Control · Mathematics 2025-09-19 Kansei Ushiyama

Leveraging Transformer attention has led to great advancements in HDR deghosting. However, the intricate nature of self-attention introduces practical challenges, as existing state-of-the-art methods often demand high-end GPUs or exhibit…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Xiaoning Liu , Ao Li , Zongwei Wu , Yapeng Du , Le Zhang , Yulun Zhang , Radu Timofte , Ce Zhu

Fast Iterative Shrinking-Threshold Algorithm (FISTA) is a popular fast gradient descent method (FGM) in the field of large scale convex optimization problems. However, it can exhibit undesirable periodic oscillatory behaviour in some…

Optimization and Control · Mathematics 2019-12-30 Teodoro Alamo , Pablo Krupa , Daniel Limon

We propose a new iterative greedy algorithm for reconstructions of sparse signals with or without noisy perturbations in compressed sensing. The proposed algorithm, called \emph{subspace thresholding pursuit} (STP) in this paper, is a…

Information Theory · Computer Science 2014-05-22 Chao-Bing Song , Shu-Tao Xia , Xin-Ji Liu

Convex-composite optimization, which minimizes an objective function represented by the sum of a differentiable function and a convex one, is widely used in machine learning and signal/image processing. Fast Iterative Shrinkage Thresholding…

Optimization and Control · Mathematics 2022-05-12 Hiroki Tanabe , Ellen H. Fukuda , Nobuo Yamashita

By integrating certain optimization solvers with deep neural network, deep unfolding network (DUN) has attracted much attention in recent years for image compressed sensing (CS). However, there still exist several issues in existing DUNs:…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Wenxue Cui , Shaohui Liu , Debin Zhao

Accelerated proximal gradient methods, which are also called fast iterative shrinkage-thresholding algorithms (FISTA) are known to be efficient for many applications. Recently, Tanabe et al. proposed an extension of FISTA for multiobjective…

Optimization and Control · Mathematics 2023-06-02 Yuki Nishimura , Ellen H. Fukuda , Nobuo Yamashita

One of the most popular and important first-order iterations that provides optimal complexity of the classical proximal gradient method (PGM) is the "Fast Iterative Shrinkage/Thresholding Algorithm" (FISTA). In this paper, two inexact…

Optimization and Control · Mathematics 2020-05-11 Yunier Bello-Cruz , Max L. N. Gonçalves , Nathan Krislock

The iterative weighted shrinkage-thresholding algorithm (IWSTA) has shown superiority to the classic unweighted iterative shrinkage-thresholding algorithm (ISTA) for solving linear inverse problems, which address the attributes differently.…

Computer Vision and Pattern Recognition · Computer Science 2021-12-23 Bingxue Wu , Jiao Wei , Chen Li , Yudong Yao , Yueyang Teng

With modern defense applications increasingly relying on inexpensive, autonomous drones, lies the major challenge of designing computationally and memory-efficient onboard algorithms to fulfill mission objectives. This challenge is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Conor Flynn , Radoslav Ivanov , Birsen Yazici

Sparse coding is a core building block in many data analysis and machine learning pipelines. Typically it is solved by relying on generic optimization techniques, such as the Iterative Soft Thresholding Algorithm and its accelerated version…

Machine Learning · Statistics 2017-06-06 Thomas Moreau , Joan Bruna

We consider the problem of finding a sparse solution for an underdetermined linear system of equations when the known parameters on both sides of the system are subject to perturbation. This problem is particularly relevant to…

Systems and Control · Computer Science 2016-06-16 Reza Arablouei

Iterative Hard Thresholding (IHT) is a class of projected gradient descent methods for optimizing sparsity-constrained minimization models, with the best known efficiency and scalability in practice. As far as we know, the existing…

Machine Learning · Computer Science 2017-06-22 Bo Liu , Xiao-Tong Yuan , Lezi Wang , Qingshan Liu , Dimitris N. Metaxas

In this report, a novel efficient algorithm for recovery of jointly sparse signals (sparse matrix) from multiple incomplete measurements has been presented, in particular, the NESTA-based MMV optimization method. In a nutshell, the jointly…

Information Theory · Computer Science 2009-05-21 Lianlin Li , Fang Li

Sparse principal component analysis (PCA), an important variant of PCA, attempts to find sparse loading vectors when conducting dimension reduction. This paper considers the nonsmooth Riemannian optimization problem associated with the…

Optimization and Control · Mathematics 2021-09-03 Wen Huang , Ke Wei

Image super-resolution (SR) has witnessed extensive neural network designs from CNN to transformer architectures. However, prevailing SR models suffer from prohibitive memory footprint and intensive computations, which limits further…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Jiamian Wang , Huan Wang , Yulun Zhang , Yun Fu , Zhiqiang Tao

There exist many well-established techniques to recover sparse signals from compressed measurements with known performance guarantees in the static case. However, only a few methods have been proposed to tackle the recovery of time-varying…

Dynamical Systems · Mathematics 2023-07-19 Aurele Balavoine , Christopher J. Rozell , Justin Romberg

This paper presents a multilevel FISTA algorithm, based on the use of the Moreau envelope to build the correction brought by the coarse models, which is easy to compute when the explicit form of the proximal operator of the considered…

Optimization and Control · Mathematics 2022-10-31 Guillaume Lauga , Elisa Riccietti , Nelly Pustelnik , Paulo Gonçalves

Time-frequency distributions (TFDs) play a vital role in providing descriptive analysis of non-stationary signals involved in realistic scenarios. It is well known that low time-frequency (TF) resolution and the emergency of cross-terms…

Signal Processing · Electrical Eng. & Systems 2020-05-01 Lei Jiang , Haijian Zhang , Lei Yu

Accurate signal recovery or image reconstruction from indirect and possibly undersampled data is a topic of considerable interest; for example, the literature in the recent field of compressed sensing is already quite immense. Inspired by…

Optimization and Control · Mathematics 2011-04-15 Stephen Becker , Jerome Bobin , Emmanuel Candes