English
Related papers

Related papers: FISTA-Net: Learning A Fast Iterative Shrinkage Thr…

200 papers

The design of novel algorithms for solving inverse problems in signal processing is an incredibly difficult, heuristic-driven, and time-consuming task. In this short paper, we the idea of automated algorithm discovery in the signal…

Machine Learning · Computer Science 2025-12-29 Patrick Yubeaton , Sarthak Gupta , M. Salman Asif , Chinmay Hegde

Variational methods are widely applied to ill-posed inverse problems for they have the ability to embed prior knowledge about the solution. However, the level of performance of these methods significantly depends on a set of parameters,…

Optimization and Control · Mathematics 2020-01-23 Carla Bertocchi , Emilie Chouzenoux , Marie-Caroline Corbineau , Jean-Christophe Pesquet , Marco Prato

In recent years, unfolding iterative algorithms as neural networks has become an empirical success in solving sparse recovery problems. However, its theoretical understanding is still immature, which prevents us from fully utilizing the…

Machine Learning · Computer Science 2018-11-06 Xiaohan Chen , Jialin Liu , Zhangyang Wang , Wotao Yin

We address the problem of reconstructing sparse signals from noisy and compressive measurements using a feed-forward deep neural network (DNN) with an architecture motivated by the iterative shrinkage-thresholding algorithm (ISTA). We…

Machine Learning · Computer Science 2017-05-23 Debabrata Mahapatra , Subhadip Mukherjee , Chandra Sekhar Seelamantula

The ``fast iterative shrinkage-thresholding algorithm'', a.k.a. FISTA, is one of the most widely used algorithms in the literature. However, despite its optimal theoretical $O(1/k^2)$ convergence rate guarantee, oftentimes in practice its…

Optimization and Control · Mathematics 2018-07-12 Jingwei Liang , Carola-Bibiane Schönlieb

Solving inverse problems is a fundamental component of science, engineering and mathematics. With the advent of deep learning, deep neural networks have significant potential to outperform existing state-of-the-art, model-based methods for…

Machine Learning · Computer Science 2022-12-22 Maksym Neyra-Nesterenko , Ben Adcock

Accelerated proximal gradient methods, which are also called fast iterative shrinkage-thresholding algorithms (FISTA) are known to be efficient for many applications. Recently, Tanabe et al. proposed an extension of FISTA for multiobjective…

Optimization and Control · Mathematics 2023-06-02 Yuki Nishimura , Ellen H. Fukuda , Nobuo Yamashita

Complex-field signal recovery problems from noisy linear/nonlinear measurements appear in many areas of signal processing and wireless communications. In this paper, we propose a trainable iterative signal recovery algorithm named…

Information Theory · Computer Science 2019-10-18 Satoshi Takabe , Tadashi Wadayama , Yonina C. Eldar

The optimization inspired network can bridge convex optimization and neural networks in Compressive Sensing (CS) reconstruction of natural image, like ISTA-Net+, which mapping optimization algorithm: iterative shrinkage-thresholding…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Nanyu Li , Cuiyin Liu

The idea of unfolding iterative algorithms as deep neural networks has been widely applied in solving sparse coding problems, providing both solid theoretical analysis in convergence rate and superior empirical performance. However, for…

Machine Learning · Computer Science 2020-10-27 Yuhai Song , Zhong Cao , Kailun Wu , Ziang Yan , Changshui Zhang

One of the most popular and important first-order iterations that provides optimal complexity of the classical proximal gradient method (PGM) is the "Fast Iterative Shrinkage/Thresholding Algorithm" (FISTA). In this paper, two inexact…

Optimization and Control · Mathematics 2020-05-11 Yunier Bello-Cruz , Max L. N. Gonçalves , Nathan Krislock

Multi-task learning aims to boost the generalization performance of multiple related tasks simultaneously by leveraging information contained in those tasks. In this paper, we propose a multi-task learning framework, where we utilize prior…

Machine Learning · Computer Science 2023-01-05 Mengyuan Zhang , Kai Liu

Soft threshold pruning is among the cutting-edge pruning methods with state-of-the-art performance. However, previous methods either perform aimless searching on the threshold scheduler or simply set the threshold trainable, lacking…

Machine Learning · Computer Science 2023-02-28 Yanqi Chen , Zhengyu Ma , Wei Fang , Xiawu Zheng , Zhaofei Yu , Yonghong Tian

Compressed sensing has shown great potentials in accelerating magnetic resonance imaging. Fast image reconstruction and high image quality are two main issues faced by this new technology. It has been shown that, redundant image…

Medical Physics · Physics 2016-01-27 Yunsong Liu , Zhifang Zhan , Jian-Feng Cai , Di Guo , Zhong Chen , Xiaobo Qu

Single-pixel imaging (SPI) is a promising imaging modality with distinctive advantages in strongly perturbed environments. Existing SPI methods lack physical sparsity constraints and overlook the integration of local and global features,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Jijun Lu , Yifan Chen , Libang Chen , Yiqiang Zhou , Ye Zheng , Mingliang Chen , Zhe Sun , Xuelong Li

Introduced by Beck and Teboulle, FISTA (for Fast Iterative Shrinkage-Thresholding Algorithm) is a first-order method widely used in convex optimization. Adapted from Nesterov's accelerated gradient method for convex functions, the generated…

Optimization and Control · Mathematics 2024-07-25 Jean-François Aujol , Charles Dossal , Hippolyte Labarrière , Aude Rondepierre

We propose a deep network that can be trained to tackle image reconstruction and classification problems that involve detection of multiple object instances, without any supervision regarding their whereabouts. The network learns to extract…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Baptiste Angles , Yuhe Jin , Simon Kornblith , Andrea Tagliasacchi , Kwang Moo Yi

A significant milestone in modern gradient-based optimization was achieved with the development of Nesterov's accelerated gradient descent (NAG) method. This forward-backward technique has been further advanced with the introduction of its…

Optimization and Control · Mathematics 2024-04-10 Bowen Li , Bin Shi , Ya-xiang Yuan

In this paper, we propose an efficient numerical scheme for solving some large scale ill-posed linear inverse problems arising from image restoration. In order to accelerate the computation, two different hidden structures are exploited.…

Numerical Analysis · Mathematics 2024-12-20 Zixuan Chen , James Nagy , Yuanzhe Xi , Bo Yu

Recently, many forms of audio industrial applications, such as sound monitoring and source localization, have begun exploiting smart multi-modal devices equipped with a microphone array. Regrettably, model-based methods are often difficult…

Sound · Computer Science 2023-06-21 Hao Liang , Guanxing Zhou , Xiaotong Tu , Andreas Jakobsson , Xinghao Ding , Yue Huang