English
Related papers

Related papers: Discovering Sparse Recovery Algorithms Using Neura…

200 papers

The linear inverse problem emerges from various real-world applications such as Image deblurring, inpainting, etc., which are still thrust research areas for image quality improvement. In this paper, we have introduced a new algorithm…

Signal Processing · Electrical Eng. & Systems 2022-11-29 Avinash Kumar , Sujit Kumar Sahoo

Sparse coding is a core building block in many data analysis and machine learning pipelines. Typically it is solved by relying on generic optimization techniques, such as the Iterative Soft Thresholding Algorithm and its accelerated version…

Machine Learning · Statistics 2017-06-06 Thomas Moreau , Joan Bruna

This paper investigates the impact of loss function selection in deep unfolding techniques for sparse signal recovery algorithms. Deep unfolding transforms iterative optimization algorithms into trainable lightweight neural networks by…

Signal Processing · Electrical Eng. & Systems 2026-04-24 Koshi Nagahisa , Ryo Hayakawa , Youji Iiguni

This paper provides a new way of developing the fast iterative shrinkage/thresholding algorithm (FISTA) that is widely used for minimizing composite convex functions with a nonsmooth term such as the $\ell_1$ regularizer. In particular,…

Optimization and Control · Mathematics 2019-06-14 Donghwan Kim , Jeffrey A. Fessler

We consider the iterative shrinkage/thresholding algorithm (ISTA) applied to a cost function composed of a data fidelity term and a penalty term. The penalty is non-convex but the concavity of the penalty is accounted for by the data…

Optimization and Control · Mathematics 2016-04-20 Ilker Bayram

With modern defense applications increasingly relying on inexpensive, autonomous drones, lies the major challenge of designing computationally and memory-efficient onboard algorithms to fulfill mission objectives. This challenge is…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Conor Flynn , Radoslav Ivanov , Birsen Yazici

Soft threshold pruning is among the cutting-edge pruning methods with state-of-the-art performance. However, previous methods either perform aimless searching on the threshold scheduler or simply set the threshold trainable, lacking…

Machine Learning · Computer Science 2023-02-28 Yanqi Chen , Zhengyu Ma , Wei Fang , Xiawu Zheng , Zhaofei Yu , Yonghong Tian

Solving inverse problems with iterative algorithms is popular, especially for large data. Due to time constraints, the number of possible iterations is usually limited, potentially affecting the achievable accuracy. Given an error one is…

Numerical Analysis · Computer Science 2018-02-16 Raja Giryes , Yonina C. Eldar , Alex M. Bronstein , Guillermo Sapiro

The purpose of this technical report is to review the main properties of an accelerated composite gradient (ACG) method commonly referred to as the Fast Iterative Shrinkage-Thresholding Algorithm (FISTA). In addition, we state a version of…

Optimization and Control · Mathematics 2021-07-06 Weiwei Kong , Jefferson G. Melo , Renato D. C. Monteiro

The ``fast iterative shrinkage-thresholding algorithm'', a.k.a. FISTA, is one of the most widely used algorithms in the literature. However, despite its optimal theoretical $O(1/k^2)$ convergence rate guarantee, oftentimes in practice its…

Optimization and Control · Mathematics 2018-07-12 Jingwei Liang , Carola-Bibiane Schönlieb

There exist many well-established techniques to recover sparse signals from compressed measurements with known performance guarantees in the static case. However, only a few methods have been proposed to tackle the recovery of time-varying…

Dynamical Systems · Mathematics 2023-07-19 Aurele Balavoine , Christopher J. Rozell , Justin Romberg

This paper introduces a novel framework for physics-aware sparse signal recovery in measurement systems governed by partial differential equations (PDEs). Unlike conventional compressed sensing approaches that treat measurement systems as…

Information Theory · Computer Science 2025-10-09 Tadashi Wadayama , Koji Igarashi , Takumi Takahashi

AS-ISTA (Architecture Searched-Iterative Shrinkage Thresholding Algorithm) and AS-FISTA (AS-Fast ISTA) are compressed sensing algorithms introducing structural parameters to ISTA and FISTA to enable architecture search within the iterative…

Signal Processing · Electrical Eng. & Systems 2026-02-17 Ayano Nakai-Kasai , Yusuke Nakane , Tadashi Wadayama

Drawing on theoretical insights, we advocate an error-based thresholding (EBT) mechanism for learned ISTA (LISTA), which utilizes a function of the layer-wise reconstruction error to suggest a specific threshold for each observation in the…

Machine Learning · Computer Science 2023-12-20 Ziang Li , Kailun Wu , Yiwen Guo , Changshui Zhang

In this paper, we propose an efficient numerical scheme for solving some large scale ill-posed linear inverse problems arising from image restoration. In order to accelerate the computation, two different hidden structures are exploited.…

Numerical Analysis · Mathematics 2024-12-20 Zixuan Chen , James Nagy , Yuanzhe Xi , Bo Yu

Learned Iterative Shrinkage-Thresholding Algorithm (LISTA) introduces the concept of unrolling an iterative algorithm and training it like a neural network. It has had great success on sparse recovery. In this paper, we show that adding…

Machine Learning · Computer Science 2021-11-01 Xiaohan Chen , Jialin Liu , Zhangyang Wang , Wotao Yin

Sparse signal recovery is one of the most fundamental problems in various applications, including medical imaging and remote sensing. Many greedy algorithms based on the family of hard thresholding operators have been developed to solve the…

Signal Processing · Electrical Eng. & Systems 2023-06-09 Rachel Grotheer , Shuang Li , Anna Ma , Deanna Needell , Jing Qin

Accurate signal recovery or image reconstruction from indirect and possibly undersampled data is a topic of considerable interest; for example, the literature in the recent field of compressed sensing is already quite immense. Inspired by…

Optimization and Control · Mathematics 2011-04-15 Stephen Becker , Jerome Bobin , Emmanuel Candes

The problem of phase retrieval (PR) involves recovering an unknown image from limited amplitude measurement data and is a challenge nonlinear inverse problem in computational imaging and image processing. However, many of the PR methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Aoxu Liu , Xiaohong Fan , Yin Yang , Jianping Zhang

Various iterative reconstruction algorithms for inverse problems can be unfolded as neural networks. Empirically, this approach has often led to improved results, but theoretical guarantees are still scarce. While some progress on…

Statistics Theory · Mathematics 2021-08-16 Arash Behboodi , Holger Rauhut , Ekkehard Schnoor