English
Related papers

Related papers: Enhanced Fast Iterative Shrinkage Thresholding Alg…

200 papers

We study $\ell^1$ regularized least squares optimization problem in a separable Hilbert space. We show that the iterative soft-thresholding algorithm (ISTA) converges linearly, without making any assumption on the linear operator into play…

Optimization and Control · Mathematics 2017-12-04 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

The adaptive Iterative Soft-Thresholding Algorithm (ISTA) has been a popular algorithm for finding a desirable solution to the LASSO problem without explicitly tuning the regularization parameter $\lambda$. Despite that the adaptive ISTA is…

Machine Learning · Statistics 2025-07-04 Yining Feng , Ivan Selesnick

We consider the constrained Linear Inverse Problem (LIP), where a certain atomic norm (like the $\ell_1 $ norm) is minimized subject to a quadratic constraint. Typically, such cost functions are non-differentiable, which makes them not…

Optimization and Control · Mathematics 2025-07-08 Mohammed Rayyan Sheriff , Floor Fenne Redel , Peyman Mohajerin Esfahani

Many computer vision and image processing applications rely on local features. It is well-known that motion blur decreases the performance of traditional feature detectors and descriptors. We propose an inertial-based deblurring method for…

Computer Vision and Pattern Recognition · Computer Science 2018-05-23 Janne Mustaniemi , Juho Kannala , Simo Särkkä , Jiri Matas , Janne Heikkilä

Multi-task learning aims to boost the generalization performance of multiple related tasks simultaneously by leveraging information contained in those tasks. In this paper, we propose a multi-task learning framework, where we utilize prior…

Machine Learning · Computer Science 2023-01-05 Mengyuan Zhang , Kai Liu

In this paper, we conduct a theoretical and numerical study of the Fast Iterative Shrinkage-Thresholding Algorithm (FISTA) under strong convexity assumptions. We propose an autonomous Lyapunov function that reflects the strong convexity of…

Optimization and Control · Mathematics 2025-06-16 Luis M. Briceño-Arias

Iterative refinement (IR) is a popular scheme for solving a linear system of equations based on gradually improving the accuracy of an initial approximation. Originally developed to improve upon the accuracy of Gaussian elimination,…

Numerical Analysis · Mathematics 2025-06-24 Chai Wah Wu , Mark S. Squillante , Vasileios Kalantzis , Lior Horesh

In recent years, large convolutional neural networks have been widely used as tools for image deblurring, because of their ability in restoring images very precisely. It is well known that image deblurring is mathematically modeled as an…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Davide Evangelista , Elena Morotti , Elena Loli Piccolomini , James Nagy

The "Inertial Forward-Backward algorithm" (IFB) is a powerful tool for convex nonsmooth minimization problems, it gives the well known "fast iterative shrinkage-thresholding algorithm " (FISTA), which enjoys $O\left( {\frac{1}{{{k^2}}}}…

Optimization and Control · Mathematics 2022-02-25 Hongwei Liu , Ting Wang , Zexian Liu

Variational regularization of ill-posed inverse problems is based on minimizing the sum of a data fidelity term and a regularization term. The balance between them is tuned using a positive regularization parameter, whose automatic choice…

Numerical Analysis · Mathematics 2025-11-12 Markus Juvonen , Bjørn Jensen , Ilmari Pohjola , Yiqiu Dong , Samuli Siltanen

Soft threshold pruning is among the cutting-edge pruning methods with state-of-the-art performance. However, previous methods either perform aimless searching on the threshold scheduler or simply set the threshold trainable, lacking…

Machine Learning · Computer Science 2023-02-28 Yanqi Chen , Zhengyu Ma , Wei Fang , Xiawu Zheng , Zhaofei Yu , Yonghong Tian

Removing noise from images is a challenging and fundamental problem in the field of computer vision. Images captured by modern cameras are inevitably degraded by noise which limits the accuracy of any quantitative measurements on those…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Nikhil Verma , Deepkamal Kaur , Lydia Chau

In this paper we present a bilevel optimization scheme for the solution of a general image deblurring problem, in which a parametric variational-like approach is encapsulated within a machine learning scheme to provide a high quality…

Image and Video Processing · Electrical Eng. & Systems 2022-10-20 Silvia Bonettini , Giorgia Franchini , Danilo Pezzi , Marco Prato

This paper presents a multilevel framework for inertial and inexact proximal algorithms, that encompasses multilevel versions of classical algorithms such as forward-backward and FISTA. The methods are supported by strong theoretical…

Optimization and Control · Mathematics 2024-04-03 Guillaume Lauga , Elisa Riccietti , Nelly Pustelnik , Paulo Gonçalves

Euler's Elastica based unsupervised segmentation models have strong capability of completing the missing boundaries for existing objects in a clean image, but they are not working well for noisy images. This paper aims to establish a…

Computer Vision and Pattern Recognition · Computer Science 2019-02-21 Lu Tan , Ling Li , Wanquan Liu , Jie Sun , Min Zhang

We consider a combined restarting and adaptive backtracking strategy for the popular Fast Iterative Shrinking-Thresholding Algorithm frequently employed for accelerating the convergence speed of large-scale structured convex optimization…

Optimization and Control · Mathematics 2023-07-27 Jean-François Aujol , Luca Calatroni , Charles Dossal , Hippolyte Labarrière , Aude Rondepierre

In this paper, we propose two algorithms for solving linear inverse problems when the observations are corrupted by noise. A proper data fidelity term (log-likelihood) is introduced to reflect the statistics of the noise (e.g. Gaussian,…

Applications · Statistics 2011-03-14 François-Xavier Dupé , Jalal Fadili , Jean-Luc Starck

We propose an unrolled algorithm approach for learning spatially adaptive parameter maps in the framework of convolutional synthesis-based $\ell_1$ regularization. More precisely, we consider a family of pre-trained convolutional filters…

Machine Learning · Computer Science 2025-10-23 Andreas Kofler , Luca Calatroni , Christoph Kolbitsch , Kostas Papafitsoros

The L1-regularized maximum likelihood estimation problem has recently become a topic of great interest within the machine learning, statistics, and optimization communities as a method for producing sparse inverse covariance estimators. In…

Computation · Statistics 2012-11-28 Dominique Guillot , Bala Rajaratnam , Benjamin T. Rolfs , Arian Maleki , Ian Wong

By integrating certain optimization solvers with deep neural network, deep unfolding network (DUN) has attracted much attention in recent years for image compressed sensing (CS). However, there still exist several issues in existing DUNs:…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Wenxue Cui , Shaohui Liu , Debin Zhao