English
Related papers

Related papers: Learned Interpretable Residual Extragradient ISTA …

200 papers

Most existing sparse representation-based approaches for attributed scattering center (ASC) extraction adopt traditional iterative optimization algorithms, which suffer from lengthy computation times and limited precision. This paper…

Signal Processing · Electrical Eng. & Systems 2024-05-16 Haodong Yang , Zhe Zhang , Zhongling Huang

With the aim of developing a fast yet accurate algorithm for compressive sensing (CS) reconstruction of natural images, we combine in this paper the merits of two existing categories of CS methods: the structure insights of traditional…

Computer Vision and Pattern Recognition · Computer Science 2018-06-19 Jian Zhang , Bernard Ghanem

In this paper, we revisit the class of iterative shrinkage-thresholding algorithms (ISTA) for solving the linear inverse problem with sparse representation, which arises in signal and image processing. It is shown in the numerical…

Optimization and Control · Mathematics 2023-01-18 Bowen Li , Bin Shi , Ya-xiang Yuan

Recently, the paradigm of unfolding iterative algorithms into finite-length feed-forward neural networks has achieved a great success in the area of sparse recovery. Benefit from available training data, the learned networks have achieved…

Machine Learning · Computer Science 2019-10-14 Yulun Jiang , Lei Yu , Haijian Zhang , Zhou Liu

We present a semi-unified sparse dictionary learning framework that bridges the gap between classical sparse models and modern deep architectures. Specifically, the method integrates strict Top-$K$ LISTA and its convex FISTA-based variant…

Machine Learning · Computer Science 2025-11-14 Fengsheng Lin , Shengyi Yan , Trac Duy Tran

Sparse coding is a core building block in many data analysis and machine learning pipelines. Typically it is solved by relying on generic optimization techniques, such as the Iterative Soft Thresholding Algorithm and its accelerated version…

Machine Learning · Statistics 2017-06-06 Thomas Moreau , Joan Bruna

The Extreme Learning Machine (ELM) technique is a machine learning approach for constructing feed-forward neural networks with a single hidden layer and their models. The ELM model can be constructed while being trained by concurrently…

Optimization and Control · Mathematics 2024-01-30 Muideen Adegoke , Lateef O. Jolaoso , Mardiyyah Oduwole

We study $\ell^1$ regularized least squares optimization problem in a separable Hilbert space. We show that the iterative soft-thresholding algorithm (ISTA) converges linearly, without making any assumption on the linear operator into play…

Optimization and Control · Mathematics 2017-12-04 Guillaume Garrigos , Lorenzo Rosasco , Silvia Villa

Solving inverse problems with iterative algorithms is popular, especially for large data. Due to time constraints, the number of possible iterations is usually limited, potentially affecting the achievable accuracy. Given an error one is…

Numerical Analysis · Computer Science 2018-02-16 Raja Giryes , Yonina C. Eldar , Alex M. Bronstein , Guillermo Sapiro

In this paper, we consider an LQR design problem for distributed control systems. For large-scale distributed systems, finding a solution might be computationally demanding due to communications among agents. To this aim, we deal with LQR…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-09-02 Myung Cho

The problem of phase retrieval (PR) involves recovering an unknown image from limited amplitude measurement data and is a challenge nonlinear inverse problem in computational imaging and image processing. However, many of the PR methods are…

Computer Vision and Pattern Recognition · Computer Science 2023-09-11 Aoxu Liu , Xiaohong Fan , Yin Yang , Jianping Zhang

The L1-regularized maximum likelihood estimation problem has recently become a topic of great interest within the machine learning, statistics, and optimization communities as a method for producing sparse inverse covariance estimators. In…

Computation · Statistics 2012-11-28 Dominique Guillot , Bala Rajaratnam , Benjamin T. Rolfs , Arian Maleki , Ian Wong

Tomographic SAR technique has attracted remarkable interest for its ability of three-dimensional resolving along the elevation direction via a stack of SAR images collected from different cross-track angles. The emerged compressed sensing…

Signal Processing · Electrical Eng. & Systems 2023-07-19 Muhan Wang , Zhe Zhang , Xiaolan Qiu , Silin Gao , Yue Wang

Finding the sparset solution of an underdetermined system of linear equations $y=Ax$ has attracted considerable attention in recent years. Among a large number of algorithms, iterative thresholding algorithms are recognized as one of the…

Information Theory · Computer Science 2013-10-16 Jinshan Zeng , Shaobo Lin , Zongben Xu

In statistics, the least absolute shrinkage and selection operator (Lasso) is a regression method that performs both variable selection and regularization. There is a lot of literature available, discussing the statistical properties of the…

Computation · Statistics 2023-03-08 Yujie Zhao , Xiaoming Huo

The adaptive Iterative Soft-Thresholding Algorithm (ISTA) has been a popular algorithm for finding a desirable solution to the LASSO problem without explicitly tuning the regularization parameter $\lambda$. Despite that the adaptive ISTA is…

Machine Learning · Statistics 2025-07-04 Yining Feng , Ivan Selesnick

Compressed sensing has shown great potentials in accelerating magnetic resonance imaging. Fast image reconstruction and high image quality are two main issues faced by this new technology. It has been shown that, redundant image…

Medical Physics · Physics 2016-01-27 Yunsong Liu , Zhifang Zhan , Jian-Feng Cai , Di Guo , Zhong Chen , Xiaobo Qu

Inverse problems are essential to imaging applications. In this paper, we propose a model-based deep learning network, named FISTA-Net, by combining the merits of interpretability and generality of the model-based Fast Iterative…

Image and Video Processing · Electrical Eng. & Systems 2021-01-26 Jinxi Xiang , Yonggui Dong , Yunjie Yang

Soft threshold pruning is among the cutting-edge pruning methods with state-of-the-art performance. However, previous methods either perform aimless searching on the threshold scheduler or simply set the threshold trainable, lacking…

Machine Learning · Computer Science 2023-02-28 Yanqi Chen , Zhengyu Ma , Wei Fang , Xiawu Zheng , Zhaofei Yu , Yonghong Tian

We propose a simple yet effective model for Single Image Super-Resolution (SISR), by combining the merits of Residual Learning and Convolutional Sparse Coding (RL-CSC). Our model is inspired by the Learned Iterative Shrinkage-Threshold…

Computer Vision and Pattern Recognition · Computer Science 2019-01-01 Menglei Zhang , Zhou Liu , Lei Yu