English
Related papers

Related papers: Iteratively re-weighted least squares minimization…

200 papers

Compressed sensing (CS) demonstrates that a sparse, or compressible signal can be acquired using a low rate acquisition process below the Nyquist rate, which projects the signal onto a small set of vectors incoherent with the sparsity…

Information Theory · Computer Science 2014-02-25 Yuli Sun , Jinxu Tao

The task of predicting missing entries of a matrix, from a subset of known entries, is known as \textit{matrix completion}. In today's data-driven world, data completion is essential whether it is the main goal or a pre-processing step.…

Numerical Analysis · Mathematics 2021-05-18 Henry Adams , Lara Kassab , Deanna Needell

Model selection and sparse recovery are two important problems for which many regularization methods have been proposed. We study the properties of regularization methods in both problems under the unified framework of regularized least…

Statistics Theory · Mathematics 2009-09-03 Jinchi Lv , Yingying Fan

We present improved sampling complexity bounds for stable and robust sparse recovery in compressed sensing. Our unified analysis based on l1 minimization encompasses the case where (i) the measurements are block-structured samples in order…

Information Theory · Computer Science 2020-05-22 Ben Adcock , Claire Boyer , Simone Brugiapaglia

As enjoying the closed form solution, least squares support vector machine (LSSVM) has been widely used for classification and regression problems having the comparable performance with other types of SVMs. However, LSSVM has two drawbacks:…

Machine Learning · Computer Science 2017-02-08 Li Chen , Shuisheng Zhou

We propose a version of least-mean-square (LMS) algorithm for sparse system identification. Our algorithm called online linearized Bregman iteration (OLBI) is derived from minimizing the cumulative prediction error squared along with an…

Information Theory · Computer Science 2012-10-03 Tao Hu , Dmitri B. Chklovskii

Affine sum-of-ranks minimization (ASRM) generalizes the affine rank minimization (ARM) problem from matrices to tensors. Here, the interest lies in the ranks of a family $\mathcal{K}$ of different matricizations. Transferring our priorly…

Numerical Analysis · Mathematics 2021-06-30 Sebastian Krämer

A major challenge in computed tomography (CT) is to reduce X-ray dose to a low or even ultra-low level while maintaining the high quality of reconstructed images. We propose a new method for CT reconstruction that combines penalized…

Machine Learning · Statistics 2017-07-11 Xuehang Zheng , Zening Lu , Saiprasad Ravishankar , Yong Long , Jeffrey A. Fessler

This paper presents a novel hybrid algorithm for minimizing the sum of a continuously differentiable loss function and a nonsmooth, possibly nonconvex, sparse regularization function. The proposed method alternates between solving a…

Optimization and Control · Mathematics 2025-04-01 Hao Wang , Xiangyu Yang , Yichen Zhu

Sparse model estimation is a topic of high importance in modern data analysis due to the increasing availability of data sets with a large number of variables. Another common problem in applied statistics is the presence of outliers in the…

Applications · Statistics 2025-02-03 Andreas Alfons , Christophe Croux , Sarah Gelper

Iteratively reweighted $\ell_1$ algorithm is a popular algorithm for solving a large class of optimization problems whose objective is the sum of a Lipschitz differentiable loss function and a possibly nonconvex sparsity inducing…

Optimization and Control · Mathematics 2017-11-21 Peiran Yu , Ting Kei Pong

Wave equation techniques have been an integral part of geophysical imaging workflows to investigate the Earth's subsurface. Least-squares reverse time migration (LSRTM) is a linearized inversion problem that iteratively minimizes a misfit…

Computational Physics · Physics 2019-12-11 Janaki Vamaraju , Jeremy Vila , Mauricio Araya-Polo , Debanjan Datta , Mohamed Sidahmed , Mrinal Sen

We present an iterative support shrinking algorithm for $\ell_{p}$-$\ell_{q}$ minimization~($0 <p < 1 \leq q < \infty $). This algorithm guarantees the nonexpensiveness of the signal support set and can be easily implemented after being…

Numerical Analysis · Mathematics 2018-01-31 Zhifang Liu , Yanan Zhao , Chunlin Wu

We consider solving the $\ell_1$-regularized least-squares ($\ell_1$-LS) problem in the context of sparse recovery, for applications such as compressed sensing. The standard proximal gradient method, also known as iterative…

Optimization and Control · Mathematics 2012-03-15 Lin Xiao , Tong Zhang

The 2D phase unwrapping problem seeks to recover a phase image from its observation modulo 2$\pi$, and is a crucial step in a variety of imaging applications. In particular, it is one of the most time-consuming steps in the interferometric…

Optimization and Control · Mathematics 2024-01-19 Benjamin Dubois-Taine , Roland Akiki , Alexandre d'Aspremont

Numerical experiments in literature on compressed sensing have indicated that the reweighted $l_1$ minimization performs exceptionally well in recovering sparse signal. In this paper, we develop exact recovery conditions and algorithm for…

Information Theory · Computer Science 2014-06-17 Shenglong Zhou , Naihua Xiu , Yingnan Wang , Lingchen Kong

An iterative method LSMR is presented for solving linear systems $Ax=b$ and least-squares problem $\min \norm{Ax-b}_2$, with $A$ being sparse or a fast linear operator. LSMR is based on the Golub-Kahan bidiagonalization process. It is…

Mathematical Software · Computer Science 2012-01-25 David Fong , Michael Saunders

The development of computed tomography (CT) image reconstruction methods that significantly reduce patient radiation exposure while maintaining high image quality is an important area of research in low-dose CT (LDCT) imaging. We propose a…

Machine Learning · Statistics 2019-06-14 Xuehang Zheng , Saiprasad Ravishankar , Yong Long , Jeffrey A. Fessler

Performance analysis of $l_0$ norm constrained Recursive least Squares (RLS) algorithm is attempted in this paper. Though the performance pretty attractive compared to its various alternatives, no thorough study of theoretical analysis has…

Information Theory · Computer Science 2016-02-11 Samrat Mukhopadhyay , Bijit Kumar Das , Mrityunjoy Chakraborty

Image smoothing is by reducing pixel-wise gradients to smooth out details. As existing methods always rely on gradients to determine smoothing manners, it is difficult to distinguish structures and details to handle distinctively due to the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Shengchun Wang , Wencheng Wang , Fei Hou