English
Related papers

Related papers: Online Reweighted Least Squares Algorithm for Spar…

200 papers

Convolutional neural networks (CNNs) have succeeded in many practical applications. However, their high computation and storage requirements often make them difficult to deploy on resource-constrained devices. In order to tackle this issue,…

Machine Learning · Computer Science 2022-01-14 Tianzong Yu , Chunyuan Zhang , Yuan Wang , Meng Ma , Qi Song

Linear regression in $\ell_p$-norm is a canonical optimization problem that arises in several applications, including sparse recovery, semi-supervised learning, and signal processing. Generic convex optimization algorithms for solving…

Data Structures and Algorithms · Computer Science 2020-01-13 Deeksha Adil , Richard Peng , Sushant Sachdeva

In many areas of imaging science, it is difficult to measure the phase of linear measurements. As such, one often wishes to reconstruct a signal from intensity measurements, that is, perform phase retrieval. In several applications the…

Information Theory · Computer Science 2015-06-16 Afonso S. Bandeira , Dustin G. Mixon

We present an online algorithm for reconstructing a signal from a set of non-uniform samples. By representing the signal using compactly supported basis functions, we show how estimating the expansion coefficients using least-squares can be…

Signal Processing · Electrical Eng. & Systems 2022-08-04 Justin Romberg

The paper investigates the problem of estimating the state of a time-varying system with a linear measurement model; in particular, the paper considers the case where the number of measurements available can be smaller than the number of…

Systems and Control · Electrical Eng. & Systems 2021-04-07 Guido Cavraro , Emiliano Dall'Anese , Joshua Comden , Andrey Bernstein

$L_1$ regularization is used for finding sparse solutions to an underdetermined linear system. As sparse signals are widely expected in remote sensing, this type of regularization scheme and its extensions have been widely employed in many…

Image and Video Processing · Electrical Eng. & Systems 2018-05-07 Yilei Shi , Xiao Xiang Zhu , Wotao Yin , Richard Bamler

This paper develops new theory and algorithms to recover signals that are approximately sparse in some general dictionary (i.e., a basis, frame, or over-/incomplete matrix) but corrupted by a combination of interference having a sparse…

Information Theory · Computer Science 2013-09-06 Christoph Studer , Richard G. Baraniuk

Sparsity and low-rank models have been popular for reconstructing images and videos from limited or corrupted measurements. Dictionary or transform learning methods are useful in applications such as denoising, inpainting, and medical image…

Machine Learning · Statistics 2019-07-23 Brian E. Moore , Saiprasad Ravishankar , Raj Rao Nadakuditi , Jeffrey A. Fessler

Recent advances in optical systems make them ideal for undersampling multiband signals that have high bandwidths. In this paper we propose a new scheme for reconstructing multiband sparse signals using a small number of sampling channels.…

Information Theory · Computer Science 2008-06-04 Michael Fleyer , Amir Rosenthal , Alex Linden , Moshe Horowitz

We present a statistical framework to benchmark the performance of reconstruction algorithms for linear inverse problems, in particular, neural-network-based methods that require large quantities of training data. We generate synthetic…

Signal Processing · Electrical Eng. & Systems 2023-07-05 Pakshal Bohra , Pol del Aguila Pla , Jean-François Giovannelli , Michael Unser

Logistic regression, the Support Vector Machine (SVM), and least squares are well-studied methods in the statistical and computer science community, with various practical applications. High-dimensional data arriving on a real-time basis…

Machine Learning · Computer Science 2024-11-07 Debbie Lim , Yixian Qiu , Patrick Rebentrost , Qisheng Wang

In many data acquisition systems it is common to observe signals whose amplitudes have been clipped. We present two new algorithms for recovering a clipped signal by leveraging the model assumption that the underlying signal is sparse in…

Information Theory · Computer Science 2011-10-25 Alejandro J. Weinstein , Michael B. Wakin

This work proposes a decentralized, iterative, Bayesian algorithm called CB-DSBL for in-network estimation of multiple jointly sparse vectors by a network of nodes, using noisy and underdetermined linear measurements. The proposed algorithm…

Machine Learning · Computer Science 2016-11-15 Saurabh Khanna , Chandra R. Murthy

In this paper, we consider a squared $L_1/L_2$ regularized model for sparse signal recovery from noisy measurements. We first establish the existence of optimal solutions to the model under mild conditions. Next, we propose a proximal…

Optimization and Control · Mathematics 2025-11-10 Na Zhang , Hong Chen , Qia Li , Junpeng Zhou

Numerical experiments in literature on compressed sensing have indicated that the reweighted $l_1$ minimization performs exceptionally well in recovering sparse signal. In this paper, we develop exact recovery conditions and algorithm for…

Information Theory · Computer Science 2014-06-17 Shenglong Zhou , Naihua Xiu , Yingnan Wang , Lingchen Kong

Computed Tomography (CT) is pivotal in industrial quality control and medical diagnostics. Sparse-view CT, offering reduced ionizing radiation, faces challenges due to its under-sampled nature, leading to ill-posed reconstruction problems.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Jiayang Shi , Junyi Zhu , Daniel M. Pelt , K. Joost Batenburg , Matthew B. Blaschko

Partial least squares (PLS) regression combines dimensionality reduction and prediction using a latent variable model. Since partial least squares regression (PLS-R) does not require matrix inversion or diagonalization, it can be applied to…

Methodology · Statistics 2014-08-05 Tzu-Yu Liu , Laura Trinchera , Arthur Tenenhaus , Dennis Wei , Alfred O. Hero

In the Sparse Linear Regression (SLR) problem, given a $d \times n$ matrix $M$ and a $d$-dimensional query $q$, the goal is to compute a $k$-sparse $n$-dimensional vector $\tau$ such that the error $||M \tau-q||$ is minimized. This problem…

Computational Geometry · Computer Science 2018-05-01 Sariel Har-Peled , Piotr Indyk , Sepideh Mahabadi

Compressed sensing (CS) is an innovative technique allowing to represent signals through a small number of their linear projections. In this paper we address the application of CS to the scenario of progressive acquisition of 2D visual…

Information Theory · Computer Science 2014-03-06 Giulio Coluccia , Enrico Magli

Compressed Sensing suggests that the required number of samples for reconstructing a signal can be greatly reduced if it is sparse in a known discrete basis, yet many real-world signals are sparse in a continuous dictionary. One example is…

Information Theory · Computer Science 2015-07-24 Yuanxin Li , Yuejie Chi