English
Related papers

Related papers: Recovering Simultaneously Structured Data via Non-…

200 papers

Demixing problems in many areas such as hyperspectral imaging and differential optical absorption spectroscopy (DOAS) often require finding sparse nonnegative linear combinations of dictionary elements that match observed data. We show how…

Machine Learning · Statistics 2013-01-04 Ernie Esser , Yifei Lou , Jack Xin

We present a two-stage least-squares method to inverse medium problems of reconstructing multiple unknown coefficients simultaneously from noisy data. A direct sampling method is applied to detect the location of the inhomogeneity in the…

Numerical Analysis · Mathematics 2022-01-04 Kazufumi Ito , Ying Liang , Jun Zou

With the recent emergence of mixed precision hardware, there has been a renewed interest in its use for solving numerical linear algebra problems fast and accurately. The solution of least squares (LS) problems $\min_x\|b-Ax\|_2$, where $A…

Numerical Analysis · Mathematics 2024-01-29 Erin Carson , Eda Oktay

This paper presents a novel hybrid algorithm for minimizing the sum of a continuously differentiable loss function and a nonsmooth, possibly nonconvex, sparse regularization function. The proposed method alternates between solving a…

Optimization and Control · Mathematics 2025-04-01 Hao Wang , Xiangyu Yang , Yichen Zhu

A heuristic procedure based on novel recursive formulation of sinusoid (RFS) and on regression with predictive least-squares (LS) enables to decompose both uniformly and nonuniformly sampled 1-d signals into a sparse set of sinusoids (SSS).…

Information Theory · Computer Science 2017-04-13 Ivan Maric

In this paper, we study the orthogonal least squares (OLS) algorithm for sparse recovery. On the one hand, we show that if the sampling matrix $\mathbf{A}$ satisfies the restricted isometry property (RIP) of order $K + 1$ with isometry…

Information Theory · Computer Science 2017-10-11 Jinming Wen , Jian Wang , Qinyu Zhang

The joint-sparse recovery problem aims to recover, from sets of compressed measurements, unknown sparse matrices with nonzero entries restricted to a subset of rows. This is an extension of the single-measurement-vector (SMV) problem widely…

Information Theory · Computer Science 2018-08-23 Ewout van den Berg , Michael P. Friedlander

This paper is concerned with the problem of low rank plus sparse matrix decomposition for big data. Conventional algorithms for matrix decomposition use the entire data to extract the low-rank and sparse components, and are based on…

Numerical Analysis · Computer Science 2017-03-17 Mostafa Rahmani , George Atia

There has been significant interest and progress recently in algorithms that solve regression problems involving tall and thin matrices in input sparsity time. These algorithms find shorter equivalent of a n*d matrix where n >> d, which…

Data Structures and Algorithms · Computer Science 2013-04-05 Mu Li , Gary L. Miller , Richard Peng

Parallel magnetic resonance imaging has served as an effective and widely adopted technique for accelerating scans. The advent of sparse sampling offers aggressive acceleration, allowing flexible sampling and better reconstruction.…

Medical Physics · Physics 2019-09-09 Xinlin Zhang , Di Guo , Yiman Huang , Ying Chen , Liansheng Wang , Feng Huang , Xiaobo Qu

The recursive least-squares (RLS) algorithm has well-documented merits for reducing complexity and storage requirements, when it comes to online estimation of stationary signals as well as for tracking slowly-varying nonstationary…

Networking and Internet Architecture · Computer Science 2013-10-01 Gonzalo Mateos , Georgios B. Giannakis

In this paper, we consider the problem of sparse recovery from nonlinear measurements, which has applications in state estimation and bad data detection for power networks. An iterative mixed $\ell_1$ and $\ell_2$ convex program is used to…

Information Theory · Computer Science 2013-01-08 Weiyu Xu , Meng Wang , Jianfeng Cai , Ao Tang

This paper aims at constructing a good graph for discovering intrinsic data structures in a semi-supervised learning setting. Firstly, we propose to build a non-negative low-rank and sparse (referred to as NNLRS) graph for the given data…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Liansheng Zhuang , Shenghua Gao , Jinhui Tang , Jingjing Wang , Zhouchen Lin , Yi Ma

In this effort, we propose a convex optimization approach based on weighted $\ell_1$-regularization for reconstructing objects of interest, such as signals or images, that are sparse or compressible in a wavelet basis. We recover the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-17 Joseph Daws , Armenak Petrosyan , Hoang Tran , Clayton G. Webster

Distributed adaptive signal processing has attracted much attention in the recent decade owing to its effectiveness in many decentralized real-time applications in networked systems. Because many natural signals are highly sparse with most…

Optimization and Control · Mathematics 2017-11-22 Xuanyu Cao , K. J. Ray Liu

We develop and analyze stochastic optimization algorithms for problems in which the expected loss is strongly convex, and the optimum is (approximately) sparse. Previous approaches are able to exploit only one of these two structures,…

Machine Learning · Statistics 2012-07-19 Alekh Agarwal , Sahand Negahban , Martin J. Wainwright

Sparse recovery is one of the most fundamental and well-studied inverse problems. Standard statistical formulations of the problem are provably solved by general convex programming techniques and more practical, fast (nearly-linear time)…

Data Structures and Algorithms · Computer Science 2022-03-09 Jonathan A. Kelner , Jerry Li , Allen Liu , Aaron Sidford , Kevin Tian

Partial least squares (PLS) regression combines dimensionality reduction and prediction using a latent variable model. Since partial least squares regression (PLS-R) does not require matrix inversion or diagonalization, it can be applied to…

Methodology · Statistics 2014-08-05 Tzu-Yu Liu , Laura Trinchera , Arthur Tenenhaus , Dennis Wei , Alfred O. Hero

We consider the matrix completion problem of recovering a structured low rank matrix with partially observed entries with mixed data types. Vast majority of the solutions have proposed computationally feasible estimators with strong…

Machine Learning · Statistics 2020-05-27 Daqian Sun , Martin T. Wells

Solving an integer least squares (ILS) problem usually consists of two stages: reduction and search. This thesis is concerned with the reduction process for the ordinary ILS problem and the ellipsoid-constrained ILS problem. For the…

Optimization and Control · Mathematics 2015-03-17 Mazen Al Borno