English
Related papers

Related papers: Superfast Line Spectral Estimation

200 papers

Many problems of low-level computer vision and image processing, such as denoising, deconvolution, tomographic reconstruction or super-resolution, can be addressed by maximizing the posterior distribution of a sparse linear model (SLM). We…

Machine Learning · Statistics 2010-08-16 Matthias W. Seeger , Hannes Nickisch

The Kaczmarz algorithm is a popular solver for overdetermined linear systems due to its simplicity and speed. In this paper, we propose a modification that speeds up the convergence of the randomized Kaczmarz algorithm for systems of linear…

Numerical Analysis · Computer Science 2013-05-17 Hassan Mansour , Ozgur Yilmaz

For many practical applications in wireless communications, we need to recover a structured sparse signal from a linear observation model with dynamic grid parameters in the sensing matrix. Conventional expectation maximization (EM)-based…

Signal Processing · Electrical Eng. & Systems 2023-11-14 Wenkang Xu , An Liu , Bingpeng Zhou , Minjian Zhao

The analysis of gravitational wave interferometer data requires estimates for the noise covariance matrix. For stationary noise, this amounts to estimating the power spectrum. Classical methods such as Welch averaging are used in many…

General Relativity and Quantum Cosmology · Physics 2024-03-05 Toral Gupta , Neil Cornish

This paper introduces a subspace method for the estimation of an array covariance matrix. It is shown that when the received signals are uncorrelated, the true array covariance matrices lie in a specific subspace whose dimension is…

Numerical Analysis · Computer Science 2014-11-04 Mostafa Rahmani , George Atia

We consider the problem of parameter estimation in a high-dimensional generalized linear model. Spectral methods obtained via the principal eigenvector of a suitable data-dependent matrix provide a simple yet surprisingly effective…

Statistics Theory · Mathematics 2025-07-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

Compressive covariance estimation has arisen as a class of techniques whose aim is to obtain second-order statistics of stochastic processes from compressive measurements. Recently, these methods have been used in various image processing…

Image and Video Processing · Electrical Eng. & Systems 2022-07-27 Jonathan Monsalve , Juan Ramirez , Iñaki Esnaola , Henry Arguello

Finding sparse solutions of underdetermined systems of linear equations is a fundamental problem in signal processing and statistics which has become a subject of interest in recent years. In general, these systems have infinitely many…

Machine Learning · Statistics 2010-09-21 Arash Ali Amini , Massoud Babaie-Zadeh , Christian Jutten

Two complementary approaches have been extensively used in signal and image processing leading to novel results, the sparse representation methodology and the variational strategy. Recently, a new sparsity based model has been proposed, the…

Computer Vision and Pattern Recognition · Computer Science 2015-08-17 Raja Giryes , Michael Elad , Alfred M. Bruckstein

We present the framework of slowly varying regression under sparsity, allowing sparse regression models to exhibit slow and sparse variations. The problem of parameter estimation is formulated as a mixed-integer optimization problem. We…

Machine Learning · Computer Science 2023-11-14 Dimitris Bertsimas , Vassilis Digalakis , Michael Linghzi Li , Omar Skali Lami

The sparsity of multipaths in the wideband channel has motivated the use of compressed sensing for channel estimation. In this letter, we propose a different approach to sparse channel estimation. We exploit the fact that $L$ taps of…

Information Theory · Computer Science 2022-01-24 Woong-Hee Lee , Ki Won Sung

We address the problem of robust sparse estimation of the precision matrix for heavy-tailed distributions in high-dimensional settings. In such high-dimensional contexts, we observe that the covariance matrix can be approximated by a…

Methodology · Statistics 2025-03-06 Zhengke Lu , Long Feng

Spectral estimation plays a fundamental role in frequency-domain identification and related signal processing problems. This paper revisits a 2-D spectral estimation problem formulated in terms of convex optimization. More precisely, we…

Optimization and Control · Mathematics 2026-01-07 Ji Cheng , Bin Zhu

This work is a re-examination of the sparse Bayesian learning (SBL) of linear regression models of Tipping (2001) in a high-dimensional setting. We propose a hard-thresholded version of the SBL estimator that achieves, for orthogonal design…

Methodology · Statistics 2015-02-12 Yves Atchade , Chia Chye Yee

Two-dimensional terahertz spectroscopy (2DTS) is a low-frequency analogue of two-dimensional optical spectroscopy that is rapidly maturing as a probe of a wide variety of condensed matter systems. However, a persistent problem of 2DTS is…

We consider the problem of estimating sparse graphs by a lasso penalty applied to the inverse covariance matrix. Using a coordinate descent procedure for the lasso, we develop a simple algorithm that is remarkably fast: in the worst cases,…

Methodology · Statistics 2007-08-28 Jerome Friedman , Trevor Hastie , Robert Tibshirani

Motivated by recent work on stochastic gradient descent methods, we develop two stochastic variants of greedy algorithms for possibly non-convex optimization problems with sparsity constraints. We prove linear convergence in expectation to…

Numerical Analysis · Mathematics 2014-07-02 Nam Nguyen , Deanna Needell , Tina Woolf

The computation of the matrix exponential is a ubiquitous operation in numerical mathematics, and for a general, unstructured $n\times n$ matrix it can be computed in $\mathcal{O}(n^3)$ operations. An interesting problem arises if the input…

Numerical Analysis · Mathematics 2021-06-02 Daniel Kressner , Robert Luce

The iterations of many sparse estimation algorithms are comprised of a fixed linear filter cascaded with a thresholding nonlinearity, which collectively resemble a typical neural network layer. Consequently, a lengthy sequence of algorithm…

Machine Learning · Computer Science 2016-05-11 Bo Xin , Yizhou Wang , Wen Gao , David Wipf

The randomized version of the Kaczmarz method for the solution of linear systems is known to converge linearly in expectation. In this work we extend this result and show that the recently proposed Randomized Sparse Kaczmarz method for…

Optimization and Control · Mathematics 2016-10-11 Frank Schöpfer , Dirk A. Lorenz