English
Related papers

Related papers: Statistical Mechanics Approach to Sparse Noise Den…

200 papers

Using a Bayesian approach, we consider the problem of recovering sparse signals under additive sparse and dense noise. Typically, sparse noise models outliers, impulse bursts or data loss. To handle sparse noise, existing methods…

Machine Learning · Statistics 2015-01-13 Martin Sundin , Saikat Chatterjee , Magnus Jansson

I will show that there is a deep relation between error-correction codes and certain mathematical models of spin glasses. In particular minimum error probability decoding is equivalent to finding the ground state of the corresponding spin…

Condensed Matter · Physics 2016-08-31 Nicolas Sourlas

The lasso has become an important practical tool for high dimensional regression as well as the object of intense theoretical investigation. But despite the availability of efficient algorithms, the lasso remains computationally demanding…

Statistics Theory · Mathematics 2009-11-23 Christopher Genovese , Jiashun Jin , Larry Wasserman

We consider the problem of sparse signal reconstruction from noisy one-bit compressed measurements when the receiver has access to side-information (SI). We assume that compressed measurements are corrupted by additive white Gaussian noise…

Signal Processing · Electrical Eng. & Systems 2020-06-11 Swatantra Kafle , Thakshila Wimalajeewa , and Pramod K. Varshney

Most existing bounds for signal reconstruction from compressive measurements make the assumption of additive signal-independent noise. However in many compressive imaging systems, the noise statistics are more accurately represented by…

Information Theory · Computer Science 2018-02-13 Deepak Garg , Pakshal Bohra , Karthik S. Gurumoorthy , Ajit Rajwade

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

Statistics Theory · Mathematics 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

This paper is concerned with the problem of recovering a structured signal from a relatively small number of corrupted random measurements. Sharp phase transitions have been numerically observed in practice when different convex programming…

Information Theory · Computer Science 2021-01-05 Zhongxing Sun , Wei Cui , Yulong Liu

From a numerical analysis perspective, assessing the robustness of l1-minimization is a fundamental issue in compressed sensing and sparse regularization. Yet, the recovery guarantees available in the literature usually depend on a priori…

Numerical Analysis · Mathematics 2017-05-10 Simone Brugiapaglia , Ben Adcock , Richard K. Archibald

We apply basic statistical reasoning to signal reconstruction by machine learning -- learning to map corrupted observations to clean signals -- with a simple and powerful conclusion: it is possible to learn to restore images by only looking…

Computer Vision and Pattern Recognition · Computer Science 2018-10-30 Jaakko Lehtinen , Jacob Munkberg , Jon Hasselgren , Samuli Laine , Tero Karras , Miika Aittala , Timo Aila

We study the rate of decay of the probability of error for distinguishing between a sparse signal with noise, modeled as a sparse mixture, from pure noise. This problem has many applications in signal processing, evolutionary biology,…

Information Theory · Computer Science 2016-12-28 Jonathan G. Ligo , George V. Moustakides , Venugopal V. Veeravalli

Demixing is the problem of identifying multiple structured signals from a superimposed, undersampled, and noisy observation. This work analyzes a general framework, based on convex optimization, for solving demixing problems. When the…

Information Theory · Computer Science 2013-10-01 Michael B. McCoy , Joel A. Tropp

The achievable and converse regions for sparse representation of white Gaussian noise based on an overcomplete dictionary are derived in the limit of large systems. Furthermore, the marginal distribution of such sparse representations is…

Information Theory · Computer Science 2017-02-13 Ori Shental

Additive or multiplicative stationary noise recently became an important issue in applied fields such as microscopy or satellite imaging. Relatively few works address the design of dedicated denoising methods compared to the usual white…

Computer Vision and Pattern Recognition · Computer Science 2013-07-18 Jérôme Fehrenbach , Pierre Weiss

Sparse coding and dictionary learning are popular techniques for linear inverse problems such as denoising or inpainting. However in many cases, the measurement process is nonlinear, for example for clipped, quantized or 1-bit measurements.…

Signal Processing · Electrical Eng. & Systems 2020-01-08 Lucas Rencker , Francis Bach , Wenwu Wang , Mark D. Plumbley

We introduce a statistical physics inspired supervised machine learning algorithm for classification and regression problems. The method is based on the invariances or stability of predicted results when known data is represented as…

Machine Learning · Statistics 2018-11-19 Patrick Chao , Tahereh Mazaheri , Bo Sun , Nicholas B. Weingartner , Zohar Nussinov

Noiseless compressive sensing is a protocol that enables undersampling and later recovery of a signal without loss of information. This compression is possible because the signal is usually sufficiently sparse in a given basis. Currently,…

Information Theory · Computer Science 2024-07-22 D. Barbier , C Lucibello , L. Saglietti , F. Krzakala , L. Zdeborova

We consider the problem of recovering signals from their power spectral density. This is a classical problem referred to in literature as the phase retrieval problem, and is of paramount importance in many fields of applied sciences. In…

Information Theory · Computer Science 2013-11-12 Kishore Jaganathan , Samet Oymak , Babak Hassibi

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual…

Machine Learning · Statistics 2012-06-22 Tingni Sun , Cun-Hui Zhang

In x-ray computed tomography (CT) it is generally acknowledged that reconstruction methods exploiting image sparsity allow reconstruction from a significantly reduced number of projections. The use of such reconstruction methods is…

Numerical Analysis · Mathematics 2014-08-05 Jakob S. Jørgensen , Emil Y. Sidky , Per Christian Hansen , Xiaochuan Pan

Sparsity promoting norms are frequently used in high dimensional regression. A limitation of such Lasso-type estimators is that the optimal regularization parameter depends on the unknown noise level. Estimators such as the concomitant…

Machine Learning · Statistics 2020-09-04 Quentin Bertrand , Mathurin Massias , Alexandre Gramfort , Joseph Salmon
‹ Prev 1 4 5 6 7 8 10 Next ›