English
Related papers

Related papers: The Generalized Lasso for Sub-gaussian Measurement…

200 papers

We study the problem of jointly sparse support recovery with 1-bit compressive measurements in a sensor network. Sensors are assumed to observe sparse signals having the same but unknown sparse support. Each sensor quantizes its measurement…

Information Theory · Computer Science 2015-06-02 Vipul Gupta , Bhavya Kailkhura , Thakshila Wimalajeewa , Pramod K. Varshney

The Lasso is a method for high-dimensional regression, which is now commonly used when the number of covariates $p$ is of the same order or larger than the number of observations $n$. Classical asymptotic normality theory does not apply to…

Statistics Theory · Mathematics 2023-09-20 Michael Celentano , Andrea Montanari , Yuting Wei

Most detection algorithms in spatial modulation (SM) are formulated as linear regression via the regularized least-squares (RLS) method. In this method, the transmit signal is estimated by minimizing the residual sum of squares penalized…

Information Theory · Computer Science 2019-05-15 Ali Bereyhi , Saba Asaad , Bernhard Gäde , Ralf R. Müller

Infinite-dimensional compressed sensing deals with the recovery of analog signals (functions) from linear measurements, often in the form of integral transforms such as the Fourier transform. This framework is well-suited to many real-world…

Information Theory · Computer Science 2021-05-25 Ben Adcock , Vegard Antun , Anders C. Hansen

Image hashing is a principled approximate nearest neighbor approach to find similar items to a query in a large collection of images. Hashing aims to learn a binary-output function that maps an image to a binary vector. For optimal…

Computer Vision and Pattern Recognition · Computer Science 2022-06-01 Khoa D. Doan , Peng Yang , Ping Li

The fused lasso, also known as (anisotropic) total variation denoising, is widely used for piecewise constant signal estimation with respect to a given undirected graph. The fused lasso estimate is highly nontrivial to compute when the…

Statistics Theory · Mathematics 2018-08-01 Oscar Hernan Madrid Padilla , James G. Scott , James Sharpnack , Ryan J. Tibshirani

We delve into the impact of memoryless scalar quantization on matrix completion. Our primary motivation for this research is to evaluate the recovery performance of nuclear norm minimization in handling quantized matrix problems without the…

Information Theory · Computer Science 2025-12-15 Arian Eamaz , Farhang Yeganegi , Mojtaba Soltanalian

We study the majority rule transformation applied to the Gibbs measure for the 2--D Ising model at the critical point. The aim is to show that the renormalized hamiltonian is well defined in the sense that the renormalized measure is…

High Energy Physics - Theory · Physics 2009-10-30 Emilio N. M. Cirillo , E. Olivieri

We apply classical and Bayesian lasso regularizations to a family of models with the presence of mixture and process variables. We analyse the performance of these estimates with respect to ordinary least squares estimators by a simulation…

We study the average distortion introduced by scalar, vector, and entropy coded quantization of compressive sensing (CS) measurements. The asymptotic behavior of the underlying quantization schemes is either quantified exactly or…

Information Theory · Computer Science 2009-03-07 Wei Dai , Hoa Vinh Pham , Olgica Milenkovic

Nowadays, l1 penalized likelihood has absorbed a high amount of consideration due to its simplicity and well developed theoretical properties. This method is known as a reliable method in order to apply in a broad range of applications…

Methodology · Statistics 2015-06-12 Hamed Haselimashhadi

The notion of signal sparsity has been gaining increasing interest in information theory and signal processing communities. As a consequence, a plethora of sparsity metrics has been presented in the literature. The appropriateness of these…

Information Theory · Computer Science 2016-02-08 Anastasios Maronidis , Elisavet Chatzilari , Spiros Nikolopoulos , Ioannis Kompatsiaris

This paper investigates system identification problems with Gaussian inputs and quantized observations under fixed thresholds. By reinterpreting the nonlinear effects induced by quantization as the product of the unknown parameter and an…

Optimization and Control · Mathematics 2025-10-20 Xingrui Liu , Ying Wang , Yanlong Zhao

We give the first computationally tractable and almost optimal solution to the problem of one-bit compressed sensing, showing how to accurately recover an s-sparse vector x in R^n from the signs of O(s log^2(n/s)) random linear measurements…

Information Theory · Computer Science 2015-03-19 Yaniv Plan , Roman Vershynin

It is well known that the Lasso can be interpreted as a Bayesian posterior mode estimate with a Laplacian prior. Obtaining samples from the full posterior distribution, the Bayesian Lasso, confers major advantages in performance as compared…

Computation · Statistics 2018-01-09 Marcela Mendoza , Alexis Allegra , Todd P. Coleman

In this paper, we investigate learning-based maximum likelihood (ML) detection for uplink massive multiple-input and multiple-output (MIMO) systems with one-bit analog-to-digital converters (ADCs). To overcome the significant dependency of…

Information Theory · Computer Science 2019-08-27 Jinseok Choi , Yunseong Cho , Brian L. Evans , Alan Gatherer

Binary measurements arise naturally in a variety of statistical and engineering applications. They may be inherent to the problem---e.g., in determining the relationship between genetics and the presence or absence of a disease---or they…

Information Theory · Computer Science 2014-08-01 Richard Baraniuk , Simon Foucart , Deanna Needell , Yaniv Plan , Mary Wootters

Clustering and estimating cluster means are core problems in statistics and machine learning, with k-means and Expectation Maximization (EM) being two widely used algorithms. In this work, we provide a theoretical explanation for the…

Machine Learning · Statistics 2025-06-19 David Silva-Sánchez , Roy R. Lederman

We study the behavior of channel capacity when a one-bit quantizer is employed at the output of the discrete-time average-power-limited Gaussian channel. We focus on the low signal-to-noise ratio regime, where communication at very low…

Information Theory · Computer Science 2011-06-01 Tobias Koch , Amos Lapidoth

Several analog-to-digital conversion methods for bandlimited signals used in applications, such as Sigma Delta quantization schemes, employ coarse quantization coupled with oversampling. The standard mathematical model for the error accrued…

Information Theory · Computer Science 2010-04-21 Felix Krahmer , Rachel Ward