English
Related papers

Related papers: On the Error Exponent of Approximate Sufficient St…

200 papers

This paper presents some results on the maximum likelihood (ML) estimation from incomplete data. Finite sample properties of conditional observed information matrices are established. They possess positive definiteness and the same Loewner…

Methodology · Statistics 2022-07-26 Budhi Arta Surya

This paper considers the fundamental limit of compressed sensing for i.i.d. signal distributions and i.i.d. Gaussian measurement matrices. Its main contribution is a rigorous characterization of the asymptotic mutual information (MI) and…

Information Theory · Computer Science 2016-07-12 Galen Reeves , Henry D. Pfister

Compressed Sensing decoding algorithms can efficiently recover an N dimensional real-valued vector x to within a factor of its best k-term approximation by taking m = 2klog(N/k) measurements y = Phi x. If the sparsity or approximate…

Numerical Analysis · Mathematics 2008-12-09 Rachel Ward

In this paper, we address the classical problem of maximum-likelihood (ML) detection of data in the presence of random phase noise. We consider a system, where the random phase noise affecting the received signal is first compensated by a…

Information Theory · Computer Science 2016-11-15 Rajet Krishnan , M. Reza Khanzadi , Thomas Eriksson , Tommy Svensson

This paper addresses the adaptive radar target detection problem in the presence of Gaussian interference with unknown statistical properties. To this end, the problem is first formulated as a binary hypothesis test, and then we derive a…

Signal Processing · Electrical Eng. & Systems 2025-03-05 Chaoran Yin , Tianqi Wang , Linjie Yan , Chengpeng Hao , Alfonso Farina , Danilo Orlando

We provide two results concerning the optimality of the maximum mutual information (MMI) decoder. First, we prove that the error exponents of the typical random codes under the optimal maximum likelihood (ML) decoder and the MMI decoder are…

Information Theory · Computer Science 2020-07-27 Ran Tamir , Neri Merhav

Optimal MIMO detection has been one of the most challenging and computationally inefficient tasks in wireless systems. We show that the new analog computing techniques like Coherent Ising Machines (CIM) are promising candidates for…

Networking and Internet Architecture · Computer Science 2024-09-06 Abhishek Kumar Singh , Kyle Jamieson , Davide Venturelli , Peter McMahon

We consider the problem of fitting the parameters of a high-dimensional linear regression model. In the regime where the number of parameters $p$ is comparable to or exceeds the sample size $n$, a successful approach uses an…

Statistics Theory · Mathematics 2013-11-04 Adel Javanmard , Andrea Montanari

The error exponent in lossy source coding characterizes the asymptotic decay rate of error probability with respect to blocklength. The Marton's error exponent provides the theoretically optimal bound on this rate. However, computation…

Information Theory · Computer Science 2025-07-29 Jiachuan Ye , Shitong Wu , Lingyi Chen , Wenyi Zhang , Huihui Wu , Hao Wu

We consider the problem of testing for the presence (or detection) of an unknown sparse signal in additive white noise. Given a fixed measurement budget, much smaller than the dimension of the signal, we consider the general problem of…

Information Theory · Computer Science 2015-03-19 Ramin Zahedi , Ali Pezeshki , Edwin K. P. Chong

Likelihood-free inference methods typically make use of a distance between simulated and real data. A common example is the maximum mean discrepancy (MMD), which has previously been used for approximate Bayesian computation, minimum…

Methodology · Statistics 2023-05-11 Ayush Bharti , Masha Naslidnyk , Oscar Key , Samuel Kaski , François-Xavier Briol

Evaluating the statistical dimension is a common tool to determine the asymptotic phase transition in compressed sensing problems with Gaussian ensemble. Unfortunately, the exact evaluation of the statistical dimension is very difficult and…

Information Theory · Computer Science 2019-06-06 Sajad Daei , Farzan Haddadi , Arash Amini , Martin Lotz

We study robust linear regression in high-dimension, when both the dimension $d$ and the number of data points $n$ diverge with a fixed ratio $\alpha=n/d$, and study a data model that includes outliers. We provide exact asymptotics for the…

Machine Learning · Statistics 2024-06-24 Matteo Vilucchio , Emanuele Troiani , Vittorio Erba , Florent Krzakala

This paper introduces a unified framework for the detection of a source with a sensor array in the context where the noise variance and the channel between the source and the sensors are unknown at the receiver. The Generalized Maximum…

Probability · Mathematics 2010-06-16 Pascal Bianchi , Merouane Debbah , Mylène Maïda , Jamal Najim

We improve existing results in the field of compressed sensing and matrix completion when sampled data may be grossly corrupted. We introduce three new theorems. 1) In compressed sensing, we show that if the m \times n sensing matrix has…

Information Theory · Computer Science 2012-01-19 Xiaodong Li

We propose methodology for estimation of sparse precision matrices and statistical inference for their low-dimensional parameters in a high-dimensional setting where the number of parameters $p$ can be much larger than the sample size. We…

Statistics Theory · Mathematics 2016-07-21 Jana Janková , Sara van de Geer

Mixed linear regression (MLR) model is among the most exemplary statistical tools for modeling non-linear distributions using a mixture of linear models. When the additive noise in MLR model is Gaussian, Expectation-Maximization (EM)…

Machine Learning · Statistics 2021-05-14 Babak Barazandeh , Ali Ghafelebashi , Meisam Razaviyayn , Ram Sriharsha

This paper addresses the detection of a stochastic process in noise from irregular samples. We consider two hypotheses. The \emph{noise only} hypothesis amounts to model the observations as a sample of a i.i.d. Gaussian random variables…

Information Theory · Computer Science 2009-09-25 Walid Hachem , Eric Moulines , Francois Roueff

We study the matrix denoising problem of estimating the singular vectors of a rank-$1$ signal corrupted by noise with both column and row correlations. Existing works are either unable to pinpoint the exact asymptotic estimation error or,…

Statistics Theory · Mathematics 2024-10-29 Yihan Zhang , Marco Mondelli

Existing two-sample testing techniques, particularly those based on choosing a kernel for the Maximum Mean Discrepancy (MMD), often assume equal sample sizes from the two distributions. Applying these methods in practice can require…

Machine Learning · Statistics 2025-12-17 Aaron Wei , Milad Jalali , Danica J. Sutherland