English
Related papers

Related papers: Analysis of Mismatched Estimation Errors Using Gra…

200 papers

We investigate the finite sample performance of sample splitting, cross-fitting and averaging for the estimation of the conditional average treatment effect. Recently proposed methods, so-called meta-learners, make use of machine learning…

Methodology · Statistics 2020-08-27 Daniel Jacob

We consider communication over memoryless channels using low-density parity-check code ensembles above the iterative (belief propagation) threshold. What is the computational complexity of decoding (i.e., of reconstructing all the typical…

Information Theory · Computer Science 2007-07-13 Cyril Measson , Andrea Montanari , Tom Richardson , Rudiger Urbanke

This paper investigates achievable information rates and error exponents of mismatched decoding when the channel belongs to the class of channels that are close to the decoding metric in terms of relative entropy. For both discrete- and…

Information Theory · Computer Science 2025-05-28 Priyanka Patel , Francesc Molina , Albert Guillén i Fàbregas

We consider the problem of decoding a discrete signal of categorical variables from the observation of several histograms of pooled subsets of it. We present an Approximate Message Passing (AMP) algorithm for recovering the signal in the…

Information Theory · Computer Science 2020-01-22 Ahmed El Alaoui , Aaditya Ramdas , Florent Krzakala , Lenka Zdeborova , Michael I. Jordan

We address the problem of estimating the transmissivity of the pure-loss channel from the Bayesian point of view, i.e., we consider that some prior probability distribution function (PDF) on the unknown variable is available and we employ…

Quantum Physics · Physics 2023-10-13 Boyu Zhou , Boulat A. Bash , Saikat Guha , Christos N. Gagatsos

This thesis is interested in the application of statistical physics methods and inference to sparse linear estimation problems. The main tools are the graphical models and approximate message-passing algorithm together with the cavity…

Information Theory · Computer Science 2015-11-06 Jean Barbier

This paper studies the problem of power allocation in compressed sensing when different components in the unknown sparse signal have different probability to be non-zero. Given the prior information of the non-uniform sparsity and the total…

Information Theory · Computer Science 2014-05-12 Xiaochen Zhao , Wei Dai

Detailed derivations of two bounds of the minimum mean-square error (MMSE) of complex-valued multiple-input multiple-output (MIMO) systems are proposed for performance evaluation. Particularly, the lower bound is derived based on a…

Information Theory · Computer Science 2021-11-29 Chongjun Ouyang , Hongwen Yang

The partition function pertaining to finite--temperature decoding of a (typical) randomly chosen code is known to have three types of behavior, corresponding to three phases in the plane of rate vs. temperature: the {\it ferromagnetic…

Information Theory · Computer Science 2007-08-08 Neri Merhav

Quantum computing allows for the manipulation of highly correlated states whose properties quickly go beyond the capacity of any classical method to calculate. Thus one natural problem which could lend itself to quantum advantage is the…

Quantum Physics · Physics 2024-12-19 Kevin Lively , Tim Bode , Jochen Szangolies , Jian-Xin Zhu , Benedikt Fauseweh

Minimum mean square error (MMSE) estimation of block sparse signals from noisy linear measurements is considered. Unlike in the standard compressive sensing setup where the non-zero entries of the signal are independently and uniformly…

Information Theory · Computer Science 2012-04-26 Mikko Vehkaperä , Saikat Chatterjee , Mikael Skoglund

Bagging can significantly improve the generalization performance of unstable machine learning algorithms such as trees or neural networks. Though bagging is now widely used in practice and many empirical studies have explored its behavior,…

Machine Learning · Computer Science 2019-08-08 Martin Mihelich , Charles Dognin , Yan Shu , Michael Blot

Fundamental relations between information and estimation have been established in the literature for the continuous-time Gaussian and Poisson channels, in a long line of work starting from the classical representation theorems by Duncan and…

Information Theory · Computer Science 2017-04-19 Jiantao Jiao , Kartik Venkat , Tsachy Weissman

Although supervised learning based on a deep neural network has recently achieved substantial improvement on speech enhancement, the existing schemes have either of two critical issues: spectrum or metric mismatches. The spectrum mismatch…

Sound · Computer Science 2020-05-12 Jaeyoung Kim , Mostafa El-Khamy , Jungwon Lee

In parameter estimation, assumptions about the model are typically considered which allow us to build optimal estimation methods under many statistical senses. However, it is usually the case where such models are inaccurately known or not…

Statistics Theory · Mathematics 2015-12-14 Adrià Gusi-Amigó , Pau Closas , Luc Vandendorpe

Distributed state estimation (DSE) is considered as a more robust and reliable alternative for centralized state estimation (CSE) in power system. Especially, taking into account the future power grid, so called smart grid in which…

Systems and Control · Electrical Eng. & Systems 2021-04-12 Sajjad Asefi , Elena Gryazina , Helder Leite

We consider linear precoding and decoding in the downlink of a multiuser multiple-input, multiple-output (MIMO) system, wherein each user may receive more than one data stream. We propose several mean squared error (MSE) based criteria for…

Information Theory · Computer Science 2009-02-10 Adam J. Tenenbaum , Raviraj S. Adve

Two-stage stochastic programming is a problem formulation for decision-making under uncertainty. In the first stage, the actor makes a best "here and now" decision in the presence of uncertain quantities that will be resolved in the future,…

Most optimization problems in applied sciences realistically involve uncertainty in the parameters defining the cost function, of which only statistical information is known beforehand. In a recent work we introduced a message passing…

Statistical Mechanics · Physics 2013-09-03 Fabrizio Altarelli , Alfredo Braunstein , Abolfazl Ramezanpour , Riccardo Zecchina

Compressed sensing deals with efficient recovery of analog signals from linear encodings. This paper presents a statistical study of compressed sensing by modeling the input signal as an i.i.d. process with known distribution. Three classes…

Information Theory · Computer Science 2012-07-12 Yihong Wu , Sergio Verdú