English
Related papers

Related papers: Bayesian minimum mean square error for transmissiv…

200 papers

The problem of adaptive sampling for estimating probability mass functions (pmf) uniformly well is considered. Performance of the sampling strategy is measured in terms of the worst-case mean squared error. A Bayesian variant of the…

Methodology · Statistics 2020-12-09 Dhruva Kartik , Neeraj Sood , Urbashi Mitra , Tara Javidi

The minimum mean-square error (MMSE) achievable by optimal estimation of a random variable $Y\in\mathbb{R}$ given another random variable $X\in\mathbb{R}^{d}$ is of much interest in a variety of statistical settings. In the context of…

Information Theory · Computer Science 2022-07-12 Mario Diaz , Peter Kairouz , Lalitha Sankar

This paper deals with arbitrarily distributed finite-power input signals observed through an additive Gaussian noise channel. It shows a new formula that connects the input-output mutual information and the minimum mean-square error (MMSE)…

Information Theory · Computer Science 2007-07-13 Dongning Guo , Shlomo Shamai , Sergio Verdu

We consider the problem of sequentially learning to estimate, in the mean squared error (MSE) sense, a Gaussian $K$-vector of unknown covariance by observing only $m < K$ of its entries in each round. We propose two MSE estimators, and…

Machine Learning · Computer Science 2025-05-05 Ayon Ghosh , L. A. Prashanth , Dipayan Sen , Aditya Gopalan

In this work we explore possibilities for coding and decoding tailor-made for mean squared error evaluation of error in contexts such as image transmission. To do so, we introduce a loss function that expresses the overall performance of a…

Information Theory · Computer Science 2014-11-06 Marcelo Firer , Luciano Panek , Jerry Anderson Pinheiro

We provide the optimal measurement strategy for a class of noisy channels that reduce to the identity channel for a specific value of a parameter (spreading channels). We provide an example that is physically relevant: the estimation of the…

Quantum Physics · Physics 2022-12-21 Wojciech Górecki , Alberto Riccardi , Lorenzo Maccone

Working from a model of Gaussian pixel noise, we present and unify over twenty-five years of developments in the statistical analysis of the photon transfer conversion gain measurement. We then study a two-sample estimator of the conversion…

Optics · Physics 2023-01-24 Aaron Hendrickson , David P. Haefner , Bradley L. Preece

In this contribution, we consider the problem of blind source separation in a Bayesian estimation framework. The wavelet representation allows us to assign an adequate prior distribution to the wavelet coefficients of the sources. MCMC…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Mahieddine M. Ichir , Ali Mohammad-Djafari

We consider the task of estimating a low-rank matrix from non-linear and noisy observations. We prove a strong universality result showing that Bayes-optimal performances are characterized by an equivalent Gaussian model with an effective…

Machine Learning · Statistics 2024-03-08 Pierre Mergny , Justin Ko , Florent Krzakala , Lenka Zdeborová

Bayesian optimization is widely used for optimizing expensive black box functions, but most existing approaches focus on scalar responses. In many scientific and engineering settings the response is functional, varying smoothly over an…

Machine Learning · Computer Science 2026-04-28 Pouya Ahadi , Reza Marzban , Ali Adibi , Kamran Paynabar

In this paper, we study a generalized Kalman-Bucy filtering problem under uncertainty. The drift uncertainty for both signal process and observation process is considered and the attitude to uncertainty is characterized by a convex operator…

Optimization and Control · Mathematics 2020-11-09 Shaolin Ji , Chuiliu Kong , Chuanfeng Sun , Ji-Feng Zhang

Conventional frequentist learning, as assumed by existing federated learning protocols, is limited in its ability to quantify uncertainty, incorporate prior knowledge, guide active learning, and enable continual learning. Bayesian learning…

Information Theory · Computer Science 2021-08-31 Dongzhu Liu , Osvaldo Simeone

Experimental data in Particle and Nuclear physics, Particle Astrophysics and Radiation Protection Dosimetry are obtained from experimental facilities comprising a complex array of sensors, electronics and software. Computer simulation is…

Data Analysis, Statistics and Probability · Physics 2025-03-06 Nikolay D. Gagunashvili

We introduce a framework that enables efficient sampling from learned probability distributions for MRI reconstruction. Different from conventional deep learning-based MRI reconstruction techniques, samples are drawn from the posterior…

Machine Learning · Computer Science 2023-07-21 Guanxiong Luo , Moritz Blumenthal , Martin Heide , Martin Uecker

This paper studies a new and highly efficient Markov chain Monte Carlo (MCMC) methodology to perform Bayesian inference in low-photon imaging problems, with particular attention to situations involving observation noise processes that…

Integrated sensing and communication is regarded as a key enabler for next-generation wireless networks. To optimize the transmitted waveform for both sensing and communication, various performance metrics must be considered. This work…

A Bayesian approach termed BAyesian Least Squares Optimization with Nonnegative L1-norm constraint (BALSON) is proposed. The error distribution of data fitting is described by Gaussian likelihood. The parameter distribution is assumed to be…

Machine Learning · Computer Science 2018-07-10 Jiyang Xie , Zhanyu Ma , Guoqiang Zhang , Jing-Hao Xue , Jen-Tzung Chien , Zhiqing Lin , Jun Guo

We study the excess mean square error (EMSE) above the minimum mean square error (MMSE) in large linear systems where the posterior mean estimator (PME) is evaluated with a postulated prior that differs from the true prior of the input…

Information Theory · Computer Science 2015-05-18 Yanting Ma , Dror Baron , Ahmad Beirami

Estimating position and orientation change of a mobile platform from two consecutive point clouds provided by a high-resolution sensor is a key problem in autonomous navigation. In particular, scan matching algorithms aim to find the…

Signal Processing · Electrical Eng. & Systems 2021-06-09 Rico Mendrzik , Florian Meyer

We propose a method for estimating channel parameters from RSSI measurements and the lost packet count, which can work in the presence of losses due to both interference and signal attenuation below the noise floor. This is especially…

Machine Learning · Computer Science 2015-04-07 Silvija Kokalj-Filipovic , Larry Greenstein