English
Related papers

Related papers: Extensions of the I-MMSE Relation

200 papers

The Goodman-Nguyen relation is a partial order generalising the implication (inclusion) relation to conditional events. As such, with precise probabilities it both induces an agreeing probability ordering and is a key tool in a certain…

Probability · Mathematics 2015-03-09 Renato Pelessoni , Paolo Vicig

In a recent work we have introduced a novel approach to study the effect of weak non-linearities in the transfer function on the information transmitted by an analogue channel, by means of a perturbative diagrammatic expansion. We extend…

Statistical Mechanics · Physics 2009-11-07 E. Korutcheva , V. Del Prete

We model the ligand-receptor molecular communication channel with a discrete-time Markov model, and show how to obtain the capacity of this channel. We show that the capacity-achieving input distribution is iid; further, unusually for a…

Information Theory · Computer Science 2016-11-17 Andrew W. Eckford , Peter J. Thomas

We consider the discrete memoryless degraded broadcast channels with feedback. We prove that the error probability of decoding tends to one exponentially for rates outside the capacity region and derive an explicit lower bound of this…

Information Theory · Computer Science 2015-04-24 Yasutada Oohama

Fluctuation relations are powerful equalities that hold far from equilibrium. However, the standard approach to include measurement and feedback schemes may become inapplicable in certain situations, including continuous measurements,…

Mesoscale and Nanoscale Physics · Physics 2019-09-05 Patrick P. Potts , Peter Samuelsson

Recently, the separable indirect effect (SIE) has gained attention due to its identifiability without requiring the untestable cross-world assumption necessary for the natural indirect effect (NIE). This article systematically compares the…

Methodology · Statistics 2025-07-08 Yan-Lin Chen , Sheng-Hsuan Lin

We introduce a double/debiased machine learning estimator for the impulse response function in settings where a time series of interest is subjected to multiple discrete treatments, assigned over time, which can have a causal effect on…

Econometrics · Economics 2025-12-17 Daniele Ballinari , Alexander Wehrli

Correlation functions in concentrated ionic systems are studied within the mesoscopic theory at the level of the Gaussian approximation. The previously neglected fluctuation contribution to the inverse charge-charge correlation function is…

Soft Condensed Matter · Physics 2025-06-26 O. Patsahan , A. Ciach

Few models have been more ubiquitous in their respective fields than Bayesian knowledge tracing and item response theory. Both of these models were developed to analyze data on learners. However, the study designs that these models are…

Methodology · Statistics 2018-10-15 Benjamin Deonovic , Michael Yudelson , Maria Bolsinova , Meirav Attali , Gunter Maris

A coding scheme is proposed for the memoryless Gaussian broadcast channel with correlated noises and feedback. For all noise correlations other than -1, the gap between the sum-rate the scheme achieves and the full-cooperation bound…

Information Theory · Computer Science 2015-03-13 Michael Gastpar , Amos Lapidoth , Yossef Steinberg , Michele Wigger

In this paper, we will establish a discrete-time version of Clark(-Ocone-Haussmann) formula, which can be seen as an asymptotic expansion in a weak sense. The formula is applied to the estimation of the error caused by the martingale…

Probability · Mathematics 2013-09-02 Jirô Akahori , Takafumi Amaba , Kaori Okuma

The study of inter-human communication requires a more complex framework than Shannon's (1948) mathematical theory of communication because "information" is defined in the latter case as meaningless uncertainty. Assuming that meaning cannot…

Digital Libraries · Computer Science 2013-03-15 Loet Leydesdorff , Inga A. Ivanova

We study correlated jamming in joint source-channel communication systems. An i.i.d. source is to be communicated over a memoryless channel in the presence of a correlated jammer with non-causal knowledge of user transmission. This…

Information Theory · Computer Science 2014-04-22 Amitalok J. Budkuley , Bikash Kumar Dey , Vinod M. Prabhakaran

We study memoryless, discrete time, matrix channels with additive white Gaussian noise and input power constraints of the form $Y_i = \sum_j H_{ij} X_j + Z_i$, where $Y_i$ ,$X_j$ and $Z_i$ are complex, $i=1..m$, $j=1..n$, and $H$ is a…

Data Analysis, Statistics and Probability · Physics 2007-05-23 Anirvan Mayukh Sengupta , Partha Pratim Mitra

Channel decoding is a challenging task in communication channels exhibiting memory effects. In this work, we apply the recently proposed decoding paradigm of guessing random additive noise decoding (GRAND) to channels with memory, focusing…

Information Theory · Computer Science 2026-03-12 Zhuang Li , Wenyi Zhang

Multivariate time series with missing values are common in areas such as healthcare and finance, and have grown in number and complexity over the years. This raises the question whether deep learning methodologies can outperform classical…

Machine Learning · Statistics 2020-02-21 Vincent Fortuin , Dmitry Baranchuk , Gunnar Rätsch , Stephan Mandt

It is often convenient to use Gaussian blur in studying image quality or in data augmentation pipelines for training convoluional neural networks. Because of their convenience, Guassians are sometimes used as first order approximations of…

Image and Video Processing · Electrical Eng. & Systems 2023-01-04 Austin C. Bergstrom , David Conran , David W. Messinger

The theoretical analysis of downlink massive MIMO usually assumes the ideal Gaussian channel matrix with asymp- totic orthogonality of channel vectors associated with different users, since it can provide the favorable propagation…

Information Theory · Computer Science 2015-11-30 Zhen Gao , Linglong Dai , Chau Yuen , Zhaocheng Wang

We present two classes of improved estimators for mutual information $M(X,Y)$, from samples of random points distributed according to some joint probability density $\mu(x,y)$. In contrast to conventional estimators based on binnings, they…

Statistical Mechanics · Physics 2009-11-10 Alexander Kraskov , Harald Stoegbauer , Peter Grassberger

Biochemical signal transduction, a form of molecular communication, can be modeled using graphical Markov channels with input-modulated transition rates. Such channel models are strongly non-Gaussian. In this paper we use a linear noise…

Quantitative Methods · Quantitative Biology 2019-08-30 Gregory R. Hessler , Andrew W. Eckford , Peter J. Thomas