English
Related papers

Related papers: Mutual information rate and bounds for it

200 papers

Estimating conditional mutual information (CMI) is an essential yet challenging step in many machine learning and data mining tasks. Estimating CMI from data that contains both discrete and continuous variables, or even discrete-continuous…

Information Theory · Computer Science 2021-01-14 Alexander Marx , Lincen Yang , Matthijs van Leeuwen

We consider a collection of distributed units that interact with one another through the sending of messages. Each message carries a positive ($+1$) or negative ($-1$) tag and causes the receiving unit to send out messages as a function of…

Neurons and Cognition · Quantitative Biology 2017-01-12 Valmir C. Barbosa

A method to estimate the time-dependent correlation via an empirical bias estimate of the time-delayed mutual information for a time-series is proposed. In particular, the bias of the time-delayed mutual information is shown to often be…

Chaotic Dynamics · Physics 2016-01-20 DJ Albers , George Hripcsak

We devised a measure based on the distributions of relative event timings of two coupled units. The measure dynamically evaluates temporal interdependencies between the two coupled units. Using this we show that even in the event of…

Chaotic Dynamics · Physics 2007-05-23 Michal Zochowski , Rhonda Dzakpasu

The data for many classification problems, such as pattern and speech recognition, follow mixture distributions. To quantify the optimum performance for classification tasks, the Shannon mutual information is a natural information-theoretic…

Signal Processing · Electrical Eng. & Systems 2022-06-22 Yijun Ding , Amit Ashok

Fluctuations in biochemical networks, e.g., in a living cell, have a complex origin that precludes a description of such systems in terms of bipartite or multipartite processes, as is usually done in the framework of stochastic and/or…

Statistical Mechanics · Physics 2020-01-29 R. Chétrite , M. L. Rosinberg , T. Sagawa , G. Tarjus

Flexible information routing fundamentally underlies the function of many biological and artificial networks. Yet, how such systems may specifically communicate and dynamically route information is not well understood. Here we identify a…

Adaptation and Self-Organizing Systems · Physics 2016-07-08 Christoph Kirst , Marc Timme , Demian Battaglia

We introduce the Mutual Information Machine (MIM), a novel formulation of representation learning, using a joint distribution over the observations and latent state in an encoder/decoder framework. Our key principles are symmetry and mutual…

Machine Learning · Statistics 2019-10-10 Micha Livne , Kevin Swersky , David J. Fleet

Information thermodynamics relates the rate of change of mutual information between two interacting subsystems to their thermodynamics when the joined system is described by a bipartite stochastic dynamics satisfying local detailed balance.…

Statistical Mechanics · Physics 2022-08-05 Emanuele Penocchio , Francesco Avanzini , Massimiliano Esposito

While the linear Pearson correlation coefficient represents a well-established normalized measure to quantify the interrelation of two stochastic variables $X$ and $Y$, it fails for multidimensional variables such as Cartesian coordinates.…

Data Analysis, Statistics and Probability · Physics 2024-09-19 Daniel Nagel , Georg Diez , Gerhard Stock

Real-world systems are characterized by complex interactions of their internal degrees of freedom, while living in ever-changing environments whose net effect is to act as additional couplings. Here, we introduce a paradigmatic interacting…

Statistical Mechanics · Physics 2021-11-23 Giorgio Nicoletti , Daniel Maria Busiello

The mutual information (MI) between two random variables is an important correlation measure in data analysis. The Shannon entropy of a joint probability distribution is the variable part under fixed marginals. We aim to minimize and…

Optimization and Control · Mathematics 2025-09-08 Paula Franke , Kay Hamacher , Paul Manns

Understanding dependencies between variables is critical for interpretability and efficient generation in masked diffusion models (MDMs), yet these models primarily expose marginal conditional distributions and do not explicitly represent…

Machine Learning · Computer Science 2026-05-21 Jai Sharma , Yifan Wang , Bryan Li

We derive a tight lower bound on equivocation (conditional entropy), or equivalently a tight upper bound on mutual information between a signal variable and channel outputs. The bound is in terms of the joint distribution of the signals and…

Information Theory · Computer Science 2019-01-14 Michal Hledík , Thomas R. Sokolowski , Gašper Tkačik

We introduce an information-theoretic quantity with similar properties to mutual information that can be estimated from data without making explicit assumptions on the underlying distribution. This quantity is based on a recently proposed…

Machine Learning · Computer Science 2023-07-31 Oscar Skean , Jhoan Keider Hoyos Osorio , Austin J. Brockmeier , Luis Gonzalo Sanchez Giraldo

I present several new relations between mutual information (MI) and statistical estimation error for a system that can be regarded simultaneously as a communication channel and as an estimator of an input parameter. I first derive a…

Applications · Statistics 2010-10-08 Sudhakar Prasad

Conditional Mutual Information (CMI) is a measure of conditional dependence between random variables X and Y, given another random variable Z. It can be used to quantify conditional dependence among variables in many data-driven inference…

Machine Learning · Computer Science 2019-06-10 Sudipto Mukherjee , Himanshu Asnani , Sreeram Kannan

In this work, we consider an upper bound for the quantum mutual information in thermal states of a bipartite quantum system. This bound is related with the interaction energy and logarithm of the partition function of the system. We…

Quantum Physics · Physics 2015-03-20 Aleksey Fedorov , Evgeny Kiktenko

We provide a mutual information lower bound that can be used to analyze the effect of training in models with unknown parameters. For large-scale systems, we show that this bound can be calculated using the difference between two…

Information Theory · Computer Science 2021-08-21 Xiangbo Meng , Kang Gao , Bertrand M. Hochwald

Information-theoretic quantities, such as entropy, are used to quantify the amount of information a given variable provides. Entropies can be used together to compute the mutual information, which quantifies the amount of information two…

Data Analysis, Statistics and Probability · Physics 2014-12-22 Kevin H. Knuth , Deniz Gençağa , William B. Rossow