English
Related papers

Related papers: A new approach to mutual information. II

200 papers

Mutual information $I(X;Y)$ is a useful definition in information theory to estimate how much information the random variable $Y$ holds about the random variable $X$. One way to define the mutual information is by comparing the joint…

Information Theory · Computer Science 2022-04-14 Bulut Kuskonmaz , Jaron Skovsted Gundersen , Rafal Wisniewski

It is well known that quantum mechanics admits a geometric formulation on the complex projective space as a Kahler manifold. In this paper we consider the notion of mutual information among continuous random variables in relation to the…

Mathematical Physics · Physics 2020-04-07 Davide Pastorello

Forecasting techniques for assessing the power of future experiments to discriminate between theories or discover new laws of nature are of great interest in many areas of science. In this paper, we introduce a Bayesian forecasting method…

Data Analysis, Statistics and Probability · Physics 2024-09-24 Mohammad Hossein Namjoo

We investigate the sets of joint probability distributions that maximize the average multi-information over a collection of margins. These functionals serve as proxies for maximizing the multi-information of a set of variables or the mutual…

Information Theory · Computer Science 2019-06-14 Thomas Merkh , Guido Montúfar

A new discrete distribution has been proposed as a discrete analogue of the two sided power distribution [Van Drop, J. R. and Kotz, S. (2002a). A novel extension of the triangular distribution and its parameter estimation, Journal of the…

Statistics Theory · Mathematics 2015-01-27 Subrata Chakraborty , Dhrubajyoti Chakravarty

Correlation function and mutual information are two powerful tools to characterize the correlations in a quantum state of a composite system, widely used in many-body physics and in quantum information science, respectively. We find that…

Quantum Physics · Physics 2015-05-19 R. X. Dong , D. L. Zhou

Regularity properties of the pressure are related to phase transitions. In this article we study thermodynamic formalism for systems defined in non-compact phase spaces, our main focus being countable Markov shifts. We produce metric…

Dynamical Systems · Mathematics 2023-03-28 Godofredo Iommi , Mike Todd

Mutual information is a widely-used information theoretic measure to quantify the amount of association between variables. It is used extensively in many applications such as image registration, diagnosis of failures in electrical machines,…

Computation · Statistics 2021-08-21 Luai Al-Labadi , Forough Fazeli-Asl , Zahra Saberi

In previous papers, we expressed the Entanglement of Formation in terms of Conditional Mutual Information (CMI). In this brief paper, we express the Entanglement of Distillation in terms of CMI.

Quantum Physics · Physics 2007-05-23 Robert R. Tucci

Real-world systems are characterized by complex interactions of their internal degrees of freedom, while living in ever-changing environments whose net effect is to act as additional couplings. Here, we introduce a paradigmatic interacting…

Statistical Mechanics · Physics 2021-11-23 Giorgio Nicoletti , Daniel Maria Busiello

The mutual information (MI) of Poisson-type channels has been linked to a filtering problem since the 70s, but its evaluation for specific continuous-time, discrete-state systems remains a demanding task. As an advantage, Markov renewal…

Information Theory · Computer Science 2024-06-18 Maximilian Gehri , Nicolai Engelmann , Heinz Koeppl

In this paper, we define the topological pressure of continuous functions with respect to the holomorphic correspondences using the open covers of the Riemann sphere. Further, we show that this method coincides with the existing definition…

Dynamical Systems · Mathematics 2026-03-09 Subith Gopinathan

Mutual information is the reciprocal information that is common to or shared by two or more parties. Quantum mutual information for bipartite quantum systems is non-negative, and bears the interpretation of total correlation between the two…

Quantum Physics · Physics 2017-08-02 Asutosh Kumar

In this paper, we consider a dynamical system on the Riemann sphere that evolves through a set-valued map, namely a holomorphic correspondence. Analogous to the investigation of the dynamics effected by a continuous map defined on a compact…

Dynamical Systems · Mathematics 2026-03-05 Subith Gopinathan , Shrihari Sridharan

The persistent mutual information (PMI) is a complexity measure for stochastic processes. It is related to well-known complexity measures like excess entropy or statistical complexity. Essentially it is a variation of the excess entropy so…

Mathematical Physics · Physics 2012-10-19 Peter Gmeiner

This paper develops new methodology, together with related theories, for combining information from independent studies through confidence distributions. A formal definition of a confidence distribution and its asymptotic counterpart (i.e.,…

Statistics Theory · Mathematics 2007-06-13 Kesar Singh , Minge Xie , William E. Strawderman

Mutual information is widely used, in a descriptive way, to measure the stochastic dependence of categorical random variables. In order to address questions such as the reliability of the descriptive value, one must consider…

Machine Learning · Computer Science 2007-07-13 Marcus Hutter , Marco Zaffalon

Given an arbitrary continuous probability density function, it is introduced a conjugated probability density, which is defined through the Shannon information associated with its cumulative distribution function. These new densities are…

Statistics Theory · Mathematics 2018-01-26 H. M. de Oliveira , R. J. Cintra

The goal of this paper is to define and investigate those topological pressures, which is an extension of topological entropy presented by Feng and Huang [13], of continuous transformations. This study reveals the similarity between many…

Dynamical Systems · Mathematics 2013-08-05 Xinjia Tang , Wen-Chiao Cheng , Yun Zhao

We introduce four, a priori different, notions of topological pressure for possibly discontinuous semiflows acting on compact metric spaces and observe that they all agree with the classical one when restricted to the continuous setting.…

Dynamical Systems · Mathematics 2023-02-27 Lucas Backes , Fagner B. Rodrigues