Related papers: An information diffusion Fano inequality
Directed information or its variants are utilized extensively in the characterization of the capacity of channels with memory and feedback, nonanticipative lossy data compression, and their generalizations to networks. In this paper, we…
In this paper, we first describe the generalized notion of Cramer-Rao lower bound obtained by Naudts (2004) using two families of probability density functions, the original model and an escort model. We reinterpret the results in Naudts…
This paper deals with Cram\'er-Rao inequalities in the context of nonextensive statistics and in estimation theory. It gives characterizations of generalized q-Gaussian distributions, and introduces generalized versions of Fisher…
This is a survey paper with some original results of the author on refined versions of the Azuma-Hoeffding inequality with some examples that are related to information theory. This work has evolved to the joint paper with Maxim Raginsky in…
This paper examines how an event from one random variable provides pointwise mutual information about an event from another variable via probability mass exclusions. We start by introducing probability mass diagrams, which provide a visual…
The invariant response was defined from a formulation of the fluctuation-response theorem in the space of probability distributions. An inequality is here conjectured which sets the mutual information as an upper bound to the invariant…
Hidden stochastic effects acting uniformly on a many-particle system can generate strong correlations and macroscopic relative fluctuations that persist at large system sizes, even when the particles themselves remain causally independent.…
This correspondence studies an estimator of the conditional support of a distribution underlying a set of i.i.d. observations. The relation with mutual information is shown via an extension of Fano's theorem in combination with a…
The performance of standard learning procedures has been observed to differ widely across groups. Recent studies usually attribute this loss discrepancy to an information deficiency for one group (e.g., one group has less data). In this…
We give a concentration inequality based on the premise that random variables take values within a particular region. The concentration inequality guarantees that, for any sequence of correlated random variables, the difference between the…
The aim of this paper is to provide a self-contained proof of a general case of the coarea inequality, also known as the Eilenberg inequality. The result is known, but we are not aware of any place that a proof would be written with all…
Across income groups and countries, individual citizens perceive economic inequality spectacularly wrong. These misperceptions have far-reaching consequences, as it is perceived inequality, not actualinequality informing redistributive…
The paper deals with a generalisation of uniform distribution. The analogues of Weyl's criterion are derived.
Many biological phenomena or social events critically depend on how information evolves in complex networks. However, a general theory to characterize information evolution is yet absent. Consequently, numerous unknowns remain about the…
We establish an information inequality that is intimately connected to the evaluation of the sum rate given by Marton's inner bound for two receiver broadcast channels with a binary input alphabet. This generalizes a recent result where the…
In this paper, a network-based stochastic information propagation model is developed. The information flow is modeled by a probabilistic differential equation system. The numerical solution of these equations leads to the expected number of…
We study the propagation of waves in a quasi 1D homogeneous host medium filled with various resonators. We first prove that a far field coupling between the elements explains its dispersive nature. This coupling is interpreted as a Fano…
Information diffusion on social networks has been described as a collective outcome of threshold behaviors in the framework of threshold models. However, since the existing models do not take into account individuals' optimization problem,…
In this paper we introduce a new generalisation of the relative Fisher Information for Markov jump processes on a finite or countable state space, and prove an inequality which connects this object with the relative entropy and a large…
We give an elementary estimate that entails and generalises numerous Korn inequalities scattered in the literature. As special instances, we obtain general Korn-type inequalities involving normal or tangential trace components, or lower…