Related papers: Entropy of probability kernels from the backwards …
Traditional thermodynamic trade-off relations usually apply to quantities that depend linearly on probability distributions. In contrast, many important information-theoretic measures, such as entropies, are nonlinear and therefore…
Building on the recent work of Johnson (2007) and Yu (2008), we prove that entropy is a concave function with respect to the thinning operation T_a. That is, if X and Y are independent random variables on Z_+ with ultra-log-concave…
Via operator theoretic methods, we formalize the concentration phenomenon for a given observable `$r$' of a discrete time Markov chain with `$\mu_{\pi}$' as invariant ergodic measure, possibly having support on an unbounded state space. The…
To an exact endofunctor of a triangulated category with a split-generator, the notion of entropy is given by Dimitrov-Haiden-Katzarkov-Kontsevich, which is a (possibly negative infinite) real-valued function of a real variable. In this…
The paper is devoted to the investigation of Segal's entropy in semifinite von Neumann algebras. The following questions are dealt with: semicontinuity, the 'ideal-like' structure of the linear span of the set of operators with finite…
Extending our results in "Entropy conjecture for continuous maps of nilmanifolds", to appear in Israel Jour. of Math., we confirm that Entropy Conjecture holds for every continuous self-map of a compact $K(\pi,1)$ manifold with the…
We consider a randomly forced Ginzburg-Landau equation on an unbounded domain. The forcing is smooth and homogeneous in space and white noise in time. We prove existence and smoothness of solutions, existence of an invariant measure for the…
Talagrand's inequalities make a link between two fundamentals concepts of probability: transport of measures and entropy. The study of the counterpart of these inequalities in the context of free probability has been initiated by Biane and…
We develop a theory of classical complexity. We study the relations between classical complexity and entropy, and conjecture that in an isolated system, classical absolute complexity always tends to grow, until it reaches its maximum. We…
Entropy estimation, due in part to its connection with mutual information, has seen considerable use in the study of time series data including causality detection and information flow. In many cases, the entropy is estimated using…
The $f$-invariant is a notion of entropy for probability-measure-preserving actions of free groups. We show it is invariant under bounded orbit-equivalence.
In this paper, we prove that most of the boolean functions, $f : \{-1,1\}^n \rightarrow \{-1,1\}$ satisfy the Fourier Entropy Influence (FEI) Conjecture due to Friedgut and Kalai (Proc. AMS'96). The conjecture says that the Entropy of a…
We consider a new functional inequality controlling the rate of relative entropy decay for random walks, the interchange process and more general block-type dynamics for permutations. The inequality lies between the classical logarithmic…
We study existence and uniqueness of invariant probability measures for continuous-time Markov processes on general state spaces. Existence is obtained from tightness of time averages under a weak regularity assumption inspired by…
Subentropy is an entropy-like quantity that arises in quantum information theory; for example, it provides a tight lower bound on the accessible information for pure state ensembles, dual to the von Neumann entropy upper bound in Holevo's…
We present an upper bound for the Kolmogorov-Sinai entropy of quantum systems having a mixing quantum phase space. The method for this estimation is based on the following ingredients: i) the graininess of quantum phase space in virtue of…
We characterize positive topological entropy for quasi-state space homeomorphisms induced from $C^*$-algebra automorphisms in terms of dynamically generated subspaces isomorphic to $\ell_1$. This geometric condition is also used to give a…
We study the relative entropy of the empirical probability vector with respect to the true probability vector in multinomial sampling of $k$ categories, which, when multiplied by sample size $n$, is also the log-likelihood ratio statistic.…
We introduce the notion of induced topological pressure for countable state Markov shifts with respect to a non-negative scaling function and an arbitrary subset of finite words. Firstly, the scaling function allows a direct access to…
Recently Lewis Bowen introduced a notion of entropy for measure-preserving actions of countable sofic groups admitting a generating measurable partition with finite entropy; and then David Kerr and Hanfeng Li developed an operator-algebraic…