Related papers: Entropy, subentropy and the elementary symmetric f…
In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be…
Let $f : X\to X$ be a dominating meromorphic map on a compact K\"ahler manifold $X$ of dimension $k$. We extend the notion of topological entropy $h^l_{\mathrm{top}}(f)$ for the action of $f$ on (local) analytic sets of dimension $0\leq l…
Like its precursor this paper is concerned with the Hopf algebra of noncommutative symmetric functions and its graded dual, the Hopf algebra of quasisymmetric functions. It complements and extends the previous paper but is also…
We consider an extension of the conditional min- and max-entropies to infinite-dimensional separable Hilbert spaces. We show that these satisfy characterizing properties known from the finite-dimensional case, and retain…
The Tsallis entropy is shown to be an additive entropy of degree-q that information scientists have been using for almost forty years. Neither is it a unique solution to the nonadditive functional equation from which random entropies are…
We investigate certain optimization problems for Shannon information measures, namely, minimization of joint and conditional entropies $H(X,Y)$, $H(X|Y)$, $H(Y|X)$, and maximization of mutual information $I(X;Y)$, over convex regions. When…
We consider the entropy of sums of independent discrete random variables, in analogy with Shannon's Entropy Power Inequality, where equality holds for normals. In our case, infinite divisibility suggests that equality should hold for…
In this article, we construct semiparametrically efficient estimators of linear functionals of a probability measure in the presence of side information using an easy empirical likelihood approach. We use estimated constraint functions and…
This paper considers the estimation of Shannon entropy for discrete distributions with countably infinite support. While minimax rates for finite-support distributions are established, infinite-support distributions present distinct…
A common statistical situation concerns inferring an unknown distribution Q(x) from a known distribution P(y), where X (dimension n), and Y (dimension m) have a known functional relationship. Most commonly, n<m, and the task is relatively…
A short and elementary proof of the joint convexity of relative entropy is presented, using nothing beyond linear algebra. The key ingredients are an easily verified integral representation and the strategy used to prove the Cauchy-Schwarz…
The main result of this paper is a proof using real analysis of the monotonicity of the topological entropy for the family of quadratic maps, sometimes called Milnor's Monotonicity Conjecture. In contrast, the existing proofs rely in one…
We present a deformed algebra related to the q-exponential and the q-logarithm functions that emerge from nonextensive statistical mechanics. We also develop a q-derivative (and consistently a q-integral) for which the q-exponential is an…
We describe the phenomenology of the classical q-path entropy of a phase-space curve. This allows one to disclose an entropic force-like mechanism that is able to mimic some phenomenological aspects of the strong force, such as confinement,…
In this article, using a known method, a computation is performed of the derivatives of the microcanonical entropy, with respect to the energy up to the 4-th order, using a Laplace transform technique, and adapted it to the case where the…
A quasi-entropy is constructed for tensors averaged by a density function on $SO(3)$ using the log-determinant of a covariance matrix. It serves as a substitution of the entropy for tensors derived from a constrained minimization that…
We develop a new method for studying the asymptotics of symmetric polynomials of representation-theoretic origin as the number of variables tends to infinity. Several applications of our method are presented: We prove a number of theorems…
We show that the typical dynamical system sometimes begins to behave like a non-deterministic system with a small classical entropy, and this behavior lasts an extremely long time, until the system starts decreasing entropy. Then again it…
We introduce subshifts of quasi-finite type as a generalization of the well-known subshifts of finite type. This generalization is much less rigid and therefore contains the symbolic dynamics of many non-uniform systems, e.g., piecewise…
In this paper we derive the Laplace transforms of the integral functionals $$ \int_0^\infty (p(\exp(B^{(\mu)}_t)+1)^{-1}+ q(\exp(B^{(\mu)}_t)+1)^{-2}) dt, $$ $$ \int_0^\infty (p(\exp(R^{(3)}_t)-1)^{-1}+ q(\exp(R^{(3)}_t)-1)^{-2}) dt, $$…