Related papers: Entropy, subentropy and the elementary symmetric f…
Entropic Dynamics (ED) is a framework in which Quantum Mechanics is derived as an application of entropic methods of inference. In ED the dynamics of the probability distribution is driven by entropy subject to constraints that are codified…
After studying some properties of the generalized exponential and logarithmic function, in particular investigating the domain where the first maintains itself real and positive, and outlining how the known dualities $q \leftrightarrow…
We solve Talagrand's entropy problem: the L_2-covering numbers of every uniformly bounded class of functions are exponential in its shattering dimension. This extends Dudley's theorem on classes of {0,1}-valued functions, for which the…
We describe quantum entropic functionals and outline a research program dealing with entropic fluctuations in non-equilibrium quantum statistical mechanics.
Entropy and differential entropy are important quantities in information theory. A tractable extension to singular random variables-which are neither discrete nor continuous-has not been available so far. Here, we present such an extension…
We study the convexity of the entropy functional along particular interpolating curves defined on the space of finitely supported probability measures on a graph.
Entropy-type integral functionals of densities are widely used in mathematical statistics, information theory, and computer science. Examples include measures of closeness between distributions (e.g., density power divergence) and…
Various lower bounds are established for the entropy of sums, products and their combinations. First, we derive a prime-field analogue of a version of the entropy power inequality established by Tao over torsion-free groups. Next, we prove…
Entropic Dynamics (ED) is a framework in which Quantum Mechanics (QM) is derived as an application of entropic methods of inference. The magnitude of the wave function is manifestly epistemic: its square is a probability distribution. The…
After reviewing the entropy power, the McKean, and the Gaussian completely monotone conjectures, we prove that the first implies the second, for each order of the time-derivative. The proof is elementary and is based on manipulating the…
In this paper, we introduce two bounds which we call the Upper Differential Entropy and the Lower Differential Entropy for an infinite family of intervals(strips) in quantum field theory. The two bounds are equal provided that the theory is…
We consider the differential entropy of probability measures absolutely continuous with respect to a given $\sigma$-finite reference measure on an arbitrary measurable space. We state the asymptotic equipartition property in this general…
We derive the asymptotic distribution of ordinal-pattern frequencies under weak dependence conditions and investigate the long-run covariance matrix not only analytically for moving-average, Gaussian, and the novel generalized coin-tossing…
We use Bowen's definition of topological entropy and Ahlfors five islands theorem, as well as the theory of polynomial-like mappings, to show that the topological entropy of any entire transcendental function is infinity. In addition the…
We examine the {combinatorial} or {probabilistic} definition ("Boltzmann's principle") of the entropy or cross-entropy function $H \propto \ln \mathbb{W}$ or $D \propto - \ln \mathbb{P}$, where $\mathbb{W}$ is the statistical weight and…
In this paper we develop the following general approach. We study asymptotic behavior of the entropy numbers not for an individual smoothness class, how it is usually done, but for the collection of classes, which are defined by integral…
In this paper we present several new classes of logarithmically completely monotonic functions. Our functions have in common that they are defined in terms of the $q-$gamma and $q-$digamma functions. As an applications of this results, some…
An attempt is made to construct composable composite entropy with different $q$ indices of subsystems and address the H-theorem problem of the composite system. Though the H-theorem does not hold in general situations, it is shown that some…
The notion of utility maximising entropy (u-entropy) of a probability density, which was introduced and studied by Slomczynski and Zastawniak (Ann. Prob 32 (2004) 2261-2285, arXiv:math.PR/0410115 v1), is extended in two directions. First,…
We discuss how the method of maximum entropy, MaxEnt, can be extended beyond its original scope, as a rule to assign a probability distribution, to a full-fledged method for inductive inference. The main concept is the (relative) entropy…