Related papers: An Entropy Power Inequality for Discrete Random Va…

A common statistical situation concerns inferring an unknown distribution Q(x) from a known distribution P(y), where X (dimension n), and Y (dimension m) have a known functional relationship. Most commonly, n<m, and the task is relatively…

This paper describes an entropy equation, but one that should be used for measuring energy and not information. In relation to the human brain therefore, both of these quantities can be used to represent the stored information. The human…

The fluctuation theorem for entropy production is a remarkable symmetry of the distribution of produced entropy that holds universally in non-equilibrium steady states with Markovian dynamics. However, in systems with slow degrees of…

The 1D Mueller dipole model, its high energy limit, and its generalization were investigated. To address the ambiguity stemming from different definitions of the pseudorapidity ranges in experimental measurements, we propose the entropy as…

For discretisations of hyperbolic conservation laws, mimicking properties of operators or solutions at the continuous (differential equation) level discretely has resulted in several successful methods. While well-posedness for nonlinear…

For $X$, $Y$, $Z$ and $W$ compact metric spaces, consider two uniformly contractive IFS $\{\tau_x: Z\to Z,\, x\in x\}$ and $\{\tau_y:W\to W,\, y\in Y\}$. For a fixed $\alpha \in \mathcal{P}(X)$ with $supp(\alpha)=X$ we define the entropy of…

We introduce and validate a finite-size two-body excess entropy integral equation. By using analytical arguments and computer simulations of prototypical simple liquids, we show that the excess entropy $s_2$ exhibits a finite-size scaling…

We introduce an axiomatic approach to entropies and relative entropies that relies only on minimal information-theoretic axioms, namely monotonicity under mixing and data-processing as well as additivity for product distributions. We find…

We investigate the role of convexity in R\'enyi entropy power inequalities. After proving that a general R\'enyi entropy power inequality in the style of Bobkov-Chistyakov (2015) fails when the R\'enyi parameter $r\in(0,1)$, we show that…

In this work, we consider a recently proposed entropy S (called varentropy) defined by a variational relationship dI=beta*(d<x>-<dx>) as a measure of uncertainty of random variable x. By definition, varentropy underlies a generalized…

We introduce a novel notion of invariance feedback entropy to quantify the state information that is required by any controller that enforces a given subset of the state space to be invariant. We establish a number of elementary properties,…

Let $X$ be an integrable discrete random variable over $\{0, 1, 2, \ldots\}$ with $\mathbb{P}(X = i + 1) \leq \mathbb{P}(X = i)$ for all $i$. Then for any integer $a \geq 1$, $\mathbb{P}(X \leq a) \leq \mathbb{E}[X] / (2a - 1)$. Let $W$ be…

Let $(X,d,T )$ be a topological dynamical system with specification property. For $ \alpha\in \mathbb R^+$ and any $x_0\in X$, define $$ \mathbf D^{x_0}_\alpha :=\Big\{x\in X: \lim\limits_{\epsilon\to…

We present a detailed analysis of numerical discreteness errors in two-species, gravity-only, cosmological simulations using the density power spectrum as a diagnostic probe. In a simple setup where both species are initialized with the…

Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential…

Let $X_{d_1,d_2}$ be an $F$-random variable with numerator and denominator degrees of freedom $d_1$ and $d_2$, respectively. We investigate the inequality: $P\{|X_{d_1,d_2}-E[X_{d_1,d_2}]|\le \sqrt{{\rm Var}(X_{d_1,d_2})}\}\ge…

We study some properties of binary sequences generated by random substitutions of constant length. Specifically, assuming the alphabet $\{0,1\}$, we consider the following asymmetric substitution rule of length $k$: $0 \to \langle 0, 0,…

Researchers in physical science aim to uncover universal features in strongly interacting many-body systems, often hidden in complicated observables like entanglement entropy (EE). The non-local nature of EE makes it challenging to compute…

A quantitative relationship between the diffusion coefficient $D$ of a tagged particle in a liquid and the entropy $S$ of that liquid has long been sought, as it would allow entropy to be inferred directly from diffusion measurements and…

We consider two numerical entropy--type invariants for actions of $\Zk$, invariant under a choice of generators and well-adapted for smooth actions whose individual elements have positive entropy. We concentrate on the maximal rank case,…