Related papers: Relationships between cumulative entropy/extropy, …
We establish upper and lower bounds for the metric entropy and bracketing entropy of the class of $d$-dimensional bounded monotonic functions under $L^p$ norms. It is interesting to see that both the metric entropy and bracketing entropy…
First, we present a concise glossary of formulas for composition of standard, cumulant, factorial, and factorial cumulant moments in superposition (compound) models, where final particles are created via independent emission from a…
In this paper, we consider the concept of the residual inaccuracy measure and extend it to its weighted version based on extropy. Properties of this measure are studied and the discrimination principle is applied in the class of…
Employing the Verlinde's hypothesis, and considering two well-known generalized entropy formalisms, two modifications to the Newtonian gravity are derived. In addition, it has been shown that the generalized entropy measures may also…
This paper introduces and studies a new uncertainty measure, the cumulative residual interval entropy (CRIE). Defined as the cumulative residual entropy of a doubly truncated (interval) continuous random variable, this measure has several…
Relative entropy is a powerful measure of the dissimilarity between two statistical field theories in the continuum. In this work, we study the relative entropy between Gaussian scalar field theories in a finite volume with different masses…
We present estimators for entropy and other functions of a discrete probability distribution when the data is a finite sample drawn from that probability distribution. In particular, for the case when the probability distribution is a joint…
This paper provides tight bounds on the R\'enyi entropy of a function of a discrete random variable with a finite number of possible values, where the considered function is not one-to-one. To that end, a tight lower bound on the R\'enyi…
We review the behaviour of the Gibbs' and conditional entropies in deterministic and stochastic systems and continue to a formulation appropriate for a stochastically perturbed system with delayed dynamics. The underlying question driving…
We introduce a new information-theoretic formulation of quantum measurement uncertainty relations, based on the notion of relative entropy between measurement probabilities. In the case of a finite-dimensional system and for any approximate…
The routine definitions of both entropy, and differential entropy show inconsistencies that make them not reciprocally coherent. We propose a few possible modifications of these quantities so that 1) they no longer show incongruities, 2)…
In this paper, we consider the global comparison problem of Gini means with fixed number of variables on a subinterval $I$ of $\mathbb{R}_+$, i.e., the following inequality \begin{align}\tag{$\star$}\label{ggcabs}…
We discuss the information entropy for a general open pointer-based simultaneous measurement and show how it is bound from below. This entropic uncertainty bound is a direct consequence of the structure of the entropy and can be obtained…
The general weighted cumulative residual extropy (GWCRJ) and general weighted cumulative past extropy (GWCPJ) are introduced in this paper. There are some results in relation to GWCPJ and GWCRJ. We take into account GWCRJ-based uncertainty…
A novel heuristic approach is proposed here for time series data analysis, dubbed Generalized weighted permutation entropy, which amalgamates and generalizes beyond their original scope two well established data analysis methods:…
Statistical Physics, Diffusion Entropy Analysis and Information Theory commonly use Mathai's entropy which measures the randomness of probability laws, whereas welfare economics and the Social Sciences commonly use Gini index which measures…
The Generalized Mallows Model (GMM) is a well known family of models for ranking data. A GMM is a distribution over $\mathbb{S}_n$, the set of permutations of n objects, characterized by a location parameter $\sigma \in \mathbb{S}_n$, known…
Since Bandt et al. have shown that the permutation entropy and the Kolmogorov-Sinai entropy coincide for piecewise monotone interval maps, the relationship of both entropies for time-discrete dynamical systems is of a certain interest. The…
Obtaining meaningful quantitative descriptions of the statistical dependence within multivariate systems is a difficult open problem. Recently, the Partial Information Decomposition (PID) was proposed to decompose mutual information (MI)…
The uncertainty relation for continuous variables due to Byalinicki-Birula and Mycielski expresses the complementarity between two $n$-uples of canonically conjugate variables $(x_1,x_2,\cdots x_n)$ and $(p_1,p_2,\cdots p_n)$ in terms of…