Related papers: Decomposed entropy and estimation of output power …
Distributed systems, such as biological and artificial neural networks, process information via complex interactions engaging multiple subsystems, resulting in high-order patterns with distinct properties across scales. Investigating how…
The Fisher-Snedecor $\mathcal{F}$ distribution has been recently proposed as a more accurate and mathematically tractable composite fading model than traditional established models in some practical cases. In this paper, we firstly derive…
The angular emission pattern of a random laser is typically very irregular and difficult to tune. Here we show by detailed numerical calculations that one can overcome the lack of control over this emission pattern by actively shaping the…
A two parameter generalization of Boltzmann-Gibbs-Shannon entropy based on natural logarithm is introduced. The generalization of the Shannon-Kinchinn axioms corresponding to the two parameter entropy is proposed and verified. We present…
We describe an efficient theoretical criterion, suitable for indistinguishable particles to quantify the quantum correlations of any pure two-fermion state, based on the Slater rank concept. It represents the natural generalization of the…
We propose a method for reconstructing the fluctuation components of the electron velocity distribution function f(v_perp), and the electron entropy, which is a functional of f(v_perp) expressed as -f(v_perp)lnf(v_perp)dv_perp, using the…
A tunable plasma-based energy dechirper has been developed at FLASHForward to remove the correlated energy spread of a 681~MeV electron bunch. Through the interaction of the bunch with wakefields excited in plasma the projected energy…
The metaphor of a potential epigenetic differentiation landscape broadly suggests that during differentiation a stem cell follows the steepest descending gradient toward a stable equilibrium state which represents the final cell type. It…
Shannon entropy in position ($S_{\rvec}$) and momentum ($S_{\pvec}$) spaces, along with their sum ($S_t$) are presented for unit-normalized densities of He, Li$^+$ and Be$^{2+}$ ions, spatially confined at the center of an impenetrable…
We present a new class of estimators of Shannon entropy for severely undersampled discrete distributions. It is based on a generalization of an estimator proposed by T. Schuermann, which itself is a generalization of an estimator proposed…
We extend the angular power density formulae for spontaneous radiation emission from planar undulators to include finite emittance and angular misalignment of the electron beam. Then we calculate and compare power densities estimated from…
We propose a method to derive the stationary size distributions of a system, and the degree distributions of networks, using maximisation of the Gibbs-Shannon entropy. We apply this to a preferential attachment-type algorithm for systems of…
In this article we provide initial findings regarding the problem of solving likelihood equations by means of a maximum entropy approach. Unlike standard procedures that require equating at zero the score function of the maximum-likelihood…
Diffusion probabilistic models (DPMs) have achieved remarkable quality in image generation that rivals GANs'. But unlike GANs, DPMs use a set of latent variables that lack semantic meaning and cannot serve as a useful representation for…
We calculate and analyze various entropy measures and their properties for selected probability distributions. The entropies considered include Shannon, R\'enyi, generalized R\'enyi, Tsallis, Sharma-Mittal, and modified Shannon entropy,…
Information flow analysis is a powerful technique for reasoning about the sensitive information exposed by a program during its execution. While past work has proposed information theoretic metrics (e.g., Shannon entropy, min-entropy,…
The quality of image encryption is commonly measured by the Shannon entropy over the ciphertext image. However, this measurement does not consider to the randomness of local image blocks and is inappropriate for scrambling based image…
Using fluorescence spectroscopy we directly measure entropy production of a single two-level system realized experimentally as an optically driven defect center in diamond. We exploit a recent suggestion to define entropy on the level of a…
High-resolution tunable laser spectroscopy is used to measure time-resolved absorption spectra for ten neutral uranium transitions and six singly-ionized transitions in a laser produced plasma. Spectral lineshapes are analyzed to determine…
We consider the problem of finite sample corrections for entropy estimation. New estimates of the Shannon entropy are proposed and their systematic error (the bias) is computed analytically. We find that our results cover correction…