Related papers: Relating information entropy and mass variance to …
The information entropies in coordinate and momentum spaces and their sum ($S_r$, $S_k$, $S$) are evaluated for many nuclei using "experimental" densities or/and momentum distributions. The results are compared with the harmonic oscillator…
During a spontaneous change, a macroscopic physical system will evolve towards a macro-state with more realizations. This observation is at the basis of the Statistical Mechanical version of the Second Law of Thermodynamics, and it provides…
We analyze two volume limited galaxy samples from the SDSS photometric and spectroscopic data to test the isotropy in the local Universe. We use information entropy to quantify the global anisotropy in the galaxy distribution at different…
The entropy is a measure of uncertainty that plays a central role in information theory. When the distribution of the data is unknown, an estimate of the entropy needs be obtained from the data sample itself. We propose a semi-parametric…
We use information entropy to analyze the anisotropy in the mock galaxy catalogues from dark matter distribution and simulated biased galaxy distributions from $\Lambda$CDM N-body simulation. We show that one can recover the linear bias…
Information theoretic measures (entropies, entropy rates, mutual information) are nowadays commonly used in statistical signal processing for real-world data analysis. The present work proposes the use of Auto Mutual Information (Mutual…
Determining the strength of non-linear statistical dependencies between two variables is a crucial matter in many research fields. The established measure for quantifying such relations is the mutual information. However, estimating mutual…
Prompted by the realisation that the statistical entropy of an ideal gas in the micro-canonical ensemble should not fluctuate or change over time, the meaning of the H-theorem is re-interpreted from the perspective of information theory in…
Heterogeneity in dynamics in the form of non-Gaussian molecular displacement distributions appears ubiquitously in soft matter. We address the quantification of such heterogeneity using an information-theoretic measure of the distance…
This study explores the role of information entropy in understanding nuclear density distributions, including both stable configurations and non-traditional structures such as neutron halos and $\alpha$-clustering. By quantifying the…
We extend previously proposed measures of complexity, emergence, and self-organization to continuous distributions using differential entropy. This allows us to calculate the complexity of phenomena for which distributions are known. We…
A non-zero mutual information between morphology of a galaxy and its large-scale environment is known to exist in SDSS upto a few tens of Mpc. It is important to test the statistical significance of these mutual information if any. We…
Information theory is an outstanding framework to measure uncertainty, dependence and relevance in data and systems. It has several desirable properties for real world applications: it naturally deals with multivariate data, it can handle…
We consider the problem of learning a target probability distribution over a set of $N$ binary variables from the knowledge of the expectation values (with this target distribution) of $M$ observables, drawn uniformly at random. The space…
Supplement 1 to GUM (GUM-S1) recommends the use of maximum entropy principle (MaxEnt) in determining the probability distribution of a quantity having specified properties, e.g., specified central moments. When we only know the mean value…
In this paper, we analyze the relationship between entropy and information in the context of the mixing process of two identical ideal gases. We will argue that entropy has a special information-based feature that is enfolded in the…
The information shared among observables representing processes of interest is traditionally evaluated in terms of macroscale measures characterizing aggregate properties of the underlying processes and their interactions. Traditional…
We present results of the investigations of the statistical properties of a joint density and velocity divergence probability distribution function (PDF) in the mildly non-linear regime. For that purpose we use both perturbation theory…
Epidemic models with inhomogeneous populations have been used to study major outbreaks and recently Britton and Lindenstrand \cite{BL} described the case when latency and infectivity have independent gamma distributions. They found that…
It is well known that entropy production is a proxy to the detection of non-equilibrium, i.e. of the absence of detailed balance; however, due to the global character of this quantity, its knowledge does not allow to identify spatial…