English
Related papers

Related papers: Derangetropy in Probability Distributions and Info…

200 papers

In this chapter, a statistical measure of complexity and the Fisher-Shannon information product are introduced and their properties are discussed. These measures are based on the interplay between the Shannon information, or a function of…

Chaotic Dynamics · Physics 2012-01-13 Ricardo Lopez-Ruiz , Jaime Sanudo , Elvira Romera , Xavier Calbet

Statistical properties of coupled dynamic-stochastic systems are studied within a combination of the maximum information principle and the superstatistical approach. The conditions at which the Shannon entropy functional leads to a…

Statistical Mechanics · Physics 2009-11-11 E. V. Vakarin , J. P. Badiali

How does the information flow between different brain regions during various stimuli? This is the question we aim to address by studying complex cognitive paradigms in terms of Information Theory. To assess creativity and the emergence of…

Neurons and Cognition · Quantitative Biology 2025-07-08 Ania Mesa-Rodríguez , Ernesto Estevez-Rams , Holger Kantz

In mathematics information is a number that measures uncertainty (entropy) based on a probabilistic distribution, often of an obscure origin. In real life language information is a datum, a statement, more precisely, a formula. But such a…

Artificial Intelligence · Computer Science 2022-05-17 Anatol Slissenko

We propose new measures of shared information, unique information and synergistic information that can be used to decompose the multi-information of a pair of random variables $(Y,Z)$ with a third random variable $X$. Our measures are…

Information Theory · Computer Science 2014-06-18 Nils Bertschinger , Johannes Rauh , Eckehard Olbrich , Jürgen Jost , Nihat Ay

We introduce a class of information measures based on group entropies, allowing us to describe the information-theoretical properties of complex systems. These entropic measures are nonadditive, and are mathematically deduced from a series…

Statistical Mechanics · Physics 2019-10-21 Piergiulio Tempesta , Henrik Jeldtoft Jensen

In this article, we discuss the problem of establishing relations between information measures assessed for network structures. Two types of entropy based measures namely, the Shannon entropy and its generalization, the R\'{e}nyi entropy…

Information Theory · Computer Science 2013-01-24 Lavanya Sivakumar , Matthias Dehmer

This survey is dedicated to a new direction in the theory of dynamical systems: the dynamics of metrics in measure spaces and new (catalytic) invariants of transformations with invariant measure. A space equipped with a measure and a metric…

Dynamical Systems · Mathematics 2023-11-27 A. M. Vershik , G. A. Veprev , P. B. Zatitskii

A change in a stochastic system has three representations: Probabilistic, statistical, and informational: (i) is based on random variable $u(\omega)\to\tilde{u}(\omega)$; this induces (ii) the probability distributions $F_u(x)\to…

Statistical Mechanics · Physics 2019-02-27 Hong Qian , Yu-Chen Cheng , Lowell F. Thompson

Commonly observed patterns typically follow a few distinct families of probability distributions. Over one hundred years ago, Karl Pearson provided a systematic derivation and classification of the common continuous distributions. His…

Probability · Mathematics 2011-02-28 Steven A. Frank , Eric Smith

We propose to examine the predictability and the complexity characteristics of the Standard&Poor500 dynamics behaviors in a coarse-grained way using the symbolic dynamics method and under the prism of the Information theory through the…

Statistical Finance · Quantitative Finance 2021-05-11 Geoffrey Ducournau

Markov Random Field models are powerful tools for the study of complex systems. However, little is known about how the interactions between the elements of such systems are encoded, especially from an information-theoretic perspective. In…

Information Theory · Computer Science 2015-03-19 Alexandre L. M. Levada

Aging is a universal consequence of life, yet researchers have identified no universal theme. This manuscript considers aging from the perspective of entropy, wherein things fall apart. We first examine biological information change as a…

Populations and Evolution · Quantitative Biology 2026-04-13 Stephan Baehr , Hans Baehr

We propose utilizing entropy as a diagnostic tool to distinguish between constant and dynamical dark energy models. Entropy, a measure of the system's disorder or information content, captures the complexity and evolution of the universe.…

General Relativity and Quantum Cosmology · Physics 2025-07-16 Tanisha Joshi

The past entropy is considered as an uncertainty measure for the past lifetime distribution. Generating function approach to entropy become popular in recent time as it generate several well-known entropy measures. In this paper, we…

Information Theory · Computer Science 2023-12-06 Smitha S. , Sudheesh K Kattumannil

Finding interdependency relations between (possibly multivariate) time series provides valuable knowledge about the processes that generate the signals. Information theory sets a natural framework for non-parametric measures of several…

Information Theory · Computer Science 2016-02-09 German Gomez-Herrero , Wei Wu , Kalle Rutanen , Miguel C. Soriano , Gordon Pipa , Raul Vicente

In reliability theory and survival analysis, the residual entropy is known as a measure suitable to describe the dynamic information content in stochastic systems conditional on survival. Aiming to analyze the variability of such…

Statistics Theory · Mathematics 2020-03-25 Antonio Di Crescenzo , Luca Paolillo

We introduce novel information-entropic variables -- a Point Divergence Gain (${\Omega}^{(l \rightarrow m)}_\alpha$), a Point Divergence Gain Entropy ($I_\alpha$), and a Point Divergence Gain Entropy Density ($P_\alpha$) -- which are…

Data Analysis, Statistics and Probability · Physics 2018-02-07 Renata Rychtáriková , Jan Korbel , Petr Macháček , Dalibor Štys

Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible $N$--point correlation is measured by a decrease…

Biological Physics · Physics 2016-09-08 Elad Schneidman , Susanne Still , Michael J. Berry , William Bialek

In this paper, we investigate several properties of the weighted varextropy measure and obtain it for specific distribution functions, such as the equilibrium and weighted distributions. We also obtain bounds for the weighted varextropy, as…

Statistics Theory · Mathematics 2025-07-01 Faranak Goodarzi