English
Related papers

Related papers: Point Divergence Gain and Multidimensional Data Se…

200 papers

The stochastic entropy generated during the evolution of a system interacting with an environment may be separated into three components, but only two of these have a non-negative mean. The third component of entropy production is…

Statistical Mechanics · Physics 2013-05-30 Ian J. Ford , Richard E. Spinney

We undertake a critical evaluation of recent observational information on $\Omega_m$ and $\Omega_\Lambda$ in order to identify possible sources of systematic errors and effects of simplified statistical analyses. We combine observations for…

Astrophysics · Physics 2009-11-06 S. M. Harun-or-Rashid , M. Roos

A surrogate data analysis is presented, which is based on the fluctuations of the ``entropy'' $S$ defined in the natural time-domain [Phys. Rev. E {\bf 68}, 031106, 2003]. This entropy is not a static one as, for example, the Shannon…

Data Analysis, Statistics and Probability · Physics 2007-05-23 P. A. Varotsos , N. V. Sarlis , E. S. Skordas , M. S. Lazaridou

Permutation entropy quantifies the diversity of possible orderings of the values a random or deterministic system can take, as Shannon entropy quantifies the diversity of values. We show that the metric and permutation entropy…

Chaotic Dynamics · Physics 2016-08-16 Jose M. Amigo , Matthew B. Kennel , Ljupco Kocarev

An interesting line of research is the investigation of the laws of random variables known as Dirichlet means. However, there is not much information on interrelationships between different Dirichlet means. Here, we introduce two…

Statistics Theory · Mathematics 2010-10-11 Lancelot F. James

A novel method for correlation analysis using scale-dependent Renyi entropies is described. The method involves calculating the entropy of a data distribution as an explicit function of the scale of a d-dimensional partition of d-cubes,…

Mathematical Physics · Physics 2007-05-23 J. G. Reid , T. A. Trainor

In this paper, we obtain general representations for the joint distributions and copulas of arbitrary dependent random variables absolutely continuous with respect to the product of given one-dimensional marginal distributions. The…

Statistics Theory · Mathematics 2016-08-16 Victor H. de la Peña , Rustam Ibragimov , Shaturgun Sharakhmetov

Starting from the geometrical interpretation of the R\'enyi entropy, we introduce further extensive generalizations and study their properties. In particular, we found the probability distribution function obtained by the MaxEnt principle…

Statistical Mechanics · Physics 2015-06-17 Giorgio Sonnino , György Steinbrecher

R\'enyi divergence is related to R\'enyi entropy much like information divergence (also called Kullback-Leibler divergence or relative entropy) is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as…

Information Theory · Computer Science 2010-05-28 Tim van Erven , Peter Harremoës

In this paper we propose a family of multivariate asymmetric distributions over an arbitrary subset of set of real numbers which is defined in terms of the well-known elliptically symmetric distributions. We explore essential properties,…

Methodology · Statistics 2024-09-02 Roberto Vila , Helton Saulo , Leonardo Santos , João Monteiros , Felipe Quintino

The software Randentropy is designed to estimate inequality in a random system where several individuals interact moving among many communities and producing dependent random quantities of an attribute. The overall inequality is assessed by…

Statistical Finance · Quantitative Finance 2021-03-17 Guglielmo D'Amico , Stefania Scocchera , Loriano Storchi

We study offline change point localization and inference in dynamic multilayer random dot product graphs (D-MRDPGs), where at each time point, a multilayer network is observed with shared node latent positions and time-varying,…

Methodology · Statistics 2025-06-30 Fan Wang , Kyle Ritscher , Yik Lun Kei , Xin Ma , Oscar Hernan Madrid Padilla

The time variation of entropy, as an alternative to the variance, is proposed as a measure of the diffusion rate. It is shown that for linear and time-translationally invariant systems having a large-time limit for the density, at large…

Statistical Mechanics · Physics 2013-05-24 Amir Aghamohammadi , Amir H. Fatollahi , Mohammad Khorrami , Ahmad Shariati

Probability distributions of money, income, and energy consumption per capita are studied for ensembles of economic agents. The principle of entropy maximization for partitioning of a limited resource gives exponential distributions for the…

Statistical Finance · Quantitative Finance 2010-09-02 Anand Banerjee , Victor M. Yakovenko

A new probability distribution to study lifetime data in reliability is introduced in this paper. This one is a first approach to a non-homogeneous phase-type distribution. It is built by considering one cut-point in the non-negative…

Methodology · Statistics 2025-01-15 Christian Acal , Juan Eloy Ruiz-Castro , David Maldonado , Juan B. Roldán

The space-averaged phase-space density and entropy per particle are both fundamental observables which can be extracted from the two-particle correlation functions measured in heavy-ion collisions. Two techniques have been proposed to…

Nuclear Theory · Physics 2009-11-06 David A. Brown , Sergei Y. Panitkin , George F. Bertsch

In this article, we proposed a new probability distribution named as power Maxwell distribution (PMaD). It is another extension of Maxwell distribution (MaD) which would lead more flexibility to analyze the data with non-monotone failure…

Applications · Statistics 2018-07-04 Abhimanyu Singh Yadav , Hassan S. Bakouch , Sanjay Kumar Singh , Umesh Singh

The weak law of large numbers implies that, under mild assumptions on the source, the Renyi entropy per produced symbol converges (in probability) towards the Shannon entropy rate. This paper quantifies the speed of this convergence for…

Information Theory · Computer Science 2017-05-01 Maciej Skorski

The principle of entropy increase is not only the basis of statistical mechanics, but also closely related to the irreversibility of time, the origin of life, chaos and turbulence. In this paper, we first discuss the dynamic system…

Statistical Mechanics · Physics 2022-10-11 Zou Dan Dan

The interactions between three or more random variables are often nontrivial, poorly understood, and yet, are paramount for future advances in fields such as network information theory, neuroscience, genetics and many others. In this work,…

Information Theory · Computer Science 2016-04-20 Fernando Rosas , Vasilis Ntranos , Christopher J. Ellison , Sofie Pollin , Marian Verhelst