English
Related papers

Related papers: Statistical Properties of the Entropy from Ordinal…

200 papers

This paper investigates what can be inferred about an arbitrary continuous probability distribution from a finite sample of $N$ observations drawn from it. The central finding is that the $N$ sorted sample points partition the real line…

Machine Learning · Statistics 2025-07-30 Urban Eriksson

Frequentists' inference often delivers point estimators associated with confidence intervals or sets for parameters of interest. Constructing the confidence intervals or sets requires understanding the sampling distributions of the point…

Statistics Theory · Mathematics 2016-10-18 Xinran Li , Peng Ding

Quantifying the similarity between symbolic sequences is a traditional problem in Information Theory which requires comparing the frequencies of symbols in different sequences. In numerous modern applications, ranging from DNA over music to…

Physics and Society · Physics 2016-04-18 Martin Gerlach , Francesc Font-Clos , Eduardo G. Altmann

'Causal' direction is of great importance when dealing with complex systems. Often big volumes of data in the form of time series are available and it is important to develop methods that can inform about possible causal connections between…

Statistical Mechanics · Physics 2014-01-24 Fatimah Abdul Razak , Henrik Jeldtoft Jensen

We give the first sample complexity characterizations for outcome indistinguishability, a theoretical framework of machine learning recently introduced by Dwork, Kim, Reingold, Rothblum, and Yona (STOC 2021). In outcome…

Machine Learning · Computer Science 2022-03-10 Lunjia Hu , Charlotte Peale , Omer Reingold

The present study defines a new statistic for detecting laboratory effects in the analysis of ordinal variation (ORDANOVA). The ORDANOVA is an analysis method similar to one-way analysis of variance for analysing ordinal data obtained from…

Applications · Statistics 2022-02-10 Jun-ichi Takeshita , Yuto Arai , Mayu Ogawa , Xiao-Nan Lu , Tomomichi Suzuki

We consider the problem of approximating the empirical Shannon entropy of a high-frequency data stream under the relaxed strict-turnstile model, when space limitations make exact computation infeasible. An equivalent measure of entropy is…

Computation · Statistics 2013-04-18 Peter Clifford , Ioana Ada Cosma

We propose a new interpretation of measures of information and disorder by connecting these concepts to group theory in a new way. Entropy and group theory are connected here by their common relation to sets of permutations. A combinatorial…

Information Theory · Computer Science 2019-11-25 David J. Galas

To quantify the complexity of a system, entropy-based methods have received considerable critical attentions in real-world data analysis. Among numerous entropy algorithms, amplitude-based formulas, represented by Sample Entropy, suffer…

Signal Processing · Electrical Eng. & Systems 2022-01-12 Hongjian Xiao , Danilo P. Mandic

We present a numerical study of the application of the Shannon entropy technique to the planar restricted three-body problem in the vicinity of first-order interior mean-motion resonances with the perturber. We estimate the diffusion…

Chaotic Dynamics · Physics 2020-01-08 C. Beaugé , P. M. Cincotta

We consider the classical sequential binary hypothesis testing problem in which there are two hypotheses governed respectively by distributions $P_0$ and $P_1$ and we would like to decide which hypothesis is true using a sequential test. It…

Information Theory · Computer Science 2020-07-01 Yonglong Li , Vincent Y. F. Tan

We study sequential multiple testing with independent data streams, where the goal is to identify an unknown subset of signals while controlling commonly used error metrics, including generalized familywise rates and false discovery and…

Statistics Theory · Mathematics 2026-03-06 Jingyu Liu , Yanglei Song

Permutation entropy measures the complexity of deterministic time series via a data symbolic quantization consisting of rank vectors called ordinal patterns or just permutations. The reasons for the increasing popularity of this entropy in…

Data Analysis, Statistics and Probability · Physics 2021-03-08 José M. Amigó , Roberto Dale , Piergiulio Tempesta

In this work we introduce a method for estimating entropy rate and entropy production rate from finite symbolic time series. From the point of view of statistics, estimating entropy from a finite series can be interpreted as a problem of…

Statistical Mechanics · Physics 2021-02-24 Raul Salgado-Garcia , Cesar Maldonado

Consider tossing a collection of coins, each fair or biased towards heads, and take the distribution of the total number of heads that result. It is natural to conjecture that this distribution should be 'more random' when each coin is…

Probability · Mathematics 2019-11-20 Erwan Hillion , Oliver Johnson

We calculate and analyze various entropy measures and their properties for selected probability distributions. The entropies considered include Shannon, R\'enyi, generalized R\'enyi, Tsallis, Sharma-Mittal, and modified Shannon entropy,…

Information Theory · Computer Science 2024-11-26 Iryna Bodnarchuk , Yuliya Mishura , Kostiantyn Ralchenko

We show how the Shannon entropy function can be used as a basis to set up complexity measures weighting the economic efficiency of countries and the specialization of products beyond bare diversification. This entropy function guarantees…

Physics and Society · Physics 2021-06-04 Gianluca Teza , Michele Caraglio , Attilio L. Stella

We consider the sequential composite binary hypothesis testing problem in which one of the hypotheses is governed by a single distribution while the other is governed by a family of distributions whose parameters belong to a known set…

Information Theory · Computer Science 2022-03-30 Jiachun Pan , Yonglong Li , Vincent Y. F. Tan

In this study, the cumulative effect of the empirical probability distribution of a random variable is identified as a factor that amplifies the occurrence of extreme events in datasets. To quantify this observation, a corresponding…

Maximum entropy models are increasingly being used to describe the collective activity of neural populations with measured mean neural activities and pairwise correlations, but the full space of probability distributions consistent with…

Biological Physics · Physics 2017-08-22 Badr F. Albanna , Christopher Hillar , Jascha Sohl-Dickstein , Michael R. DeWeese