English
Related papers

Related papers: Extropy and Varextropy estimators with application…

200 papers

The entropy is a measure of uncertainty that plays a central role in information theory. When the distribution of the data is unknown, an estimate of the entropy needs be obtained from the data sample itself. We propose a semi-parametric…

Methodology · Statistics 2022-01-06 Stéphane Robin , Luca Scrucca

The investor is interested in the expected return and he is also concerned about the risk and the uncertainty assumed by the investment. One of the most popular concepts used to measure the risk and the uncertainty is the variance and/or…

Statistical Finance · Quantitative Finance 2008-12-02 Andreia Dionisio , Rui Menezes , Diana A. Mendes

We present estimators for entropy and other functions of a discrete probability distribution when the data is a finite sample drawn from that probability distribution. In particular, for the case when the probability distribution is a joint…

comp-gas · Physics 2008-02-03 David H. Wolpert , David R. Wolf

The extropy measure, introduced by Lad, Sanfilippo, and Agro in their (2015) paper in Statistical Science, has garnered significant interest over the past years. In this study, we present a novel representation for the weighted extropy…

Statistics Theory · Mathematics 2024-03-06 Pradeep Kumar Sahu , Nitin Gupta

Many statistical procedures, including goodness-of-fit tests and methods for independent component analysis, rely critically on the estimation of the entropy of a distribution. In this paper, we seek entropy estimators that are efficient…

Statistics Theory · Mathematics 2017-06-23 Thomas B. Berrett , Richard J. Samworth , Ming Yuan

Weighted extropy has recently emerged as a flexible information measure for quantifying uncertainty, with particular relevance to order statistics. In this paper, we introduce and study a weighted cumulative analogue of extropy, extending…

Statistics Theory · Mathematics 2026-04-17 Santosh Kumar Chaudhary , Sarikul Islam , Nitin Gupta

Scientific modeling applications often require estimating a distribution of parameters consistent with a dataset of observations - an inference task also known as source distribution estimation. This problem can be ill-posed, however, since…

Machine Learning · Computer Science 2024-12-02 Julius Vetter , Guy Moss , Cornelius Schröder , Richard Gao , Jakob H. Macke

We review the alternative proposals introduced recently in the literature to update the standard formula to estimate the uncertainty on the mean of repeated measurements, and we compare their performances on synthetic examples with normal…

Data Analysis, Statistics and Probability · Physics 2022-09-13 Pascal Pernot , Jean-Paul Berthet

On account of a greater need for understanding the complexity of time series like physiological time series, financial time series, and many more that enter into picture for their inculpation with real-world problems, several complexity…

Chaotic Dynamics · Physics 2025-02-26 Ritik Roshan Giri , Suchandan Kayal

The profile of a sample is the multiset of its symbol frequencies. We show that for samples of discrete distributions, profile entropy is a fundamental measure unifying the concepts of estimation, inference, and compression. Specifically,…

Machine Learning · Statistics 2020-02-27 Yi Hao , Alon Orlitsky

The relationship between three probability distributions and their maximizable entropy forms is discussed without postulating entropy property. For this purpose, the entropy I is defined as a measure of uncertainty of the probability…

Statistical Mechanics · Physics 2020-10-28 Qiuping A. Wang

Entropy measures of probability distributions are widely used measures in ecology, biology, genetics, and in other fields, to quantify species diversity of a community. Unfortunately, entropy-based diversity indices, or diversity indices…

Populations and Evolution · Quantitative Biology 2014-08-14 Karim T. Abou-Moustafa

We explore the relation between entanglement entropy of quantum many body systems and the distribution of corresponding, properly selected, observables. Such a relation is necessary to actually measure the entanglement entropy. We show that…

Statistical Mechanics · Physics 2009-11-11 Israel Klich , Gil Refael , Alessandro Silva

We introduce two uncertainty measures, say weighted past varentropy (WPVE) and weighted paired dynamic varentropy (WPDVE). Several properties of these proposed measures, including their effect under the monotone transformations are studied.…

Statistics Theory · Mathematics 2025-01-31 Shital Saha , Suchandan Kayal

Existing research on negations primarily focuses on entropy and extropy. Recently, new functions such as varentropy and varextropy have been developed, which can be considered as extensions of entropy and extropy. However, the impact of…

Statistics Theory · Mathematics 2025-04-08 Santosh Kumar Chaudhary , Pradeep Kumar Sahu , Nitin Gupta

Estimating the entropy of a discrete random variable is a fundamental problem in information theory and related fields. This problem has many applications in various domains, including machine learning, statistics and data compression. Over…

Information Theory · Computer Science 2020-12-22 Yuval Shalev , Amichai Painsky , Irad Ben-Gal

We exploit the asymptotic normality of the extreme value theory (EVT) based estimators of the parameters of a symmetric L\'evy-stable distribution, to construct confidence intervals. The accuracy of these intervals is evaluated through a…

Statistics Theory · Mathematics 2019-04-11 Djamel Meraghni , Louiza Soltane

Entropy is one of the key thermodynamic variables reflecting changes in the state of matter. Unlike other thermodynamic variables, it is well-defined also for nonequilibrium steady states through its relation to information. Applying this…

Statistical Mechanics · Physics 2026-04-15 Haim Diamant , Gil Ariel

This paper proposes several tests of restricted specification in nonparametric instrumental regression. Based on series estimators, test statistics are established that allow for tests of the general model against a parametric or…

Econometrics · Economics 2019-09-24 Christoph Breunig

Entropy production is the hallmark of nonequilibrium physics, quantifying irreversibility, dissipation, and the efficiency of energy transduction processes. Despite many efforts, its measurement at the nanoscale remains challenging. We…

Biological Physics · Physics 2024-03-29 I. Di Terlizzi , M. Gironella , D. Herraez-Aguilar , T. Betz , F. Monroy , M. Baiesi , F. Ritort