English
Related papers

Related papers: On extropy of past lifetime distribution

200 papers

The concept of Entropy plays a key role in Information Theory, Statistics, and Machine Learning.This paper introduces a new entropy measure, called the t-entropy, which exploits the concavity of the inverse-tan function. We analytically…

Information Theory · Computer Science 2021-05-06 Saptarshi Chakraborty , Debolina Paul , Swagatam Das

Entropy is useful in statistical problems as a measure of irreversibility, randomness, mixing, dispersion, and number of microstates. However, there remains ambiguity over the precise mathematical formulation of entropy, generalized beyond…

Statistical Mechanics · Physics 2023-08-21 Vladimir Zhdankin

We define an entropy based on a chosen governing probability distribution. If a certain kind of measurements follow such a distribution it also gives us a suitable scale to study it with. This scale will appear as a link function that is…

Data Analysis, Statistics and Probability · Physics 2007-10-24 Peter Sunehag

In this paper we study the problem of computing max-entropy distributions over a discrete set of objects subject to observed marginals. Interest in such distributions arises due to their applicability in areas such as statistical physics,…

Data Structures and Algorithms · Computer Science 2013-05-02 Mohit Singh , Nisheeth K. Vishnoi

We explore the relation between entanglement entropy of quantum many body systems and the distribution of corresponding, properly selected, observables. Such a relation is necessary to actually measure the entanglement entropy. We show that…

Statistical Mechanics · Physics 2009-11-11 Israel Klich , Gil Refael , Alessandro Silva

Entropy measures have become increasingly popular as an evaluation metric for complexity in the analysis of time series data, especially in physiology and medicine. Entropy measures the rate of information gain, or degree of regularity in a…

Methodology · Statistics 2015-12-03 Chee Chun Gan , Gerard Learmonth

We claim that looking at probability distributions of \emph{finite time} largest Lyapunov exponents, and more precisely studying their large deviation properties, yields an extremely powerful technique to get quantitative estimates of…

Chaotic Dynamics · Physics 2009-10-20 Roberto Artuso , Cesar Manchein

In this paper, I expand Shannon's definition of entropy into a new form of entropy that allows integration of information from different random events. Shannon's notion of entropy is a special case of my more general definition of entropy.…

Machine Learning · Computer Science 2008-11-04 Stefan Jaeger

Entropic uncertainty relations demonstrate the intrinsic uncertainty of nature from an information-theory perspective. Recently, a quantum-memory-assisted entropic uncertainty relation for multiple measurements was proposed by Wu $et\ al.$…

Quantum Physics · Physics 2023-07-26 Qing-Hua Zhang , Shao-Ming Fei

The R\'{e}nyi cross-entropy measure between two distributions, a generalization of the Shannon cross-entropy, was recently used as a loss function for the improved design of deep learning generative adversarial networks. In this work, we…

Information Theory · Computer Science 2022-08-09 Ferenc Cole Thierrin , Fady Alajaji , Tamás Linder

This paper addresses the question of the fluctuations of the empirical entropy of a chain of infinite order. We assume that the chain takes values on a finite alphabet and loses memory exponentially fast. We consider two possible…

Statistical Mechanics · Physics 2007-05-23 D. Gabrielli , A. Galves , D. Guiol

We define a measure of redundant information based on projections in the space of probability distributions. Redundant information between random variables is information that is shared between those variables. But in contrast to mutual…

Information Theory · Computer Science 2013-05-30 Malte Harder , Christoph Salge , Daniel Polani

We study the problem of comparing ageing patterns of the lifetime of k-out-of-n systems. Mathematically, this reduces to being able to decide about a stochastic ordering relationship between different order statistics. We discuss such…

Methodology · Statistics 2020-06-04 Tommaso Lando , Idir Arab , Paulo Eduardo Oliveira

In recent years, the complementary dual of entropy, known as extropy, has emerged as a valuable tool for quantifying uncertainty in probability distributions. This work investigates the behavior of failure extropy in the multidimensional…

Statistics Theory · Mathematics 2025-09-16 Aman Pandey , Chanchal Kundu

The folding entropy is a quantity originally proposed by Ruelle in 1996 during the study of entropy production in the non-equilibrium statistical mechanics. As derived through a limiting process to the non-equilibrium steady state, the…

Dynamical Systems · Mathematics 2020-09-03 Gang Liao , Shirou Wang

We introduce a method for quantifying the inherent unpredictability of a continuous-valued time series via an extension of the differential Shannon entropy rate. Our extension, the specific entropy rate, quantifies the amount of predictive…

Machine Learning · Computer Science 2016-06-09 David Darmon

Specially customised Entropies are widely applied in measuring the degree of uncertainties existing in the frame of discernment. However, all of these entropies regard the frame as a whole that has already been determined which dose not…

Artificial Intelligence · Computer Science 2021-02-26 Yuanpeng He

Order statistics theory is applied in this paper to probabilistic robust control theory to compute the minimum sample size needed to come up with a reliable estimate of an uncertain quantity under continuity assumption of the related…

Optimization and Control · Mathematics 2008-05-13 Xinjia Chen , Kemin Zhou

Entropy Estimation is an important problem with many applications in cryptography, statistic,machine learning. Although the estimators optimal with respect to the sample complexity have beenrecently developed, there are still some…

Data Structures and Algorithms · Computer Science 2020-02-24 Maciej Skorski

It has experimentally been found by Lampo et al. [Biophys. J. 112, 532 (2017)] that, for two different types of cell, the distribution of the diffusivities of RNA-protein particles over cytoplasm obeys an exponential law. Then, an…

Biological Physics · Physics 2019-08-02 Yuichi Itto