English
Related papers

Related papers: On the average uncertainty for systems with nonlin…

200 papers

We present a new class of estimators of Shannon entropy for severely undersampled discrete distributions. It is based on a generalization of an estimator proposed by T. Schuermann, which itself is a generalization of an estimator proposed…

Information Theory · Computer Science 2021-11-30 Peter Grassberger

Entropy is a central concept in physics, but can be challenging to calculate even for systems that are easily simulated. This is exacerbated out of equilibrium, where generally little is known about the distribution characterizing simulated…

Statistical Mechanics · Physics 2024-05-09 Samuel D. Gelman , Guy Cohen

In many areas of engineering and sciences, decision rules and control strategies are usually designed based on nominal values of relevant system parameters. To ensure that a control strategy or decision rule will work properly when the…

Probability · Mathematics 2020-06-16 Xinjia Chen

In this paper, some general properties of Shannon information measures are investigated over sets of probability distributions with restricted marginals. Certain optimization problems associated with these functionals are shown to be…

Information Theory · Computer Science 2020-08-13 Mladen Kovačević , Ivan Stanojević , Vojin Šenk

In recent years there has been a closer interrelationship between several scientific areas trying to obtain a more realistic and rich explanation of the natural and social phenomena. Among these it should be emphasized the increasing…

Physics and Society · Physics 2016-09-08 Andreia Dionisio , Rui Menezes , Diana A. Mendes

Given an arbitrary continuous probability density function, it is introduced a conjugated probability density, which is defined through the Shannon information associated with its cumulative distribution function. These new densities are…

Statistics Theory · Mathematics 2018-01-26 H. M. de Oliveira , R. J. Cintra

Upper and lower bounds are obtained for the joint entropy of a collection of random variables in terms of an arbitrary collection of subset joint entropies. These inequalities generalize Shannon's chain rule for entropy as well as…

Information Theory · Computer Science 2024-05-07 Mokshay Madiman , Prasad Tetali

Uncertainties in successive measurements of general canonically conjugate variables are examined. Such operators are approached within a limiting procedure of the Pegg-Barnett type. Dealing with unbounded observables, we should take into…

Quantum Physics · Physics 2017-01-02 Alexey E. Rastegin

By considering a nonlinear combination of the probabilities of a system, a physical interpretation of Tsallis statistics as representing the nonlinear coupling or decoupling of statistical states is proposed. The escort probability is…

Statistical Mechanics · Physics 2025-11-25 Kenric P. Nelson , Sabir Umarov

In this paper we remark that Shannon entropy can be expressed as a function of the self-information (i.e. the logarithm) and the inverse of the Lambert $W$ function. It means that we consider that Shannon entropy has the trace form: $-k…

Statistical Mechanics · Physics 2019-07-05 Laurent Truffet

We improve the entropic uncertainty relations for position and momentum coarse-grained measurements. We derive the continuous, coarse-grained counterparts of the discrete uncertainty relations based on the concept of majorization. The…

Quantum Physics · Physics 2015-06-30 Łukasz Rudnicki

We study the continuity property of the generalized entropy as a function of the underlying probability distribution, defined with an action space and a loss function, and use this property to answer the basic questions in statistical…

Machine Learning · Computer Science 2022-01-04 Aolin Xu

We study the Shannon entropy of the probability distribution resulting from the ground-state wave function of a one-dimensional quantum model. This entropy is related to the entanglement entropy of a Rokhsar-Kivelson-type wave function…

Strongly Correlated Electrons · Physics 2009-11-25 Jean-Marie Stéphan , Shunsuke Furukawa , Grégoire Misguich , Vincent Pasquier

This article presents a new class of generalized transmuted lifetime distributions which includes a large number of lifetime distributions as sub-family. Several important mathematical quantities such as density function, distribution…

Methodology · Statistics 2024-05-21 Alok Kumar Pandey , Alam Ali , Ashok Kumar Pathak

Understanding the way in which random entities interact is of key interest in numerous scientific fields. This can range from a full characterization of the joint distribution to single scalar summary statistics. In this work we identify a…

Statistics Theory · Mathematics 2016-11-22 Yaniv Tenzer , Gal Elidan

Uncertainty relations emerging from the Tsallis entropy are derived and discussed. In particular we found a positively defined function that saturates the so called entropic inequalities for entropies characterizing the physical states…

Quantum Physics · Physics 2013-05-29 Grzegorz Wilk , Zbigniew Wlodarczyk

We introduce a novel entropy-related function, \textit{non-repeatability}, designed to capture dynamical behaviors in complex systems. Its normalized form, \textit{mutability}, has been previously applied in statistical physics as a…

Statistical Mechanics · Physics 2025-04-04 Eugenio E. Vogel , Francisco J. Peña , G. Saravia , P. Vargas

The notion of probability density for a random function is not as straightforward as in finite-dimensional cases. While a probability density function generally does not exist for functional data, we show that it is possible to develop the…

Statistics Theory · Mathematics 2010-03-01 Aurore Delaigle , Peter Hall

Every observation may follow a distribution that is randomly selected in a class of distributions. It is called the distribution uncertainty. This is a fact acknowledged in some research fields such as financial risk measure. Thus, the…

Methodology · Statistics 2014-12-10 Lu Lin , Ping Dong , Yunquan Song , Lixing Zhu

This paper introduces a framework for modeling cyclical and feedback-driven information flow through a generalized family of entropy-modulated transformations called derangetropy functionals. Unlike scalar and static entropy measures such…

Information Theory · Computer Science 2025-06-17 Masoud Ataei , Xiaogang Wang
‹ Prev 1 4 5 6 7 8 10 Next ›