中文
相关论文

相关论文: Generalized entropy optimized by an arbitrary dist…

200 篇论文

We present a generalization of the maximal inequalities that upper bound the expectation of the maximum of $n$ jointly distributed random variables. We control the expectation of a randomly selected random variable from $n$ jointly…

概率论 · 数学 2017-08-31 Jiantao Jiao , Yanjun Han , Tsachy Weissman

A generalised notion of exponential families is introduced. It is based on the variational principle, borrowed from statistical physics. It is shown that inequivalent generalised entropy functions lead to distinct generalised exponential…

数学物理 · 物理学 2015-05-13 Jan Naudts

Gaussian mixture distributions are commonly employed to represent general probability distributions. Despite the importance of using Gaussian mixtures for uncertainty estimation, the entropy of a Gaussian mixture cannot be calculated…

机器学习 · 统计学 2025-01-23 Takashi Furuya , Hiroyuki Kusumoto , Koichi Taniguchi , Naoya Kanno , Kazuma Suetake

We present a new approach to far-from-equilibrium statistical mechanics, based on the concept of generalized entropy, which is a microscopically-defined generalization of Onsager-Machlup functional. In the case when a set of slow…

统计力学 · 物理学 2007-05-23 Alexei V. Tkachenko

The definition of nonequilibrium entropy is provided for the general nonequilibrium processes by connecting thermodynamics with statistical physics, and the principle of entropy increment in the nonequilibrium processes is also proved in…

数据分析、统计与概率 · 物理学 2007-05-23 Xiaochun Mei

Many inference problems involving questions of optimality ask for the maximum or the minimum of a finite set of unknown quantities. This technical report derives the first two posterior moments of the maximum of two correlated Gaussian…

机器学习 · 统计学 2009-10-02 Philipp Hennig

We consider the maximum entropy problems associated with R\'enyi $Q$-entropy, subject to two kinds of constraints on expected values. The constraints considered are a constraint on the standard expectation, and a constraint on the…

信息论 · 计算机科学 2008-12-18 Jean-François Bercher

We review a new form of entropy suggested by us, with origin in mixing of states of systems due to interactions and deformations of phase cells. It is demonstrated that this nonextensive form also leads to asymmetric maximal entropy…

统计力学 · 物理学 2009-06-16 Fariel Shafee

We introduce the beta generalized exponential distribution that includes the beta exponential and generalized exponential distributions as special cases. We provide a comprehensive mathematical treatment of this distribution. We derive the…

统计方法学 · 统计学 2010-08-17 Wagner Barreto-Souza , Alessandro H. S. Santos , Gauss M. Cordeiro

We propose a new way of defining entropy of a system, which gives a general form which may be nonextensive as Tsallis entropy, but is linearly dependent on component entropies, like Renyi entropy, which is extensive. This entropy has a…

适应与自组织系统 · 物理学 2007-10-11 Fariel Shafee

It is shown that the distribution derived from the principle of maximum Tsallis entropy is a superposable Levy-type distribution. Concomitantly, the leading order correction to the limit distribution is also deduced. This demonstration…

统计力学 · 物理学 2007-05-23 Sumiyoshi Abe , A. K. Rajagopal

Tsallis has suggested a nonextensive generalization of the Boltzmann-Gibbs entropy, the maximization of which gives a generalized canonical distribution under special constraints. In this brief report we show that the generalized canonical…

统计力学 · 物理学 2021-04-28 Brian R. La Cour , William C. Schieve

In this paper we derive the maximum entropy characteristics of a particular rank order distribution, namely the discrete generalized beta distribution, which has recently been observed to be extremely useful in modelling many several…

物理与社会 · 物理学 2019-09-30 Abhik Ghosh , Preety Shreya , Banasri Basu

We consider the problem of estimating the population probability distribution given a finite set of multivariate samples, using the maximum entropy approach. In strict keeping with Jaynes' original definition, our precise formulation of the…

数据分析、统计与概率 · 物理学 2007-07-13 Sabbir Rahman , Mahbub Majumdar

In this paper, we propose an optimization-based mechanism to explain power law distributions, where the function that the optimization process is seeking to optimize is derived mathematically, then the behavior and interpretation of this…

物理与社会 · 物理学 2018-12-27 A. M. Khalili

Following the theory of information measures based on the cumulative distribution function, we propose the fractional generalized cumulative entropy, and its dynamic version. These entropies are particularly suitable to deal with…

概率论 · 数学 2021-06-30 Antonio Di Crescenzo , Suchandan Kayal , Alessandra Meoli

The paper deals with the generalization of both Boltzmann entropy and distribution in the light of most-probable interpretation of statistical equilibrium. The statistical analysis of the generalized entropy and distribution leads to some…

量子物理 · 物理学 2009-11-13 C. G. Chakrabarti , Indranil Chakrabarty

The entropy is a measure of uncertainty that plays a central role in information theory. When the distribution of the data is unknown, an estimate of the entropy needs be obtained from the data sample itself. We propose a semi-parametric…

统计方法学 · 统计学 2022-01-06 Stéphane Robin , Luca Scrucca

This article aims to introduced a new distribution named as extended xgamma (EXg) distribution. This generalization is derived from xgamma distribution (Xg), a special finite mixture of exponential and gamma distributions [see, Sen et al.…

We present a derivation of power law canonical distributions from first principle statistical mechanics, including the exponential distribution as a It is presented a derivation of power law canonical distributions from first principle…

统计力学 · 物理学 2014-10-13 M. P. Almeida