English
Related papers

Related papers: On the way towards a generalized entropy maximizat…

200 papers

We present a derivation of power law canonical distributions from first principle statistical mechanics, including the exponential distribution as a It is presented a derivation of power law canonical distributions from first principle…

Statistical Mechanics · Physics 2014-10-13 M. P. Almeida

In this paper, we introduce the generalized Gompertz-power series class of distributions which is obtained by compounding generalized Gompertz and power series distributions. This compounding procedure follows same way that was previously…

Methodology · Statistics 2015-09-01 Saeid Tahmasebi , Ali Akbar Jafari

Tsallis and R\'{e}nyi entropies, which are monotone transformations of each other, are deformations of the celebrated Shannon entropy. Maximization of these deformed entropies, under suitable constraints, leads to the $q$-exponential family…

Probability · Mathematics 2022-01-14 Ting-Kam Leonard Wong , Jun Zhang

We demonstrate and discuss the process of gaining information and show an example in which some specific way of gaining information about an object results in the Tsallis form of entropy rather than in the Shannon one.

Statistical Mechanics · Physics 2009-11-13 Grzegorz Wilk , Zbigniew Wlodarczyk

We introduce a variational algorithm based on Matrix Product States that is trained by minimizing a generalized free energy defined using Tsallis entropy instead of the standard Gibbs entropy. As a result, our model can generate the…

Statistical Mechanics · Physics 2024-09-16 Pablo Díez-Valle , Fernando Martínez-García , Juan José García-Ripoll , Diego Porras

Hierarchical structures, which include multiple levels, are prevalent in statistical and machine-learning models as well as physical systems. Extending the foundational result that the maximum entropy distribution under mean constraints is…

Information Theory · Computer Science 2025-09-03 Amir R. Asadi

Quantum Renyi relative entropies provide a one-parameter family of distances between density matrices, which generalizes the relative entropy and the fidelity. We study these measures for renormalization group flows in quantum field theory.…

High Energy Physics - Theory · Physics 2018-10-17 Horacio Casini , Raimel Medina , Ignacio Salazar , Gonzalo Torroba

We present our view in a standing debate about the definition and meaning of power-law entropies for continuous systems. Our suggestion is that such arguments should take into account the generalized operations of addition and…

Statistical Mechanics · Physics 2018-10-17 Anthony J. Creaco , Nikolaos Kalogeropoulos

Maximum entropy modeling is a flexible and popular framework for formulating statistical models given partial knowledge. In this paper, rather than the traditional method of optimizing over the continuous density directly, we learn a smooth…

Methodology · Statistics 2017-05-01 Gabriel Loaiza-Ganem , Yuanjun Gao , John P. Cunningham

We apply Tsallis's q-indexed nonextensive entropy to formulate a random matrix theory (RMT), which may be suitable for systems with mixed regular-chaotic dynamics. We consider the super-extensive regime of q < 1. We obtain analytical…

Mathematical Physics · Physics 2011-12-06 A. Abd El-Hady , A. Y. Abul-Magd

Two R\'{e}nyi-type generalizations of the Shannon cross-entropy, the R\'{e}nyi cross-entropy and the Natural R\'{e}nyi cross-entropy, were recently used as loss functions for the improved design of deep learning generative adversarial…

Information Theory · Computer Science 2022-10-06 Ferenc Cole Thierrin , Fady Alajaji , Tamás Linder

A generalization of the entropy production rate is proposed $\Pi_q$ in non-equilibrium systems by extending the formalism of classical stochastic thermodynamics to regimes with non-Gaussian fluctuations. Through the R\'enyi entropy $S_q$ ,…

Statistical Mechanics · Physics 2025-10-02 J. M. Nieto-Villar , R. Mansilla , I. Santamaria-Holek

A $q$-Gaussian measure is a generalization of a Gaussian measure. This generalization is obtained by replacing the exponential function with the power function of exponent $1/(1-q)$ ($q\neq 1$). The limit case $q=1$ recovers a Gaussian…

Quantum Algebra · Mathematics 2020-02-18 Hiroshi Matsuzoe , Asuka Takatsu

The method of Maximum (relative) Entropy (ME) is used to translate the information contained in the known form of the likelihood into a prior distribution for Bayesian inference. The argument is guided by intuition gained from the…

Data Analysis, Statistics and Probability · Physics 2009-11-10 Ariel Caticha , Roland Preuss

Information entropy and its extension, which are important generalization of entropy, have been applied in many research domains today. In this paper, a novel generalized relative entropy is constructed to avoid some defects of traditional…

Information Theory · Computer Science 2017-04-24 Shuai Liu , Mengye Lu , Gaocheng Liu , Zheng Pan

We present a new type of generalization of the Renyi entropy that follows naturally from its representation as a thermodynamic quantity. We apply it to the case of d-dimensional conformal field theories (CFTs) reduced on a region bounded by…

High Energy Physics - Theory · Physics 2019-05-29 Clifford V. Johnson

In this paper, we prove that the Renyi entropy of linearly normalized partial maxima of independent and identically distributed random variables is convergent to the corresponding limit Renyi entropy when the linearly normalized partial…

Other Statistics · Statistics 2014-04-23 Ali Saeb

Using the Generalized Maximium Entropy Principle based on the nonextensive q entropy a new family of random matrix ensembles is generated. This family unifies previous extensions of Random Matrix Theory and gives rise to an orthogonal…

Mathematical Physics · Physics 2009-11-10 A. C. Bertuola , O. Bohigas , M. P. Pato

Entropic uncertainty relations are interesting in their own rights as well as for a lot of applications. Keeping this in mind, we try to make the corresponding inequalities as tight as possible. The use of parametrized entropies also allows…

Quantum Physics · Physics 2023-05-30 Alexey E. Rastegin

We define an entropy based on a chosen governing probability distribution. If a certain kind of measurements follow such a distribution it also gives us a suitable scale to study it with. This scale will appear as a link function that is…

Data Analysis, Statistics and Probability · Physics 2007-10-24 Peter Sunehag