English
Related papers

Related papers: Weighted Approach to General Entropy Function

200 papers

Since its origin in the thermodynamics of the 19th century, the concept of entropy has also permeated other fields of physics and mathematics, such as Classical and Quantum Statistical Mechanics, Information Theory, Probability Theory,…

Machine Learning · Statistics 2025-03-06 Salomé A. Sepúveda Fontaine , José M. Amigó

We present aspects of entropic functionals relatively recently introduced in Physics which are non-additive, in the conventional sense of the word, some of which have a power-law functional form. We use as an example among them, and to be…

General Relativity and Quantum Cosmology · Physics 2019-02-27 Nikos Kalogeropoulos

Pseudoentropy characterizations provide a quantitatively precise demonstration of the close relationship between computational hardness and computational randomness. We prove a unified pseudoentropy characterization that generalizes and…

Computational Complexity · Computer Science 2025-09-05 Lunjia Hu , Salil Vadhan

In this paper, we develop the lower and upper bounds of worst-case distortion riskmetrics and weighted entropy for unimodal, and symmetric unimodal distributions when mean and variance information are available. We also consider the sharp…

Risk Management · Quantitative Finance 2025-11-24 Baishuai Zuo , Chuancun Yin

By replacing linear averaging in Shannon entropy with Kolmogorov-Nagumo average (KN-averages) or quasilinear mean and further imposing the additivity constraint, R\'{e}nyi proposed the first formal generalization of Shannon entropy. Using…

Information Theory · Computer Science 2007-07-13 Ambedkar Dukkipati , M. Narasimha Murty , Shalabh Bhatnagar

In a recent paper [Entropy 2020, 22(1), 17] C. Tsallis states that entropy -- as in Shannon's or Kullback-Leiber's definitions -- is inadequate to interpret black hole entropy and suggests that a new non-additive functional should take the…

General Relativity and Quantum Cosmology · Physics 2021-03-23 Pedro Pessoa , Bruno Arderucio Costa

We explore the relation between entanglement entropy of quantum many body systems and the distribution of corresponding, properly selected, observables. Such a relation is necessary to actually measure the entanglement entropy. We show that…

Statistical Mechanics · Physics 2009-11-11 Israel Klich , Gil Refael , Alessandro Silva

We show that in the continuum limit, the average spectrum method (ASM) is equivalent to maximizing R\'enyi entropies of order $\eta$, of which Shannon entropy is the special case $\eta=1$. The order of R\'enyi entropy is determined by the…

Strongly Correlated Electrons · Physics 2023-07-24 Khaldoon Ghanem , Erik Koch

Topological entropy is a widely studied indicator of chaos in topological dynamics. Here we give a generalized definition of topological entropy which may be applied to set-valued functions. We demonstrate that some of the well-known…

Dynamical Systems · Mathematics 2015-09-29 James Kelly , Tim Tennant

The R\'{e}nyi cross-entropy measure between two distributions, a generalization of the Shannon cross-entropy, was recently used as a loss function for the improved design of deep learning generative adversarial networks. In this work, we…

Information Theory · Computer Science 2022-08-09 Ferenc Cole Thierrin , Fady Alajaji , Tamás Linder

The unified entropy as a promotion of the von Neumann entropy exhibits distinct diversity which contains the Tsallis entropy, the R\'{e}nyi entropy, the von Neumann entropy as special cases. The unified-($r,t$) entropy entanglement with…

Quantum Physics · Physics 2026-05-22 Wenxue Ren , Binghao Li , Ruiqun Niu , Yu Guo , Shuanping Du

Recently, a new measure of information called extropy has been introduced by Lad, Sanfilippo and Agr\`o as the dual version of Shannon entropy. In the literature, Tsallis introduced a measure for a discrete random variable, named Tsallis…

Probability · Mathematics 2021-09-30 Narayanaswamy Balakrishnan , Francesco Buono , Maria Longobardi

Many common probability distributions in statistics like the Gaussian, multinomial, Beta or Gamma distributions can be studied under the unified framework of exponential families. In this paper, we prove that both R\'enyi and Tsallis…

Information Theory · Computer Science 2012-02-01 Frank Nielsen , Richard Nock

Typically, the entropy of an isolated system in equilibrium is calculated by counting the number of accessible microstates, or in more general cases by using the Gibbs formula. In irreversible processes entropy spontaneously increases and…

Statistical Mechanics · Physics 2020-04-16 Taha A Malik , Rafael Lopez-Mobilia

The entanglement entropy of a subsystem of a quantum system is expressed, in the replica approach, through analytic continuation with respect to n of the trace of the n-th power of the reduced density matrix. This trace can be thought of as…

High Energy Physics - Theory · Physics 2008-12-18 Michele Caraglio , Ferdinando Gliozzi

Few parameters dependent generalised entropy includes Tsallis entropy, R{\'e}nyi entropy, Sharma-Mittal entropy, Barrow entropy, Kaniadakis entropy, etc as particular representatives. Its relation to physical systems is not always clear. In…

General Relativity and Quantum Cosmology · Physics 2023-08-16 Shin'ichi Nojiri , Sergei D. Odintsov

A lower bound of the reduced relative entropy is given by the use of a variational expression. The reduced Tsallis relative entropy is defined and some results are given. In particular, the convexity of the reduced Tsallis relative entropy…

Quantum Physics · Physics 2025-03-06 Shigeru Furuichi , Frank Hansen

We present a detailed discussion of entanglement entropy in (1+1)-dimensional Warped Conformal Field Theories (WCFTs). We implement the Rindler method to evaluate entanglement and Renyi entropies for a single interval and along the way we…

High Energy Physics - Theory · Physics 2017-01-19 Alejandra Castro , Diego M. Hofman , Nabil Iqbal

We investigate the cumulative Tsallis entropy, an information measure recently introduced as a cumulative version of the classical Tsallis differential entropy, which is itself a generalization of the Boltzmann-Gibbs statistics. This…

Statistics Theory · Mathematics 2023-06-02 Guillaume Dulac , Thomas Simon

When the experimental objective is expressed by a set of estimable functions, and any eigenvalue-based optimality criterion is selected, we prove the equivalence of the recently introduced weighted optimality and the 'standard' optimality…

Statistics Theory · Mathematics 2016-10-21 Samuel Rosa