English
Related papers

Related papers: Entropy operates in non-linear semifields

200 papers

Following a recent proof of Shannon's entropy power inequality (EPI), a comprehensive framework for deriving various EPIs for the R\'enyi entropy is presented that uses transport arguments from normal densities and a change of variable by…

Information Theory · Computer Science 2018-10-17 Olivier Rioul

Quantum generalizations of R\'enyi's entropies are a useful tool to describe a variety of operational tasks in quantum information processing. Two families of such generalizations turn out to be particularly useful: the Petz quantum R\'enyi…

Quantum Physics · Physics 2020-12-16 Raban Iten

We define a formal framework for the study of algebras of type Max-plus, Min-Plus, tropical algebras, and more generally algebras over a commutative idempotent semi-field. This work is motivated by the increasingly diversified use of these…

Commutative Algebra · Mathematics 2008-07-22 Dominique Castella

It is known that the variance and entropy of quantum observables decompose into intrinsically quantum and classical contributions. Here a general method of constructing quantum-classical decompositions of resources such as uncertainty is…

Quantum Physics · Physics 2023-07-07 Michael J. W. Hall

The equivalence between non-extensive C. Tsallis entropy and the extensive entropy introduced by Alfr\'ed R\'enyi is discussed. The R\'enyi entropy is studied from the perspective of the geometry of the Lebesgue and generalised, exotic…

Data Analysis, Statistics and Probability · Physics 2014-02-25 Giorgio Sonnino , György Steinbrecher , Alberto Sonnino

We study the Renyi entropy in the finite temperature crossover regime of a Hubbard chain using quantum Monte Carlo. The ground state entropy has characteristic features such as a logarithmic divergence with block size and $2\kF$…

Strongly Correlated Electrons · Physics 2014-03-19 Lars Bonnes , Hannes Pichler , Andreas M. Läuchli

In this work, we study the real-time evolution of pseudo-(R\'enyi) entropy, a generalization of entanglement entropy, in two-dimensional conformal field theories (CFTs). We focus on states obtained by acting primary operators located at…

High Energy Physics - Theory · Physics 2022-09-28 Wu-zhong Guo , Song He , Yu-Xuan Zhang

In this paper, we establish a sum rule that connects the pseudoentropy and entanglement entropy of a superposition state. Through analytical continuation of the superposition parameter, we demonstrate that the transition matrix and density…

High Energy Physics - Theory · Physics 2024-06-12 Wu-zhong Guo , Yao-zong Jiang , Jin Xu

The $n$-index R\'enyi mutual information and transfer entropy for the two-dimensional kinetic Ising model with arbitrary single-spin dynamics in the thermodynamic limit are derived as functions of thermodynamic quantities. By means of Monte…

Statistical Mechanics · Physics 2014-12-22 Zhehui Deng , Jinshan Wu , Wenan Guo

We propose R\'enyi information generating function and discuss its properties. A connection between the R\'enyi information generating function and the diversity index is proposed for discrete type random variables. The relation between the…

Statistics Theory · Mathematics 2025-02-25 Shital Saha , Suchandan Kayal , N. Balakrishnan

Quantum generalizations of Renyi's entropies are a useful tool to describe a variety of operational tasks in quantum information processing. Two families of such generalizations turn out to be particularly useful: the Petz quantum Renyi…

Quantum Physics · Physics 2017-01-25 Raban Iten , Joseph M. Renes , David Sutter

Let $R$ be a ring, let $G$ be an amenable group and let $R\ast G$ be a crossed product. The goal of this paper is to construct, starting with a suitable additive function $L$ on the category of left modules over $R$, an additive function on…

Rings and Algebras · Mathematics 2017-10-24 Simone Virili

The Matrix-based Renyi's entropy enables us to directly measure information quantities from given data without the costly probability density estimation of underlying distributions, thus has been widely adopted in numerous statistical…

Machine Learning · Statistics 2022-05-17 Yuxin Dong , Tieliang Gong , Shujian Yu , Chen Li

The matrix-based R\'enyi's entropy allows us to directly quantify information measures from given data, without explicit estimation of the underlying probability distribution. This intriguing property makes it widely applied in statistical…

Machine Learning · Computer Science 2022-12-01 Yuxin Dong , Tieliang Gong , Shujian Yu , Hong Chen , Chen Li

A very brief introduction to tropical and idempotent mathematics is presented. Tropical mathematics can be treated as a result of a dequantization of the traditional mathematics as the Planck constant tends to zero taking imaginary values.…

Numerical Analysis · Mathematics 2012-09-11 G. L. Litvinov

Binary idempotent semirings govern classical path algebras. Their multiplicative structure is dyadic. We examine whether this restriction is structural or accidental. We define ternary idempotent $\Gamma$-semirings as higher-arity ordered…

Rings and Algebras · Mathematics 2026-02-26 Chandrasekhar Gokavarapu , D. Madhusudhana Rao

The de Bruijn identity states that Fisher information is equal to a half of the time-derivative of Shannon differential entropy along heat flow. In the same spirit, a generalized version of Fisher information, which we term the…

Information Theory · Computer Science 2025-06-12 Hao Wu , Lei Yu

I introduce the concept of integral closure for elements and ideals in idempotent semirings, and establish how it corresponds to its namesake in commutative algebra. In the case of free semirings, integral closure can be understood in terms…

Commutative Algebra · Mathematics 2016-03-08 Andrew W. Macpherson

A framework for deriving R\'enyi entropy-power inequalities (EPIs) is presented that uses linearization and an inequality of Dembo, Cover, and Thomas. Simple arguments are given to recover the previously known R\'enyi EPIs and derive new…

Information Theory · Computer Science 2020-04-08 Olivier Rioul

Entropy is a measure of self-information which is used to quantify losses. Entropy was developed in thermodynamics, but is also used to compare probabilities based on their deviating information content. Corresponding model uncertainty is…

Probability · Mathematics 2018-01-23 Alois Pichler , Ruben Schlotter
‹ Prev 1 4 5 6 7 8 10 Next ›