English
Related papers

Related papers: Swiveled R\'enyi entropies

200 papers

Properties of scalar quantization with $r$th power distortion and constrained R\'enyi entropy of order $\alpha\in (0,1)$ are investigated. For an asymptotically (high-rate) optimal sequence of quantizers, the contribution to the R\'enyi…

Information Theory · Computer Science 2012-03-27 Wolfgang Kreitmeier , Tamas Linder

Concepts of information theory are increasingly used to characterize collective phenomena in condensed matter systems, such as the use of entanglement entropies to identify emergent topological order in interacting quantum many-body…

Strongly Correlated Electrons · Physics 2015-09-28 Johannes Helmes , Jean-Marie Stéphan , Simon Trebst

We study analytically the corrections to the leading terms in the Renyi entropy of a massive lattice theory, showing significant deviations from naive expectations. In particular, we show that finite size and finite mass effects give rise…

High Energy Physics - Theory · Physics 2012-05-31 Elisa Ercolessi , Stefano Evangelisti , Fabio Franchini , Francesco Ravanini

We consider the maximum entropy problems associated with R\'enyi $Q$-entropy, subject to two kinds of constraints on expected values. The constraints considered are a constraint on the standard expectation, and a constraint on the…

Information Theory · Computer Science 2008-12-18 Jean-François Bercher

This paper introduces the variational R\'enyi bound (VR) that extends traditional variational inference to R\'enyi's alpha-divergences. This new family of variational methods unifies a number of existing approaches, and enables a smooth…

Machine Learning · Statistics 2016-10-31 Yingzhen Li , Richard E. Turner

The Random Permutation Set (RPS) is a new type of set proposed recently, which can be regarded as the generalization of evidence theory. To measure the uncertainty of RPS, the entropy of RPS and its corresponding maximum entropy have been…

Information Theory · Computer Science 2024-03-12 Jiefeng Zhou , Zhen Li , Kang Hao Cheong , Yong Deng

We show that a recent definition of relative R\'enyi entropy is monotone under completely positive, trace preserving maps. This proves a recent conjecture of M\"uller-Lennert et al.

Mathematical Physics · Physics 2015-06-16 Rupert L. Frank , Elliott H. Lieb

We obtain uncertainty and certainty relations of state-independent form for the three Pauli observables with use of the R\'enyi entropies of order $\alpha\in(0;1]$. It is shown that these entropic bounds are tight in the sense that they are…

Quantum Physics · Physics 2014-04-03 Alexey E. Rastegin

We show that for any $\alpha>0$ the R\'enyi entropy of order $\alpha$ is minimized, among all symmetric log-concave random variables with fixed variance, either for a uniform distribution or for a two sided exponential distribution. The…

Information Theory · Computer Science 2021-10-05 Maciej Białobrzeski , Piotr Nayar

Entropies are fundamental measures of uncertainty with central importance in information theory and statistics and applications across all the quantitative sciences. Under a natural set of operational axioms, the most general form of…

Information Theory · Computer Science 2026-02-02 Roberto Rubboli , Erkka Haapasalo , Marco Tomamichel

In a paper [8] the authors classify entropy into three categories, as a thermodynamics quantity, as a measure of information production, and as a means of statistical inference. An entropy measure introduced by Mathai falls into the second…

Statistical Mechanics · Physics 2024-10-31 Hans J. Haubold

This study examines sharp bounds on Arimoto's conditional R\'enyi entropy of order $\beta$ with a fixed another one of distinct order $\alpha \neq \beta$. Arimoto inspired the relation between the R\'enyi entropy and the $\ell_{r}$-norm of…

Information Theory · Computer Science 2020-08-24 Yuta Sakai , Ken-ichi Iwata

Data partitioning that maximizes/minimizes the Shannon entropy, or more generally the R\'enyi entropy is a crucial subroutine in data compression, columnar storage, and cardinality estimation algorithms. These partition algorithms can be…

Data Structures and Algorithms · Computer Science 2025-11-05 Aryan Esmailpour , Sanjay Krishnan , Stavros Sintos

The resource theories of quantum coherence attract a lot of attention in recent years. Especially, the monotonicity property plays a crucial role here. In this paper we investigate the monotonicity property for the coherence measures…

Quantum Physics · Physics 2017-08-02 Lian-He Shao , Yongming Li , Yu Luo , Zhengjun Xi

Despite recent claims we argue that Renyi's entropy is an observable quantity. It is shown that, contrary to popular belief, the reported domain of instability for Renyi entropies has zero measure (Bhattacharyya measure). In addition, we…

Statistical Mechanics · Physics 2009-11-10 Petr Jizba , Toshihico Arimitsu

Counting problems such as determining how many bit strings satisfy a given Boolean logic formula are notoriously hard. In many cases, even getting an approximate count is difficult. Here we propose that entanglement, a common concept in…

Statistical Mechanics · Physics 2013-04-03 Claudio Chamon , Eduardo R. Mucciolo

Entanglement entropy is an essential metric for characterizing quantum many-body systems, but its numerical evaluation for neural network representations of quantum states has so far been inefficient and demonstrated only for the restricted…

Quantum Physics · Physics 2020-12-21 Zhaoyou Wang , Emily J. Davis

We extend from the hyperfinite setting to general von Neumann algebras Mosonyi and Ogawa's (2015) and Mosonyi and Hiai's (2023) results showing the operational interpretation of sandwiched relative R\'enyi entropy in the strong converse of…

Quantum Physics · Physics 2025-07-18 Marius Junge , Nicholas Laracuente

The R\'enyi entropy is a mathematical generalization of the concept of entropy and it encodes the total information of a system as a funtion of its order parameter $\alpha$. The meaning of the R\'enyi entropy in physics is not completely…

General Physics · Physics 2015-10-15 Nicolò Masi

The R\'enyi entropies of quasiparticle excitations in the many-body gapped systems show a remarkable universal picture which can be understood partially by combination of a semiclassical argument with the quantum effect of…

Statistical Mechanics · Physics 2021-11-11 Jiaju Zhang , M. A. Rajabpour