English
Related papers

Related papers: Renyi extrapolation of Shannon entropy

200 papers

The purpose of this note is to give the general solution of two functional equations connected to the Shannon entropy and also to the Tsallis entropy. As a result of this, we present the regular solution of these equations, as well.…

Classical Analysis and ODEs · Mathematics 2013-07-03 Eszter Gselmann

Following a recent proof of Shannon's entropy power inequality (EPI), a comprehensive framework for deriving various EPIs for the R\'enyi entropy is presented that uses transport arguments from normal densities and a change of variable by…

Information Theory · Computer Science 2018-10-17 Olivier Rioul

A general upper bound for topological entropy of switched nonlinear systems is constructed, using an asymptotic average of upper limits of the matrix measures of Jacobian matrices of strongly persistent individual modes, weighted by their…

Systems and Control · Electrical Eng. & Systems 2023-01-31 Guosong Yang , Daniel Liberzon , João P. Hespanha

In this paper we obtain new bounds for the minimum output entropies of random quantum channels. These bounds rely on random matrix techniques arising from free probability theory. We then revisit the counterexamples developed by Hayden and…

Probability · Mathematics 2015-02-12 Benoît Collins , Ion Nechita

A natural link between the notions of majorization and strongly Sperner posets is elucidated. It is then used to obtain a variety of consequences, including new R\'enyi entropy inequalities for sums of independent, integer-valued random…

Combinatorics · Mathematics 2020-02-07 Mokshay Madiman , Liyao Wang , Jae Oh Woo

We revisit the connection between index and relative entropy for an inclusion of finite von Neumann algebras. We observe that the Pimsner-Popa index connects to sandwiched Renyi $p$-relative entropy for all $1/2\le p\le \infty$, including…

Operator Algebras · Mathematics 2020-11-17 Li Gao , Marius Junge , Nicholas LaRacuente

We compute the Renyi entropy in a one-dimensional transverse-field quantum Ising model by employing a swapping operator acting on the states which are prepared from the neural network methods. In the static ground state, Renyi entropy can…

Disordered Systems and Neural Networks · Physics 2024-03-15 Han-Qing Shi , Hai-Qing Zhang

Shannon entropy in position ($S_{\rvec}$) and momentum ($S_{\pvec}$) spaces, along with their sum ($S_t$) are presented for unit-normalized densities of He, Li$^+$ and Be$^{2+}$ ions, spatially confined at the center of an impenetrable…

Quantum Physics · Physics 2021-03-01 Sangita Majumdar , Amlan K. Roy

We consider families of tight upper bounds on the difference $S(\rho)-S(\sigma)$ with the rank/energy constraint imposed on the state $\rho$ which are valid provided that the state $\rho$ partially majorizes the state $\sigma$ and is close…

Quantum Physics · Physics 2025-06-04 M. E. Shirokov

We introduce asymptotic R\'enyi entropies as a parameterized family of invariants for random walks on groups. These invariants interpolate between various well-studied properties of the random walk, including the growth rate of the group,…

Probability · Mathematics 2024-06-11 Kimberly Golubeva , Minghao Pan , Omer Tamuz

We investigate relations between the ranks of marginals of multipartite quantum states. These are the Schmidt ranks across all possible bipartitions and constitute a natural quantification of multipartite entanglement dimensionality. We…

Quantum Physics · Physics 2014-04-29 Josh Cadney , Marcus Huber , Noah Linden , Andreas Winter

The uncertainty relation based on the Shannon entropies of the probability densities in position and momentum spaces is improved for quantum systems in arbitrary $D$-dimensional spherically symmetric potentials. To find it, we have used the…

Mathematical Physics · Physics 2013-05-22 Łukasz Rudnicki , Pablo Sánchez-Moreno , Jesús S. Dehesa

General probabilistic theories are designed to provide operationally the most general probabilistic models including both classical and quantum theories. In this letter, we introduce a systematic method to construct a series of entropies,…

Quantum Physics · Physics 2016-10-26 Gen Kimura , Junji Ishiguro , Makoto Fukui

Spectral properties of an arbitrary matrix can be characterized by the entropy of its rescaled singular values. Any quantum operation can be described by the associated dynamical matrix or by the corresponding superoperator. The entropy of…

Quantum Physics · Physics 2013-05-27 Wojciech Roga , Zbigniew Puchała , Łukasz Rudnicki , Karol Życzkowski

The entropy of a quantum system is a measure of its randomness, and has applications in measuring quantum entanglement. We study the problem of measuring the von Neumann entropy, $S(\rho)$, and R\'enyi entropy, $S_\alpha(\rho)$ of an…

Quantum Physics · Physics 2022-04-19 Jayadev Acharya , Ibrahim Issa , Nirmal V. Shende , Aaron B. Wagner

The Shannon entropy is a widely used summary statistic, for example, network traffic measurement, anomaly detection, neural computations, spike trains, etc. This study focuses on estimating Shannon entropy of data streams. It is known that…

Data Structures and Algorithms · Computer Science 2009-10-09 Ping Li

We present estimators for entropy and other functions of a discrete probability distribution when the data is a finite sample drawn from that probability distribution. In particular, for the case when the probability distribution is a joint…

comp-gas · Physics 2008-02-03 David H. Wolpert , David R. Wolf

The von Neumann entropy of an $n$-partite system $A_1^n$ given a system $B$ can be written as the sum of the von Neumann entropies of the individual subsystems $A_k$ given $A_1^{k-1}$ and $B$. While it is known that such a chain rule does…

Quantum Physics · Physics 2024-12-10 Ashutosh Marwah , Frédéric Dupuis

The quantum relative Renyi entropy of two density matrices was recently extended when the two do not commute, from which a conditional entropy is identified. This is here extended to the corresponding Tsallis relative entropy and to its…

Quantum Physics · Physics 2014-02-05 A. K. Rajagopal , Sudha , Anantha S Nayak , A. R. Usha Devi

At a quantum critical point, bipartite entanglement entropies have universal quantities which are subleading to the ubiquitous area law. For Renyi entropies, these terms are known to be similar to the von Neumann entropy, while being much…