English
Related papers

Related papers: Sharp Bounds on Arimoto's Conditional R\'{e}nyi En…

200 papers

A task is randomly drawn from a finite set of tasks and is described using a fixed number of bits. All the tasks that share its description must be performed. Upper and lower bounds on the minimum $\rho$-th moment of the number of performed…

Information Theory · Computer Science 2014-10-07 Christoph Bunte , Amos Lapidoth

The Renyi entropy plays an essential role in quantum information theory. We study the continuity estimation of the Renyi entropy. An inequality relating the Renyi entropy difference of two quantum states to their trace norm distance is…

Quantum Physics · Physics 2017-01-11 Zhihua Chen , Zhihao Ma , Ismail Nikoufar , Shaoming Fei

A novel definition of the conditional smooth Renyi entropy, which is different from that of Renner and Wolf, is introduced. It is shown that our definition of the conditional smooth Renyi entropy is appropriate to give lower and upper…

Information Theory · Computer Science 2019-01-25 Shigeaki Kuzuoka

The interplay of quantum and classical fluctuations in the vicinity of a quantum critical point (QCP) gives rise to various regimes or phases with distinct quantum character. In this work, we show that the R\'enyi entropy is a precious tool…

Statistical Mechanics · Physics 2023-12-29 Miha Srdinšek , Michele Casula , Rodolphe Vuilleumier

We explore asymptotically optimal bounds for deviations of distributions of independent Bernoulli random variables from the Poisson limit in terms of the Shannon relative entropy and R\'enyi/Tsallis relative distances (including Pearson's…

Probability · Mathematics 2019-08-15 S. G. Bobkov , G. P. Chistyakov , F. Götze

Data partitioning that maximizes/minimizes the Shannon entropy, or more generally the R\'enyi entropy is a crucial subroutine in data compression, columnar storage, and cardinality estimation algorithms. These partition algorithms can be…

Data Structures and Algorithms · Computer Science 2025-11-05 Aryan Esmailpour , Sanjay Krishnan , Stavros Sintos

In this paper we explore how non trivial boundary conditions could influence the entanglement entropy in a topological order in 2+1 dimensions. Specifically we consider the special class of topological orders describable by the quantum…

High Energy Physics - Theory · Physics 2018-06-26 Chaoyi Chen , Ling-Yan Hung , Yingcheng Li , Yidun Wan

We revisit entropic formulations of the uncertainty principle for an arbitrary pair of positive operator-valued measures (POVM) $A$ and $B$, acting on finite dimensional Hilbert space. Salicr\'u generalized $(h,\phi)$-entropies, including…

Quantum Physics · Physics 2015-06-18 S. Zozor , G. M. Bosyk , M. Portesi

We calculate the limiting behavior of relative Renyi entropy when the first probability distribution is close to the second one in a non-regular location-shift family which is generated by a probability distribution whose support is an…

Probability · Mathematics 2007-06-13 Masahito Hayashi

The Renyi distribution ensuring the maximum of a Renyi entropy is investigated for a particular case of a power--law Hamiltonian. Both Lagrange parameters, $\alpha$ and $\beta$ can be excluded. It is found that $\beta$ does not depend on a…

Statistical Mechanics · Physics 2009-11-10 A. G. Bashkirov

Over the past few years, a family of interesting new inequalities for the entropies of sums and differences of random variables has been developed by Ruzsa, Tao and others, motivated by analogous results in additive combinatorics. The…

Information Theory · Computer Science 2020-02-07 Mokshay Madiman , Ioannis Kontoyiannis

The matrix-based Renyi's \alpha-order entropy functional was recently introduced using the normalized eigenspectrum of a Hermitian matrix of the projected data in a reproducing kernel Hilbert space (RKHS). However, the current theory in the…

Information Theory · Computer Science 2019-08-01 Shujian Yu , Luis Gonzalo Sanchez Giraldo , Robert Jenssen , Jose C. Principe

The paper extends the analysis of the entropies of the Poisson distribution with parameter $\lambda$. It demonstrates that the Tsallis and Sharma-Mittal entropies exhibit monotonic behavior with respect to $\lambda$, whereas two generalized…

Probability · Mathematics 2024-11-27 Dmitri Finkelshtein , Anatoliy Malyarenko , Yuliya Mishura , Kostiantyn Ralchenko

We use a R\'enyi entropy method to prove strong converse theorems for certain information-theoretic tasks which involve local operations and quantum or classical communication between two parties. These include state redistribution,…

Quantum Physics · Physics 2016-08-10 Felix Leditzky , Mark M. Wilde , Nilanjana Datta

This paper is twofold. In the first part, we present a refinement of the R\'enyi Entropy Power Inequality (EPI) recently obtained in \cite{BM16}. The proof largely follows the approach in \cite{DCT91} of employing Young's convolution…

Probability · Mathematics 2018-05-01 Jiange Li

Uncovering causal interdependencies from observational data is one of the great challenges of nonlinear time series analysis. In this paper, we discuss this topic with the help of information-theoretic concept known as R\'enyi information…

Information Theory · Computer Science 2022-06-28 Petr Jizba , Hynek Lavička , Zlata Tabachová

We establish sharp rates for propagation of chaos in R\'enyi divergences for interacting diffusion systems at stationarity. Building upon the entropic hierarchy established in Lacker (2023), we show that under strong isoperimetry and weak…

Probability · Mathematics 2026-02-10 Matthew S. Zhang

This paper studies a specific class of statistical divergences for spectral densities of time series: the spectral $\alpha$-R\'{e}nyi divergences, which include the Itakura-Saito divergence as a limiting case. The aim of this paper is to…

Statistics Theory · Mathematics 2026-04-22 Tetsuya Takabatake , Keisuke Yano

Two families of dependence measures between random variables are introduced. They are based on the R\'enyi divergence of order $\alpha$ and the relative $\alpha$-entropy, respectively, and both dependence measures reduce to Shannon's mutual…

Information Theory · Computer Science 2019-08-22 Amos Lapidoth , Christoph Pfister

We give an overview of various results and methods related to information-theoretic distances of R\'enyi type in the light of their applications to the central limit theorem (CLT). The first part (Sections 1-9) is devoted to the total…

Information Theory · Computer Science 2025-03-07 S. G. Bobkov , G. P. Chistyakov , F. Götze
‹ Prev 1 4 5 6 7 8 10 Next ›