English
Related papers

Related papers: The Renyi Capacity and Center

200 papers

This work considers a Poisson noise channel with an amplitude constraint. It is well-known that the capacity-achieving input distribution for this channel is discrete with finitely many points. We sharpen this result by introducing upper…

Information Theory · Computer Science 2021-07-30 Alex Dytso , Luca Barletta , Shlomo Shamai

Given positive measures $\nu,\mu$ on an arbitrary measurable space $(\Omega, \mathcal F)$, we construct a sequence of finite partitions $(\pi_n)_n$ of $(\Omega, \mathcal F)$ s.t. $$ \sum_{A\in \pi_n: \mu(A)>0} 1_{A} \frac{\nu(A)}{\mu(A)}…

Classical Analysis and ODEs · Mathematics 2019-09-10 Oleksii Mostovyi , Pietro Siorpaes

We consider finitary approximations of the (embedding) Ramsey property. Using a class of homogeneous reducts of random ordered hypergraphs, we prove that these properties form a strict hierarchy. We also show that every class of finite…

Combinatorics · Mathematics 2023-07-28 Nadav Meir , Aris Papadopoulos

In this note we prove Minami's estimate for a class of discrete alloy-type models with a sign-changing single-site potential of finite support. We apply Minami's estimate to prove Poisson statistics for the energy level spacing. Our result…

Spectral Theory · Mathematics 2016-01-05 Martin Tautenhahn , Ivan Veselić

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

Quantum Physics · Physics 2016-11-29 Felix Leditzky

Properties of scalar quantization with $r$th power distortion and constrained R\'enyi entropy of order $\alpha\in (0,1)$ are investigated. For an asymptotically (high-rate) optimal sequence of quantizers, the contribution to the R\'enyi…

Information Theory · Computer Science 2012-03-27 Wolfgang Kreitmeier , Tamas Linder

We extend classical theorems of Renyi by finding the distributions of the numbers of both weak and strong left-to-right maxima (a.k.a. outstanding elements) in words over a given alphabet and in permutations of a given multiset.

Combinatorics · Mathematics 2007-05-23 Amy Myers , Herb Wilf

Recursive Bayesian inference (RBI) provides optimal Bayesian latent variable estimates in real-time settings with streaming noisy observations. Active RBI attempts to effectively select queries that lead to more informative observations to…

Machine Learning · Computer Science 2021-03-11 Yeganeh M. Marghi , Aziz Kocanaogullari , Murat Akcakaya , Deniz Erdogmus

In this paper, we first introduce and define several new information divergences in the space of transition matrices of finite Markov chains which measure the discrepancy between two Markov chains. These divergences offer natural…

Information Theory · Computer Science 2023-12-11 Youjia Wang , Michael C. H. Choi

Entropy is a fundamental concept in equilibrium statistical mechanics, yet its origin in the non-equilibrium dynamics of isolated quantum systems is not fully understood. A strong consensus is emerging around the idea that the stationary…

Statistical Mechanics · Physics 2017-09-20 Vincenzo Alba , Pasquale Calabrese

One way of studying a relational structure is to investigate functions which are related to that structure and which leave certain aspects of the structure invariant. Examples are the automorphism group, the self-embedding monoid, the…

Logic · Mathematics 2011-05-31 Manuel Bodirsky , Michael Pinsker

We consider the one-dimensional XY quantum spin chain in a transverse magnetic field. We are interested in the Renyi entropy of a block of L neighboring spins at zero temperature on an infinite lattice. The Renyi entropy is essentially the…

Quantum Physics · Physics 2010-02-16 F. Franchini , A. R. Its , V. E. Korepin

Uncertainty relations provide constraints on how well the outcomes of incompatible measurements can be predicted, and, as well as being fundamental to our understanding of quantum theory, they have practical applications such as for…

Quantum Physics · Physics 2013-05-30 Patrick J. Coles , Roger Colbeck , Li Yu , Michael Zwolak

Consider the family of power divergence statistics based on $n$ trials, each leading to one of $r$ possible outcomes. This includes the log-likelihood ratio and Pearson's statistic as important special cases. It is known that in certain…

Probability · Mathematics 2024-11-08 Fraser Daly

Dini's Theorem guarantees that a monotone sequence of continuous functions converges pointwise on a compact interval to a continuous limit that converges uniformly. In this paper, we establish new theorems generalizing Dini's result by…

General Mathematics · Mathematics 2025-06-03 Riwaj Khatiwada

The Renyi entropy is a generalization of the usual concept of entropy which depends on a parameter q. In fact, Renyi entropy is closely related to free energy. Suppose we start with a system in thermal equilibrium and then suddenly divide…

Quantum Physics · Physics 2022-05-18 John C. Baez

We extend and refine recent results on Renyi entropy in two-dimensional conformal field theories at large central charge. To do so, we examine the effects of higher spin symmetry and of allowing unequal left and right central charges, at…

High Energy Physics - Theory · Physics 2015-06-18 Eric Perlmutter

First introduced by J. Deny, the classical principle of positivity of mass states that if $\kappa_\alpha\mu\leqslant\kappa_\alpha\nu$ everywhere on $\mathbb{R}^n$, then $\mu(\mathbb{R}^n)\leqslant\nu(\mathbb{R}^n)$. Here $\mu,\nu$ are…

Classical Analysis and ODEs · Mathematics 2023-03-14 Natalia Zorii

The Vapnik-Chervonenkis dimension of a set K in R^n is the maximal dimension of the coordinate cube of a given size, which can be found in coordinate projections of K. We show that the VC dimension of a convex body governs its entropy. This…

Functional Analysis · Mathematics 2016-12-23 S. Mendelson , R. Vershynin

Quantum mechanical uncertainty relations for position and momentum are expressed in the form of inequalities involving the Renyi entropies. The proof of these inequalities requires the use of the exact expression for the (p,q)-norm of the…

Quantum Physics · Physics 2009-11-13 Iwo Bialynicki-Birula