中文
相关论文

相关论文: Simulation of Random Variables under R\'enyi Diver…

200 篇论文

Channel simulation is to simulate a noisy channel using noiseless channels with unlimited shared randomness. This can be interpreted as the reverse problem to Shannon's noisy coding theorem. In contrast to previous works, our approach…

信息论 · 计算机科学 2025-06-06 Shi-Bing Li , Ke Li , Lei Yu

We propose a new family of regularized R\'enyi divergences parametrized not only by the order $\alpha$ but also by a variational function space. These new objects are defined by taking the infimal convolution of the standard R\'enyi…

One possibility of defining a quantum R\'enyi $\alpha$-divergence of two quantum states is to optimize the classical R\'enyi $\alpha$-divergence of their post-measurement probability distributions over all possible measurements (measured…

量子物理 · 物理学 2023-01-18 Milán Mosonyi , Fumio Hiai

We propose an extension of the classical R\'enyi divergences to quantum states through an optimization over probability distributions induced by restricted sets of measurements. In particular, we define the notion of locally-measured…

量子物理 · 物理学 2025-10-10 Tobias Rippchen , Sreejith Sreekumar , Mario Berta

We derive a new variational formula for the R\'enyi family of divergences, $R_\alpha(Q\|P)$, between probability measures $Q$ and $P$. Our result generalizes the classical Donsker-Varadhan variational formula for the Kullback-Leibler…

机器学习 · 统计学 2021-07-21 Jeremiah Birrell , Paul Dupuis , Markos A. Katsoulakis , Luc Rey-Bellet , Jie Wang

We present an approximate inference method, based on a synergistic combination of R\'enyi $\alpha$-divergence variational inference (RDVI) and rejection sampling (RS). RDVI is based on minimization of R\'enyi $\alpha$-divergence…

机器学习 · 计算机科学 2019-10-30 Rahul Sharma , Abhishek Kumar , Piyush Rai

Quantum information processing is limited, in practice, to efficiently implementable operations. This motivates the study of quantum divergences that preserve their operational meaning while faithfully capturing these computational…

量子物理 · 物理学 2025-09-26 Álvaro Yángüez , Thomas A. Hahn , Jan Kochanowski

R\'enyi divergence is related to R\'enyi entropy much like information divergence (also called Kullback-Leibler divergence or relative entropy) is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as…

信息论 · 计算机科学 2010-05-28 Tim van Erven , Peter Harremoës

The conventional channel resolvability problem refers to the determination of the minimum rate required for an input process so that the output distribution approximates a target distribution in either the total variation distance or the…

信息论 · 计算机科学 2018-12-04 Lei Yu , Vincent Y. F. Tan

Two typical fixed-length random number generation problems in information theory are considered for general sources. One is the source resolvability problem and the other is the intrinsic randomness problem. In each of these problems, the…

信息论 · 计算机科学 2024-05-14 Ryo Nomura , Hideki Yagi

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

量子物理 · 物理学 2016-11-29 Felix Leditzky

This paper investigates three closely related topics -- R\'enyi resolvability, noise stability, and anti-contractivity. The R\'enyi resolvability problem refers to approximating a target output distribution of a given channel in the R\'enyi…

信息论 · 计算机科学 2025-06-10 Lei Yu

The R\'enyi entropy is a generalization of the Shannon entropy and is widely used in mathematical statistics and applied sciences for quantifying the uncertainty in a probability distribution. We consider estimation of the quadratic R\'enyi…

统计理论 · 数学 2013-03-08 David Källberg , Nikolaj Leonenko , Oleg Seleznjev

We study the distribution of the order of a random permutation of $[n]$ through the lens of R\'enyi entropy. In particular, we obtain an asymptotic for the R\'enyi $q$-entropy of the order in the full range $1 \leq q \leq \infty$. For $q >…

组合数学 · 数学 2026-05-15 Adrian Beker

We provide an operational interpretation of the multivariate R\'enyi divergence in terms of economic-theoretic tasks based on betting, risk aversion, and multiple lotteries. We show that the multivariate R\'enyi divergence…

量子物理 · 物理学 2026-01-27 Andrés F. Ducuara , Erkka Haapasalo , Ryo Takakura

We consider the maximum entropy problems associated with R\'enyi $Q$-entropy, subject to two kinds of constraints on expected values. The constraints considered are a constraint on the standard expectation, and a constraint on the…

信息论 · 计算机科学 2008-12-18 Jean-François Bercher

We provide the sandwiched R\'enyi divergence of order $\alpha\in(\frac{1}{2},1)$, as well as its induced quantum information quantities, with an operational interpretation in the characterization of the exact strong converse exponents of…

量子物理 · 物理学 2024-05-29 Ke Li , Yongsheng Yao

R\'enyi divergences play a pivotal role in information theory, statistics, and machine learning. While several estimators of these divergences have been proposed in the literature with their consistency properties established and minimax…

信息论 · 计算机科学 2025-09-12 Sreejith Sreekumar , Kengo Kato

In this paper, we study the approximation and estimation of $s$-concave densities via R\'enyi divergence. We first show that the approximation of a probability measure $Q$ by an $s$-concave densities exists and is unique via the procedure…

统计理论 · 数学 2015-10-23 Qiyang Han , Jon A. Wellner

Strong data processing inequalities (SDPI) are an important object of study in Information Theory and have been well studied for $f$-divergences. Universal upper and lower bounds have been provided along with several applications,…

信息论 · 计算机科学 2024-05-16 Lifu Jin , Amedeo Roberto Esposito , Michael Gastpar
‹ 上一页 1 2 3 10 下一页 ›