English
Related papers

Related papers: Properties of the Strong Data Processing Constant …

200 papers

This paper starts by considering the minimization of the Renyi divergence subject to a constraint on the total variation distance. Based on the solution of this optimization problem, the exact locus of the points $\bigl( D(Q\|P_1),…

Information Theory · Computer Science 2015-10-27 Igal Sason

The optimized quantum $f$-divergences form a family of distinguishability measures that includes the quantum relative entropy and the sandwiched R\'enyi relative quasi-entropy as special cases. In this paper, we establish physically…

Quantum Physics · Physics 2021-10-04 Li Gao , Mark M. Wilde

It is well known that estimating the expectation of any given bounded random variable with values in $[-B, B]$ has a sample complexity of $\mathrm{O}(B^2/\epsilon^2)$ that is independent of the underlying probability measure. We show that…

Optimization and Control · Mathematics 2026-04-29 Yan Li

A source-channel separation theorem for a general channel has recently been shown by Aggrawal et. al. This theorem states that if there exist a coding scheme that achieves a maximum distortion level d_{max} over a general channel W, then…

Information Theory · Computer Science 2013-06-27 Nir Elkayam , Meir Feder

A general formulation of translationally invariant, parametrically correlated random matrix ensembles, is used to classify universality in correlation functions. Surprisingly, the range of possible physical systems is bounded, and can be…

chao-dyn · Physics 2016-08-31 Dimitri Kusnezov , Caio H. Lewenkopf

We derive sharp upper and lower bounds for the pointwise concentration function of the maximum statistic of $d$ identically distributed real-valued random variables. Our first main result places no restrictions either on the common marginal…

Statistics Theory · Mathematics 2025-08-04 Matias D. Cattaneo , Ricardo P. Masini , William G. Underwood

Interpreting neural network classifiers using gradient-based saliency maps has been extensively studied in the deep learning literature. While the existing algorithms manage to achieve satisfactory performance in application to standard…

Computer Vision and Pattern Recognition · Computer Science 2024-04-23 Haniyeh Ehsani Oskouie , Farzan Farnia

The Lipschitz constant is an important quantity that arises in analysing the convergence of gradient-based optimization methods. It is generally unclear how to estimate the Lipschitz constant of a complex model. Thus, this paper studies an…

Machine Learning · Statistics 2023-02-10 Calypso Herrera , Florian Krach , Josef Teichmann

This paper is devoted to the study of a discrepancy-type characteristic -- the fixed volume discrepancy -- of the Fibonacci point set in the unit square. It was observed recently that this new characteristic allows us to obtain optimal rate…

Numerical Analysis · Mathematics 2019-08-14 Vladimir Temlyakov , Mario Ullrich

We derive a new variational formula for the R\'enyi family of divergences, $R_\alpha(Q\|P)$, between probability measures $Q$ and $P$. Our result generalizes the classical Donsker-Varadhan variational formula for the Kullback-Leibler…

Machine Learning · Statistics 2021-07-21 Jeremiah Birrell , Paul Dupuis , Markos A. Katsoulakis , Luc Rey-Bellet , Jie Wang

Recently, a new notion of quantum R\'enyi divergences has been introduced by M\"uller-Lennert, Dupuis, Szehr, Fehr and Tomamichel, J.Math.Phys. 54:122203, (2013), and Wilde, Winter, Yang, Commun.Math.Phys. 331:593--622, (2014), that has…

Quantum Physics · Physics 2016-06-24 Milán Mosonyi

Tight bounds for several symmetric divergence measures are derived in terms of the total variation distance. It is shown that each of these bounds is attained by a pair of 2 or 3-element probability distributions. An application of these…

Information Theory · Computer Science 2016-11-17 Igal Sason

We consider the maximum entropy problems associated with R\'enyi $Q$-entropy, subject to two kinds of constraints on expected values. The constraints considered are a constraint on the standard expectation, and a constraint on the…

Information Theory · Computer Science 2008-12-18 Jean-François Bercher

This work contains two main contributions concerning the asymmetric broadcast channel. The first is an analysis of the exact random coding error exponents for both users, and the second is the derivation of universal decoders for both…

Information Theory · Computer Science 2017-02-28 Ran Averbuch , Neri Merhav

Quantum generalizations of Renyi's entropies are a useful tool to describe a variety of operational tasks in quantum information processing. Two families of such generalizations turn out to be particularly useful: the Petz quantum Renyi…

Quantum Physics · Physics 2017-01-25 Raban Iten , Joseph M. Renes , David Sutter

We perform a dispersive analysis of the $\omega\pi$ electromagnetic transition form factor, using as input the discontinuity provided by unitarity below the $\omega\pi$ threshold and including for the first time experimental data on the…

High Energy Physics - Phenomenology · Physics 2015-05-21 I. Caprini

Statistical divergences (SDs), which quantify the dissimilarity between probability distributions, are a basic constituent of statistical inference and machine learning. A modern method for estimating those divergences relies on…

Statistics Theory · Mathematics 2022-03-30 Sreejith Sreekumar , Ziv Goldfeld

We derive an (almost) guaranteed upper bound on the error of deep neural networks under distribution shift using unlabeled test data. Prior methods either give bounds that are vacuous in practice or give estimates that are accurate on…

Machine Learning · Statistics 2023-06-02 Elan Rosenfeld , Saurabh Garg

This paper investigates three closely related topics -- R\'enyi resolvability, noise stability, and anti-contractivity. The R\'enyi resolvability problem refers to approximating a target output distribution of a given channel in the R\'enyi…

Information Theory · Computer Science 2025-06-10 Lei Yu

Quantum key distribution requires tight and reliable bounds on the secret key rate to ensure robust security. This is particularly so for the regime of finite block sizes, where the optimization of generalized R\'enyi entropic quantities is…

Quantum Physics · Physics 2026-04-09 Rebecca R. B. Chung , Nelly H. Y. Ng , Yu Cai
‹ Prev 1 4 5 6 7 8 10 Next ›