English
Related papers

Related papers: Properties of Classical and Quantum Jensen-Shannon…

200 papers

In this report, we derive a non-negative series expansion for the Jensen-Shannon divergence (JSD) between two probability distributions. This series expansion is shown to be useful for numerical calculations of the JSD, when the probability…

Machine Learning · Statistics 2008-10-29 Anil Raj , Chris H. Wiggins

The Kullback-Leibler (KL) divergence is a foundational measure for comparing probability distributions. Yet in multivariate settings, its single value often obscures the underlying reasons for divergence, conflating mismatches in individual…

Other Computer Science · Computer Science 2025-05-06 William Cook

The purpose of this paper is twofold. On a technical side, we propose an extension of the Hausdorff distance from metric spaces to spaces equipped with asymmetric distance measures. Specifically, we focus on the family of Bregman…

Machine Learning · Computer Science 2025-04-11 Tuyen Pham , Hana Dal Poz Kouřimská , Hubert Wagner

Let $X$ be a normed space that satisfies the Johnson-Lindenstrauss lemma (J-L lemma, in short) in the sense that for any integer $n$ and any $x_1,\ldots,x_n\in X$ there exists a linear mapping $L:X\to F$, where $F\subseteq X$ is a linear…

Functional Analysis · Mathematics 2008-07-29 William B. Johnson , Assaf Naor

We study a family of inequalities on pairs of measure spaces involving functions defined on product domains. Our main result establishes a Jensen-type inequality under a general product-measure framework, extending classical inequalities…

Functional Analysis · Mathematics 2026-03-09 P. D. Johnson , R. N. Mohapatra , Shankhadeep Mondal

Coherence is a fundamental ingredient in quantum physics and a key resource in quantum information processing. The quantification of quantum coherence is of great importance. We present a family of coherence quantifiers based on the Tsallis…

Quantum Physics · Physics 2020-10-23 Meng-Li Guo , Zhi-Xiang Jin , Bo Li , Bin Hu , Shao-Ming Fei

Combining gravity with quantum theory is still work in progress. On the one hand, classical gravity, is the geometry of space-time determined by the energy-momentum tensor of matter and the resulting nonlinear equations; on the other hand,…

Quantum Physics · Physics 2024-01-26 P. Gusin , D. Burys , A. Radosz

A Euclidean distance matrix $D(\alpha)$ is defined by $D_{ij}=(\alpha_i-\alpha_j)^2$, where $\alpha=(\alpha_1,\ldots,\alpha_n)$ is a real vector. We prove that $D(\alpha)$ cannot be written as a sum of $\left[2\sqrt{n}-2\right]$ nonnegative…

Combinatorics · Mathematics 2016-07-28 Yaroslav Shitov

The complexity quasi-metric of Schellekens is a topological framework in which the asymmetry of computational comparisons -- ``$A$ is at most as fast as $B$'' carrying different information than ``$B$ is at most as slow as $A$'' -- is built…

Computational Complexity · Computer Science 2026-05-01 Yaé U. Gaba

The Johnson-Lindenstrauss (JL) Lemma introduced the concept of dimension reduction via a random linear map, which has become a fundamental technique in many computational settings. For a set of $n$ points in $\mathbb{R}^d$ and any fixed…

Data Structures and Algorithms · Computer Science 2026-02-23 Shaofeng H. -C. Jiang , Robert Krauthgamer , Shay Sapir

One possibility of defining a quantum R\'enyi $\alpha$-divergence of two quantum states is to optimize the classical R\'enyi $\alpha$-divergence of their post-measurement probability distributions over all possible measurements (measured…

Quantum Physics · Physics 2023-01-18 Milán Mosonyi , Fumio Hiai

If $S$ is an infinite sequence over a finite alphabet $\Sigma$ and $\beta$ is a probability measure on $\Sigma$, then the {\it dimension} of $ S$ with respect to $\beta$, written $\dim^\beta(S)$, is a constructive version of Billingsley…

Computational Complexity · Computer Science 2009-06-24 Jack H. Lutz

The Holevo quantity provides an upper bound for the mutual information between the sender of a classical message encoded in quantum carriers and the receiver. Applying the strong sub-additivity of entropy we prove that the Holevo quantity…

Quantum Physics · Physics 2015-05-18 Wojciech Roga , Mark Fannes , Karol Zyczkowski

In this paper we introduce the intuitive notion of trivergence of probability distributions (TPD). This notion allow us to calculate the similarity among triplets of objects. For this computation, we can use the well known measures of…

Information Theory · Computer Science 2015-06-23 Juan-Manuel Torres-Moreno

A symmetrized lattice of $2n$ points in terms of an irrational real number $\alpha$ is considered in the unit square, as in the theorem of Davenport. If $\alpha$ is a quadratic irrational, the square of the $L^2$ discrepancy is found to be…

Number Theory · Mathematics 2016-10-21 Bence Borda

R\'enyi divergence is related to R\'enyi entropy much like information divergence (also called Kullback-Leibler divergence or relative entropy) is related to Shannon's entropy, and comes up in many settings. It was introduced by R\'enyi as…

Information Theory · Computer Science 2010-05-28 Tim van Erven , Peter Harremoës

Binary classification is a fundamental problem in machine learning. Recent development of quantum similarity-based binary classifiers and kernel method that exploit quantum interference and feature quantum Hilbert space opened up tremendous…

Quantum Physics · Physics 2020-04-08 Daniel K. Park , Carsten Blank , Francesco Petruccione

In this paper, we study the statistical and geometrical properties of the Kullback-Leibler divergence with kernel covariance operators (KKL) introduced by Bach [2022]. Unlike the classical Kullback-Leibler (KL) divergence that involves…

Machine Learning · Statistics 2025-03-12 Clémentine Chazal , Anna Korba , Francis Bach

This dissertation investigates relative entropies, also called generalized divergences, and how they can be used to characterize information-theoretic tasks in quantum information theory. The main goal is to further refine characterizations…

Quantum Physics · Physics 2016-11-29 Felix Leditzky

The importance of the quantum metric in flat-band systems has been noticed recently in many contexts such as the superfluid stiffness, the dc electrical conductivity, and ideal Chern insulators. Both the quantum metric of degenerate and…

Mesoscale and Nanoscale Physics · Physics 2022-11-10 Bruno Mera , Johannes Mitscherling