Related papers: Total Variation Distance for Product Distributions…

We prove a ``general shrinking lemma'' that resembles the Schwarz--Pick--Ahlfors Lemma and its many generalizations, but differs in applying to maps of a finite disk into a disk, rather than requiring the domain of the map to be complete.…

Let P be a set of points in R^d, and let M be a function that maps any subset of P to a positive real number. We examine the problem of computing the exact mean and variance of M when a subset of points in P is selected according to a…

The paper studies upper bounds for the total variation distance between two polynomials of a special form in random vectors satisfying the Doeblin-type condition. Our approach is based on the recent results concerning Nikolskii--Besov-type…

In this paper, we propose the Fourier Discrepancy Function, a new discrepancy to compare discrete probability measures. We show that this discrepancy takes into account the geometry of the underlying space. We prove that the Fourier…

We build on the formalism developed in [arXiv:1906.08372v1] to propose new representations of solutions to Stein equations. We provide new uniform and non uniform bounds on these solutions (a.k.a.\ Stein factors). We use these…

In this paper, we obtain an explicit total variation bound in the central limit theorem for the sums of non-i.i.d. random variables. Our results show that, under suitable assumptions, Lindeberg's condition is sufficient and necessary for…

We study the total variation distance (TV) between two $n$-fold Bernoulli product measures parametrized by $\vec p=(p_1,\ldots,p_n)$ and $\vec q=(q_1,\ldots,q_n)$, respectively, in the \emph{tiny} and \emph{small} regimes. In the tiny…

Given an intractable distribution $p$, the problem of variational inference (VI) is to find the best approximation from some more tractable family $Q$. Commonly, one chooses $Q$ to be a family of factorized distributions (i.e., the…

Here I present the analytic form of two common distance metrics, the symmetrised Kullback-Leibler Divergence and the Kolmogorov-Smirnov statistic, as well as an extension of the Kolmogorov-Smirnov statistic for comparing theoretical gamma…

$\alpha$-posteriors and their variational approximations distort standard posterior inference by downweighting the likelihood and introducing variational approximation errors. We show that such distortions, if tuned appropriately, reduce…

In this paper we introduce the intuitive notion of trivergence of probability distributions (TPD). This notion allow us to calculate the similarity among triplets of objects. For this computation, we can use the well known measures of…

In this paper, we get some convergence rates in total variation distance in approximating discretized paths of L{\'e}vy driven stochastic differential equations, assuming that the driving process is locally stable. The particular case of…

In this work, we are interested in characterizing typical (generic) dimensional properties of invariant measures associated with the full-shift system, $T$, in a product space whose alphabet is a perfect and separable metric space (thus,…

New upper bounds on the relative entropy are derived as a function of the total variation distance. One bound refines an inequality by Verd\'{u} for general probability measures. A second bound improves the tightness of an inequality by…

We derive closed form expressions for the lower expectations that correspond to total variation distance and chi-squared divergence balls around a probability mass function over a finite set.

We revisit extending the Kolmogorov-Smirnov distance between probability distributions to the multidimensional setting and make new arguments about the proper way to approach this generalization. Our proposed formulation maximizes the…

A fundamental notion of distance between train and test distributions from the field of domain adaptation is discrepancy distance. While in general hard to compute, here we provide the first set of provably efficient algorithms for testing…

The binary divergences that are divergences between probability measures defined on the same 2-point set have an interesting property. For the chi-squared divergence and the relative entropy, it is known that their binary divergence attain…

Let $S_n=I_1+\cdots+I_n$ be a sum of independent indicators $I_i$, with $p_i=\Pr(I_i=1)=1-\Pr(I_i=0)$, $i=1,\ldots,n$. It is well-known that the total variation distance between $S_n$ and $Z_\lambda$, where $Z_\lambda$ has a Poisson…

We propose a general algorithm for approximating nonstandard Bayesian posterior distributions. The algorithm minimizes the Kullback-Leibler divergence of an approximating distribution to the intractable posterior distribution. Our method…