Related papers: A Divergence Formula for Randomness and Dimension …

There are three classical divergence measures exist in the literature on information theory and statistics. These are namely, Jeffryes-Kullback-Leiber J-divergence. Sibson-Burbea-Rao Jensen-Shannon divegernce and Taneja Arithmetic-Geometric…

In this paper, we define spaces of measures $DS_\beta(\mathbb{R}^d)$ with dimensional stability $\beta \in (0,d)$. These spaces bridge between $M_b(\mathbb{R}^d)$, the space of finite Radon measures, and $DS_d(\mathbb{R}^d)=…

The Bernoulli convolution associated to the real $\beta>1$ and the probability vector $(p_0,..,p_{d-1})$ is a probability measure $\eta_{\beta,p}$ on $\mathbb R$, solution of the self-similarity relation…

We rigorously quantify the improvement in the sample complexity of variational divergence estimations for group-invariant distributions. In the cases of the Wasserstein-1 metric and the Lipschitz-regularized $\alpha$-divergences, the…

In this article, we study the test for independence of two random elements $X$ and $Y$ lying in an infinite dimensional space ${\cal{H}}$ (specifically, a real separable Hilbert space equipped with the inner product $\langle .,…

Convergence properties of Shannon Entropy are studied. In the differential setting, it is shown that weak convergence of probability measures, or convergence in distribution, is not enough for convergence of the associated differential…

We develop a test for spherical symmetry of a multivariate distribution $\Pr$ that works well even when the dimension of the data $d$ is larger than the sample size $n$. We propose a non-negative measure of spherical asymmetry $\zeta(\Pr)$…

Let $\alpha$ be an irrational real number. We show that the set of $\epsilon$-badly approximable numbers \[ \mathrm{Bad}^\varepsilon (\alpha) := \{x\in [0,1]\, : \, \liminf_{|q| \to \infty} |q| \cdot \| q\alpha -x \| \geq \varepsilon \} \]…

Divergences are quantities that measure discrepancy between two probability distributions and play an important role in various fields such as statistics and machine learning. Divergences are non-negative and are equal to zero if and only…

Given a norm $\nu$ on $\mathbb{R}^2$, the set of $\nu$-Dirichlet improvable numbers $\mathbf{DI}_\nu$ was defined and studied in the papers of Andersen-Duke (Acta Arith. 2021) and Kleinbock-Rao (Internat. Math. Res. Notices 2022). When…

In this paper, we study the approximation and estimation of $s$-concave densities via R\'enyi divergence. We first show that the approximation of a probability measure $Q$ by an $s$-concave densities exists and is unique via the procedure…

We consider an independent and identically distributed (i.i.d.) random dynamical system of simple linear transformations on the unit interval $T_{\beta}(x)=\beta x$ (mod $1$), $x\in[0,1]$, $\beta>0$, which are the so-called…

We generalize the family of $\alpha$-divergences using a pair of strictly comparable weighted means. In particular, we obtain the $1$-divergence in the limit case $\alpha\rightarrow 1$ (a generalization of the Kullback-Leibler divergence)…

A Hilbert space embedding for probability measures has recently been proposed, with applications including dimensionality reduction, homogeneity testing, and independence testing. This embedding represents any probability measure as a mean…

Let $\Theta=(\alpha,\beta)$ be a point in $\bR^2$, with $1,\alpha,\beta$ linearly independent over $\bQ$. We attach to $\Theta$ a quadruple $\Omega(\Theta)$ of exponents which measure the quality of approximation to $\Theta$ both by…

Let $(\Omega, \mu)$, $(\Delta, \nu)$ be measure spaces and $\{\tau_\alpha\}_{\alpha\in \Omega}$, $\{\omega_\beta\}_{\beta \in \Delta}$ be 1-bounded continuous Parseval frames for a Hilbert space $\mathcal{H}$. Then we show that…

Let $(\Omega, \mu)$ be a measure space and $\{\tau_\alpha\}_{\alpha\in \Omega}$ be a normalized continuous Bessel family for a real Hilbert space $\mathcal{H}$. If the diagonal $\Delta := \{(\alpha, \alpha):\alpha \in \Omega\}$ is…

Fix positive integers $a$ and $b$ such that $a> b\geq 2$ and a positive real $\delta>0$. Let $S$ be a planar set of diameter $\delta$ having the following property: for every $a$ points in $S$, at least $b$ of them have pairwise distances…

Let $\nu_\lambda^p$ be the distribution of the random series $\sum_{n=1}^\infty i_n \lambda^n$, where $i_n$ is a sequence of i.i.d. random variables taking the values 0,1 with probabilities $p,1-p$. These measures are the well-known…

Consider the random matrix $\Sigma = D^{1/2} X \widetilde D^{1/2}$ where $D$ and $\widetilde D$ are deterministic Hermitian nonnegative matrices with respective dimensions $N \times N$ and $n \times n$, and where $X$ is a random matrix with…