Related papers: Characterizations and Kullback-Leibler Divergence …
Bayesian nonparametric statistics is an area of considerable research interest. While recently there has been an extensive concentration in developing Bayesian nonparametric procedures for model checking, the use of the Dirichlet process,…
A simple estimator for the finite right endpoint of a distribution function in the Gumbel max-domain of attraction is proposed. Large sample properties such as consistency and the asymptotic distribution are derived. A simulation study is…
The problem of estimating the Kullback-Leibler divergence $D(P\|Q)$ between two unknown distributions $P$ and $Q$ is studied, under the assumption that the alphabet size $k$ of the distributions can scale to infinity. The estimation is…
The Multivariate Extreme Value distributions have shown their usefulness in environmental studies, financial and insurance mathematics. The Logistic or Gumbel-Hougaard distribution is one of the oldest multivariate extreme value models and…
Score-matching generative models have proven successful at sampling from complex high-dimensional data distributions. In many applications, this distribution is believed to concentrate on a much lower $d$-dimensional manifold embedded into…
We study the distributions of money in a simple closed economic system for different types of monetary transactions. We know that for arbitrary and random sharing but locally conserving money transactions, the money distribution goes to the…
We consider the extreme value statistics of correlated random variables that arise from a Langevin equation. Recently, it was shown that the extreme values of the Ornstein-Uhlenbeck process follow a different distribution than those…
We present new and improved non-asymptotic deviation bounds for Dirichlet processes (DPs), formulated using the Kullback-Leibler (KL) divergence, which is known for its optimal characterization of the asymptotic behavior of DPs. Our method…
Study of charged particle multiplicity distribution in high energy interactions of particles helps in revealing the dynamics of particle production and the underlying statistical patterns, which these distributions follow. Several…
For a given parametric probability model, we consider the risk of the maximum likelihood estimator with respect to $\alpha$-divergence, which includes the special cases of Kullback--Leibler divergence, the Hellinger distance and $\chi^2$…
In this paper, we study the statistical and geometrical properties of the Kullback-Leibler divergence with kernel covariance operators (KKL) introduced by Bach [2022]. Unlike the classical Kullback-Leibler (KL) divergence that involves…
We investigate extreme value theory for physical systems with a global conservation law which describe renewal processes, mass transport models and long-range interacting spin models. As shown previously, a special feature is that the…
This paper presents an improved exponential tail bound for Beta distributions, refining a result in [15]. This improvement is achieved by interpreting their bound as a regular Kullback-Leibler (KL) divergence one, while introducing a…
We present theoretical properties of the log-concave maximum likelihood estimator of a density based on an independent and identically distributed sample in $\mathbb{R}^d$. Our study covers both the case where the true underlying density is…
Optimum designs for parameter estimation in generalized regression models are standardly based on the Fisher information matrix (cf. Atkinson et al (2014) for a recent exposition). The corresponding optimality criteria are related to the…
The Kullback-Leibler (KL) divergence is a foundational measure for comparing probability distributions. Yet in multivariate settings, its single value often obscures the underlying reasons for divergence, conflating mismatches in individual…
Gaussian Processes and the Kullback-Leibler divergence have been deeply studied in Statistics and Machine Learning. This paper marries these two concepts and introduce the local Kullback-Leibler divergence to learn about intervals where two…
This paper explores the possibility of establishing an analytic form of the distribution of the order parameter fluctuations in a two-dimensional critical spin wave model, or width fluctuations of a two dimensional Edwards-Wilkinson…
This paper introduces link functions for transforming one probability distribution to another such that the Kullback-Leibler and R\'enyi divergences between the two distributions are symmetric. Two general classes of link models are…
In this paper we perform an analytical and numerical study of Extreme Value distributions in discrete dynamical systems that have a singular measure. Using the block maxima approach described in Faranda et al. [2011] we show that,…