Related papers: Kullback-Leibler divergence for the Fr\'echet extr…
We generalise the classical Pinsker inequality which relates variational divergence to Kullback-Liebler divergence in two ways: we consider arbitrary f-divergences in place of KL divergence, and we assume knowledge of a sequence of values…
In this paper, we provide a detailed analysis of the global convergence properties of an extensively studied and extremely effective fixed-point algorithm for the Kullback-Leibler approximation of spectral densities, proposed by Pavon and…
In this paper, we study the strong consistency of a bias reduced kernel density estimator and derive a strongly con- sistent Kullback-Leibler divergence (KLD) estimator. As application, we formulate a goodness-of-fit test and an…
$f$-divergences, which quantify discrepancy between probability distributions, are ubiquitous in information theory, machine learning, and statistics. While there are numerous methods for estimating $f$-divergences from data, a limit…
Discrete diffusion models have achieved strong empirical performance in text and other symbolic domains, with masked (absorbing-rate) variants emerging as competitive alternatives to autoregressive models. Among existing samplers, the Euler…
Pinsker's widely used inequality upper-bounds the total variation distance $||P-Q||_1$ in terms of the Kullback-Leibler divergence $D(P||Q)$. Although in general a bound in the reverse direction is impossible, in many applications the…
We present linear forms with integer coefficients containing the Euler-Mascheroni and Euler-Gompertz constants. The forms are defined by four-terms recurrence relations. Asymptotics of the forms and their coefficients are obtained.
We introduce a stochastic fractional calculus. As an application, we present a stochastic fractional calculus of variations, which generalizes the fractional calculus of variations to stochastic processes. A stochastic fractional…
Variational Inference (VI) is a popular alternative to asymptotically exact sampling in Bayesian inference. Its main workhorse is optimization over a reverse Kullback-Leibler divergence (RKL), which typically underestimates the tail of the…
We consider the extreme value statistics of $N$ independent and identically distributed random variables, which is a classic problem in probability theory. When $N\to\infty$, fluctuations around the maximum of the variables are described by…
We review the recent generalized fractional calculus of variations. We consider variational problems containing generalized fractional integrals and derivatives and study them using indirect methods. In particular, we provide necessary…
An optimal transport problem on finite spaces is a linear program. Recently, a relaxation of the optimal transport problem via strictly convex functions, especially via the Kullback--Leibler divergence, sheds new light on data sciences.…
In 2006, Ihara defined and systematically studied a generalization of the Euler-Mascheroni constant for all global fields, named the Euler-Kronecker constants. This paper examines their distribution across geometric quadratic extensions of…
This paper shows that large nonparametric classes of conditional multivariate densities can be approximated in the Kullback--Leibler distance by different specifications of finite mixtures of normal regressions in which normal means and…
We prove that the $f$-divergences between univariate Cauchy distributions are all symmetric, and can be expressed as strictly increasing scalar functions of the symmetric chi-squared divergence. We report the corresponding scalar functions…
In the present work, we formulate a necessary condition for functionals with Lagrangians depending on fractional derivatives of differentiable functions to possess an extremum. The Euler-Lagrange equation we obtained generalizes previously…
In this paper, we study the existence, regularity, and approximation of the solution for a class of nonlinear fractional differential equations. {In order to do this}, suitable variational formulations are defined for a nonlinear boundary…
We propose an algebraic geometric stability criterion for a polarised variety to admit an extremal Kaehler metric. This generalises conjectures by Yau, Tian and Donaldson which relate to the case of Kaehler-Einstein and constant scalar…
A fully coupled system of two second-order parabolic degenerate equations arising as a thin film approximation to the Muskat problem is interpreted as a gradient flow for the 2-Wasserstein distance in the space of probability measures with…
Recently, the notion of implicit extreme value distributions has been established, which is based on a given loss function $f \ge 0$. From an application point of view, one is rather interested in extreme loss events that occur relative to…