English
Related papers

Related papers: Kullback-Leibler divergence for the Fr\'echet extr…

200 papers

We introduce a kind of "perturbation" for the Li-Keiper coefficients around the Koebe function (the K function) and establish a closed system of Equations for the Li-Keiper coefficients. We then check the correctness of some of the many…

General Mathematics · Mathematics 2019-07-04 Danilo Merlini , Massimo Sala , Nicoletta Sala

We study the gradient flow for a relaxed approximation to the Kullback-Leibler (KL) divergence between a moving source and a fixed target distribution. This approximation, termed the KALE (KL approximate lower-bound estimator), solves a…

Machine Learning · Statistics 2021-11-01 Pierre Glaser , Michael Arbel , Arthur Gretton

We present new and improved non-asymptotic deviation bounds for Dirichlet processes (DPs), formulated using the Kullback-Leibler (KL) divergence, which is known for its optimal characterization of the asymptotic behavior of DPs. Our method…

Probability · Mathematics 2025-03-24 Pierre Perrault

We explain the connection between the Gumbel limit for diffusion exit times and the theory of extreme values.

Probability · Mathematics 2013-12-09 Yuri Bakhtin

We study concentration inequalities for the Kullback--Leibler (KL) divergence between the empirical distribution and the true distribution. Applying a recursion technique, we improve over the method of types bound uniformly in all regimes…

Information Theory · Computer Science 2019-10-22 Jay Mardia , Jiantao Jiao , Ervin Tánczos , Robert D. Nowak , Tsachy Weissman

By calculating the Kullback-Leibler divergence between two probability measures belonging to different exponential families, we end up with a formula that generalizes the ordinary Fenchel-Young divergence. Inspired by this formula, we…

Information Theory · Computer Science 2024-12-20 Frank Nielsen

We examine the total mixed scalar curvature of a fixed distribution as a functional of a pseudo-Riemannian metric. We develop variational formulas for quantities of extrinsic geometry of the distribution to find the critical points of this…

Differential Geometry · Mathematics 2016-09-30 Vladimir Rovenski , Tomasz Zawadzki

This paper proposes a new family of lower and upper bounds on the minimum mean squared error (MMSE). The key idea is to minimize/maximize the MMSE subject to the constraint that the joint distribution of the input-output statistics lies in…

Information Theory · Computer Science 2020-06-09 Michael Fauß , Alex Dysto , H. Vincent Poor

A finite difference numerical method is investigated for fractional order diffusion problems in one space dimension. For this, a mathematical model is developed to incorporate homogeneous Dirichlet and Neumann type boundary conditions. The…

Numerical Analysis · Mathematics 2014-11-07 Béla J. Szekeres , Ferenc Izsák

We consider three classes of linear differential equations on distribution functions, with a fractional order $\alpha\in [0,1].$ The integer case $\alpha =1$ corresponds to the three classical extreme families. In general, we show that…

Probability · Mathematics 2019-08-05 Lotfi Boudabsa , Thomas Simon , Pierre Vallois

We prove the existence of extremals for fractional Moser-Trudinger inequalities in an interval and on the whole real line. In both cases we use blow-up analysis for the corresponding Euler-Lagrange equation, which requires new sharp…

Analysis of PDEs · Mathematics 2019-04-24 Gabriele Mancini , Luca Martinazzi

We use the fitted Pareto law to construct an accompanying approximation of the excess distribution function. A selection rule of the location of the excess distribution function is proposed based on a stagewise lack-of-fit testing…

Statistics Theory · Mathematics 2008-08-08 Ion Grama , Vladimir Spokoiny

This archiving article consists of several short reports on the discussions between the two authors over the past two years at Oxford and Madrid, and their work carried out during that period on the upper bound of the Kullback-Leibler…

Information Theory · Computer Science 2019-11-20 Min Chen , Mateu Sbert

$f$-divergences are a general class of divergences between probability measures which include as special cases many commonly used divergences in probability, mathematical statistics and information theory such as Kullback-Leibler…

Statistics Theory · Mathematics 2013-10-16 Adityanand Guntuboyina , Sujayam Saha , Geoffrey Schiebinger

It has been shown that the Kullback-Leibler divergence is a Lyapunov function for the replicator equations at evolutionary stable states, or ESS. In this paper we extend the result to a more general class of game dynamics. As a result,…

Dynamical Systems · Mathematics 2014-08-22 Dashiell E. A. Fryer

In a variety of applications it is important to extract information from a probability measure $\mu$ on an infinite dimensional space. Examples include the Bayesian approach to inverse problems and possibly conditioned) continuous time…

Probability · Mathematics 2016-06-02 Frank Pinski , Gideon Simpson , Andrew Stuart , Hendrik Weber

Different fractional difference types of Euler-Lagrange equations are obtained within Riemann and Caputo by making use of different versions of integration by part forumlas in fractional difference calculus. An example is presented to…

Classical Analysis and ODEs · Mathematics 2017-03-21 Thabet Abdeljawad

We consider a boundary value problem involving a Riemann-Liouville fractional derivative of order $\alpha\in (3/2,2)$ on the unit interval $(0,1)$. The standard Galerkin finite element approximation converges slowly due to the presence of…

Numerical Analysis · Mathematics 2015-03-02 Bangti Jin , Raytcho Lazarov , Xiliang Lu , Zhi Zhou

We derive a deterministic, non-asymptotic upper bound on the Kullback-Leibler (KL) divergence of the flow-matching distribution approximation. In particular, if the $L_2$ flow-matching loss is bounded by $\epsilon^2 > 0$, then the KL…

Machine Learning · Computer Science 2025-11-10 Maojiang Su , Jerry Yao-Chieh Hu , Sophia Pi , Han Liu

Suppose Xt is either a regular exponential type Levy process or a Levy process with a bounded variation jumps measure. The distribution of the extrema of Xt play a crucial role in many financial and actuarial problems. This article employs…

Probability · Mathematics 2017-01-23 Amir T. Payandeh Najafabadi , Dan Kucerovsky