English
Related papers

Related papers: A closed-form formula for the Kullback-Leibler div…

200 papers

A new family of integer-valued Cauchy-type distributions is introduced, the {\it Cauchy-Cacoullos family}. The characteristic function is evaluated, showing some interesting distributional properties, similar to the ordinary (continuous)…

Probability · Mathematics 2022-05-10 Nickos Papadatos

Estimating the Kullback-Leibler (KL) divergence between two distributions given samples from them is well-studied in machine learning and information theory. Motivated by considerations of multi-group fairness, we seek KL divergence…

Machine Learning · Computer Science 2022-03-01 Parikshit Gopalan , Nina Narodytska , Omer Reingold , Vatsal Sharan , Udi Wieder

A finite volume scheme for the (Patlak-) Keller-Segel model in two space dimensions with an additional cross-diffusion term in the elliptic equation for the chemical signal is analyzed. The main feature of the model is that there exists a…

Numerical Analysis · Mathematics 2012-08-02 Marianne Bessemoulin-Chatard , Ansgar Jüngel

We provide optimal lower and upper bounds for the augmented Kullback-Leibler divergence in terms of the augmented total variation distance between two probability measures defined on two Euclidean spaces having different dimensions. We call…

Statistics Theory · Mathematics 2022-11-03 Michele Caprio

It is well-known that the Bhattacharyya, Hellinger, Kullback-Leibler, $\alpha$-divergences, and Jeffreys' divergences between densities belonging to a same exponential family have generic closed-form formulas relying on the strictly convex…

Statistics Theory · Mathematics 2020-04-08 Frank Nielsen , Richard Nock

We consider the Cauchy problem for homogeneous linear $q$-difference-differential equations with constant coefficients. We characterise convergent, $k$-summable and multisummable formal power series solutions in terms of analytic…

Analysis of PDEs · Mathematics 2024-12-17 Kunio Ichinobe , Sławomir Michalik

We present in this note a lower bound for the Calabi functional in a given K\"ahler class. This yields an integral inequality for constant scalar curvature metrics, which can be viewed as a refined version of Yau's Chern number inequality.

Differential Geometry · Mathematics 2018-10-18 Ping Li

Parabolic integro-differential model Cauchy problem is considered in the scale of Lp -spaces of functions whose regularity is defined by a scalable Levy measure. Existence and uniqueness of a solution is proved by deriving apriori…

Probability · Mathematics 2017-05-26 R. Mikulevicius , C. Phonsom

We give an overview of various results and methods related to information-theoretic distances of R\'enyi type in the light of their applications to the central limit theorem (CLT). The first part (Sections 1-9) is devoted to the total…

Information Theory · Computer Science 2025-03-07 S. G. Bobkov , G. P. Chistyakov , F. Götze

We establish the interior and exterior Gauss-Green formulas for divergence-measure fields in $L^p$ over general open sets, motivated by the rigorous mathematical formulation of the physical principle of balance law via the Cauchy flux in…

Analysis of PDEs · Mathematics 2019-01-21 Gui-Qiang G. Chen , Giovanni E. Comi , Monica Torres

We study the maximum likelihood estimator of density of $n$ independent observations, under the assumption that it is well approximated by a mixture with a large number of components. The main focus is on statistical properties with respect…

Statistics Theory · Mathematics 2017-01-19 Arnak S. Dalalyan , Mehdi Sebbar

We consider the explicit solution to the axisymmetric diffusion equation. We recast the solution in the form of a Mellin inversion formula, and outline a method to compute a formula for $u(r,t)$ as a series using the Cauchy residue theorem.…

Classical Analysis and ODEs · Mathematics 2021-10-07 Alexander E Patkowski

We introduce a new characterization of the Cauchy distribution and propose a class of goodness-of-fit tests to the Cauchy family. The limit distribution is derived in a Hilbert space framework under the null hypothesis and under fixed…

Statistics Theory · Mathematics 2021-06-25 Bruno Ebner , Lena Eid , Bernhard Klar

This paper deals with the Cauchy-Dirichlet problem for the fractional Cahn-Hilliard equation. The main results consist of global (in time) existence of weak solutions, characterization of parabolic smoothing effects (implying under proper…

Analysis of PDEs · Mathematics 2018-01-08 Goro Akagi , Giulio Schimperna , Antonio Segatti

We consider the problem of estimating probability density functions based on sample data, using a finite mixture of densities from some component class. To this end, we introduce the $h$-lifted Kullback--Leibler (KL) divergence as a…

Machine Learning · Statistics 2024-12-24 Mark Chiu Chong , Hien Duy Nguyen , TrungTin Nguyen

This archiving article consists of several short reports on the discussions between the two authors over the past two years at Oxford and Madrid, and their work carried out during that period on the upper bound of the Kullback-Leibler…

Information Theory · Computer Science 2019-11-20 Min Chen , Mateu Sbert

We consider the fundamental problem of estimating a discrete distribution on a domain of size $K$ with high probability in Kullback-Leibler divergence. We provide upper and lower bounds on the minimax estimation rate, which show that the…

Machine Learning · Statistics 2026-02-23 Dirk van der Hoeven , Julia Olkhovskaia , Tim van Erven

The Kullback-Leibler (KL) divergence is frequently used in data science. For discrete distributions on large state spaces, approximations of probability vectors may result in a few small negative entries, rendering the KL divergence…

Finding the proper entropy-like Lyapunov functional associated with the inelastic Boltzmann equation for an isolated freely cooling granular gas is a still unsolved challenge. The original $H$-theorem hypotheses do not fit here and the…

Soft Condensed Matter · Physics 2020-11-19 Alberto Megías , Andrés Santos

Divergences are quantities that measure discrepancy between two probability distributions and play an important role in various fields such as statistics and machine learning. Divergences are non-negative and are equal to zero if and only…

Statistics Theory · Mathematics 2019-10-22 Tomohiro Nishiyama