English
Related papers

Related papers: Computing the Kullback-Leibler Divergence between …

200 papers

When sampling multi-modal probability distributions, correctly estimating the relative probability of each mode, even when the modes have been discovered and locally sampled, remains challenging. We test a simple reweighting scheme designed…

Statistics Theory · Mathematics 2026-02-17 Pierre Monmarché

Finding the proper entropy-like Lyapunov functional associated with the inelastic Boltzmann equation for an isolated freely cooling granular gas is a still unsolved challenge. The original $H$-theorem hypotheses do not fit here and the…

Soft Condensed Matter · Physics 2020-11-19 Alberto Megías , Andrés Santos

Different fractional difference types of Euler-Lagrange equations are obtained within Riemann and Caputo by making use of different versions of integration by part forumlas in fractional difference calculus. An example is presented to…

Classical Analysis and ODEs · Mathematics 2017-03-21 Thabet Abdeljawad

In this study, recently introduced generalized distribution functions are summarized and by using one of these distribution functions, namely generalized Planck distribution, an alternative approach to the generalized Planck law for the…

Statistical Mechanics · Physics 2015-06-25 Ugur Tirnakli , Fevzi Buyukkilic , Dogan Demirhan

A GGC (Generalized Gamma Convolution) representation of Riemann's Xi-function is constructed.

General Mathematics · Mathematics 2018-10-16 Nicholas G. Polson

Score-matching generative models have proven successful at sampling from complex high-dimensional data distributions. In many applications, this distribution is believed to concentrate on a much lower $d$-dimensional manifold embedded into…

Machine Learning · Statistics 2025-04-25 Peter Potaptchik , Iskander Azangulov , George Deligiannidis

In this paper, we provide a detailed analysis of the global convergence properties of an extensively studied and extremely effective fixed-point algorithm for the Kullback-Leibler approximation of spectral densities, proposed by Pavon and…

Optimization and Control · Mathematics 2018-01-26 Giacomo Baggio

We give the new distribution named Gamma Lindley distribution (GaLD), of which the Lindley distribution (LD) is a particular case. In this paper, we discuss and add more properties. Also, an application of this distribution is given.

Applications · Statistics 2015-01-28 Halim Zeghdoudi , Sihem Nedjar

The aim of this paper is to study certain properties of the Kullback-Leibler distance between two positive integer numbers or between two ideals. We present some results related the entropy of a positive integer number and the divergence of…

Number Theory · Mathematics 2023-05-16 Nicusor Minculete , Diana Savin

The asymmetric skew divergence smooths one of the distributions by mixing it, to a degree determined by the parameter $\lambda$, with the other distribution. Such divergence is an approximation of the KL divergence that does not require the…

Information Theory · Computer Science 2021-04-27 Masanari Kimura , Hideitsu Hino

We define a family {$\gamma(P)$} of generalized Euler constants indexed by finite sets of primes $P$ and study their distribution. These arise from partial sums of reciprocals of integers not divisible by any prime in $P$. An apparent…

Number Theory · Mathematics 2019-05-01 Harold G. Diamond , Kevin Ford

We give the definition of a duality that is applicable to arbitrary $k$-forms. The operator that defines the duality depends on a fixed form $\Omega$. Our definition extends in a very natural way the Hodge duality of $n$-forms in $2n$…

Differential Geometry · Mathematics 2011-09-06 Frank Klinker

Selecting an appropriate divergence measure is a critical aspect of machine learning, as it directly impacts model performance. Among the most widely used, we find the Kullback-Leibler (KL) divergence, originally introduced in kinetic…

Mathematical Physics · Physics 2025-07-16 Gennaro Auricchio , Giovanni Brigati , Paolo Giudici , Giuseppe Toscani

We consider the fundamental problem of estimating a discrete distribution on a domain of size $K$ with high probability in Kullback-Leibler divergence. We provide upper and lower bounds on the minimax estimation rate, which show that the…

Machine Learning · Statistics 2026-02-23 Dirk van der Hoeven , Julia Olkhovskaia , Tim van Erven

We show how to find upper and lower bounds to the median of a gamma distribution, over the entire range of shape parameter $k > 0$, that are the tightest possible bounds of the form $2^{-1/k} (A + Bk)$, with closed-form parameters $A$ and…

Functional Analysis · Mathematics 2024-04-24 Richard F. Lyon

The probability density quantile (pdQ) carries essential information regarding shape and tail behavior of a location-scale family. Convergence of repeated applications of the pdQ mapping to the uniform distribution is investigated and new…

Statistics Theory · Mathematics 2018-05-23 Robert Staudte , Aihua Xia

The aim of this paper is to organize some known mass formulas arising from a definite central division algebra over a global field and to deduce some more new ones.

Number Theory · Mathematics 2014-08-26 Chia-Fu Yu

We examine critically the Gambier equation and show that it is the generic linearisable equation containing, as reductions, all the second-order equations which are integrable through linearisation. We then introduce the general discrete…

solv-int · Physics 2015-06-26 B. Grammaticos , A. Ramani , S. Lafortune

We present a pedagogical description of the inversion of Gamow's tunnelling formula and we compare it with the corresponding classical problem. We also discuss the issue of uniqueness in the solution and the result is compared with that…

Quantum Physics · Physics 2009-11-11 S. C. Gandhi , C. J. Efthimiou

A differential algebra of nonlinear generalized functions is presented as a tool for a wide range of nonsmooth nonlinear problems. The power of the differential algebra is used to do mathematical calculations or proofs; then the final…

Mathematical Physics · Physics 2007-05-23 J. F. Colombeau