English
Related papers

Related papers: Kullback-Leibler divergence for the Fr\'echet extr…

200 papers

We develop variation formulas on almost-product (e.g. foliated) pseudo-Riemannian manifolds, and we consider variations of metric preserving orthogonality of the distributions. These formulae are applied to Einstein-Hilbert type actions:…

Differential Geometry · Mathematics 2019-11-22 Vladimir Rovenski , Tomasz Zawadzki

We show that the moment generating function of the Kullback-Leibler divergence (relative entropy) between the empirical distribution of $n$ independent samples from a distribution $P$ over a finite alphabet of size $k$ (i.e. a multinomial…

Information Theory · Computer Science 2020-10-06 Rohit Agrawal

The main aim of this paper is to further develop a multiple-correction method formulated in a previous work~\cite{CXY}. As its applications, we find a kind of hybrid-type finite continued fraction approximations in two cases of Landau…

Number Theory · Mathematics 2014-10-14 Xiaodong Cao

This paper proposes and studies new quantum version of $f$-divergences, a class of convex functionals of a pair of probability distributions including Kullback-Leibler divergence, Rnyi-type relative entropy and so on. There are several…

Quantum Physics · Physics 2018-02-07 Keiji Matsumoto

Formalising the confrontation of opinions (models) to observations (data) is the task of Inferential Statistics. Information Theory provides us with a basic functional, the relative entropy (or Kullback-Leibler divergence), an asymmetrical…

Information Theory · Computer Science 2015-03-13 François Bavaud

Let K be a random variable following a truncated exponential distribution. Such distributions are described by a single parameter here denoted by $\gamma$. The determination of $\gamma$ by Maximum Likelihood methods leads to a…

Probability · Mathematics 2015-01-13 Grant Keady

We study the problem of spectrum estimation from transmission data of a known phantom. The goal is to reconstruct an x-ray spectrum that can accurately model the x-ray transmission curves and reflects a realistic shape of the typical energy…

Medical Physics · Physics 2021-07-14 Wooseok Ha , Emil Y. Sidky , Rina Foygel Barber , Taly Gilat Schmidt , Xiaochuan Pan

We study the problem of characterizing the stability of Kullback-Leibler (KL) divergence under Gaussian perturbations beyond Gaussian families. Existing relaxed triangle inequalities for KL divergence critically rely on the assumption that…

Machine Learning · Computer Science 2026-04-17 Jialu Pan , Yufeng Zhang , Nan Hu , Zhenbang Chen , Ji Wang , Keqin Li

We generalize the family of $\alpha$-divergences using a pair of strictly comparable weighted means. In particular, we obtain the $1$-divergence in the limit case $\alpha\rightarrow 1$ (a generalization of the Kullback-Leibler divergence)…

Information Theory · Computer Science 2022-11-23 Frank Nielsen

A bound for functional $\Delta(F)=\sup_{x\in\mathbb R}|F(x)-\Phi(x)|$ is obtained, which is uniform for all distribution functions $F$ of random variables with zero mean-value and unity variance. Moreover, a two-point distribution is found,…

Probability · Mathematics 2007-10-19 V. I. Chebotarev , A. S. Kondrik , K. V. Mikhaylov

In this paper, we establish the first variational formula and its Euler-Lagrange equation for the total $2p$-th mean curvature functional $\mathcal {M}_{2p}$ of a submanifold $M^n$ in a general Riemannian manifold $N^{n+m}$ for…

Differential Geometry · Mathematics 2015-06-03 Ling Xu , Jianquan Ge

We study the weak approximation error of a skew diffusion with bounded measurable drift and H\"older diffusion coefficient by an Euler-type scheme, which consists of iteratively simulating skew Brownian motions with constant drift. We first…

Probability · Mathematics 2016-09-30 Noufel Frikha

We provide sparse estimates for gradients of solutions to divergence form elliptic partial differential equations in terms of the source data. We give a general result of Meyers (or Gehring) type, a result for linear equations with VMO…

Analysis of PDEs · Mathematics 2024-09-19 Olli Saari , Hua-Yang Wang , Yuanhong Wei

Kullback-Leibler (KL) control enables efficient numerical methods for nonlinear optimal control problems. The crucial assumption of KL control is the full controllability of the transition distribution. However, this assumption is often…

Systems and Control · Electrical Eng. & Systems 2022-03-25 Kaito Ito , Kenji Kashima

In this paper, we are interested in deriving non-asymptotic error bounds for the multilevel Monte Carlo method. As a first step, we deal with the explicit Euler discretization of stochastic differential equations with a constant diffusion…

Probability · Mathematics 2018-10-19 Benjamin Jourdain , Ahmed Kebaier

A relation between Fick-Jacobs and Schr\"{o}dinger equation is shown. When the diffusion coefficient is constant, exact solutions for Fick-Jacobs equation are obtained. Using a change of variable the general case is studied.

Mathematical Physics · Physics 2012-11-27 Juan M. Romero , O. González-Gaxiola , G. Chacón-Acosta

The study of fractional variational problems in terms of a combined fractional Caputo derivative is introduced. Necessary optimality conditions of Euler-Lagrange type for the basic, isoperimetric, and Lagrange variational problems are…

Optimization and Control · Mathematics 2011-12-16 Agnieszka B. Malinowska , Delfim F. M. Torres

We develop variation formulas for the quantities of extrinsic geometry for adapted variations of metrics on almost-product (e.g. foliated) Riemannian manifolds, and apply them to study the total mixed scalar curvature of a distribution --…

Differential Geometry · Mathematics 2019-11-22 Elisabetta Barletta , Sorin Dragomir , Vladimir Rovenski

We approximate a given rational spectral density by one that is consistent with prescribed second-order statistics. Such an approximation is obtained by minimizing a suitable distance from the given spectrum and under the constraints…

Optimization and Control · Mathematics 2013-09-19 Mattia Zorzi

We present an algorithm that computes Friedl and L\"uck's twisted $L^2$-Euler characteristic for a suitable regular CW complex, employing Oki's matrix expansion algorithm to indirectly evaluate the Dieudonn\'e determinant. The algorithm…

Geometric Topology · Mathematics 2025-03-11 Jacopo G. Chen