English
Related papers

Related papers: Kullback-Leibler divergence for the Fr\'echet extr…

200 papers

A generalized Kullback-Leibler relative entropy is introduced starting with the symmetric Jackson derivative of the generalized overlap between two probability distributions. The generalization retains much of the structure possessed by the…

Statistical Mechanics · Physics 2015-05-13 Takuya Yamano

We review some recent results of the fractional variational calculus. Necessary optimality conditions of Euler-Lagrange type for functionals with a Lagrangian containing left and right Caputo derivatives are given. Several problems are…

Optimization and Control · Mathematics 2011-11-29 Ricardo Almeida , Agnieszka B. Malinowska , Delfim F. M. Torres

Estimating the Kullback-Leibler (KL) divergence between random variables is a fundamental problem in statistical analysis. For continuous random variables, traditional information-theoretic estimators scale poorly with dimension and/or…

Machine Learning · Computer Science 2025-10-08 Mikil Foss , Andrew Lamperski

A well-known result, due to Dirichlet and later generalized by de la Vallee-Poussin, expresses a relationship between the sum of fractional parts and the Euler-Mascheroni constant. In this paper, we prove an asymptotic relationship between…

Number Theory · Mathematics 2017-01-19 Ibrahim Alabdulmohsin

We study problems of the calculus of variations and optimal control within the framework of time scales. Specifically, we obtain Euler-Lagrange type equations for both Lagrangians depending on higher order delta derivatives and…

Optimization and Control · Mathematics 2010-07-30 Rui A. C. Ferreira

We consider the problem of estimating probability density functions based on sample data, using a finite mixture of densities from some component class. To this end, we introduce the $h$-lifted Kullback--Leibler (KL) divergence as a…

Machine Learning · Statistics 2024-12-24 Mark Chiu Chong , Hien Duy Nguyen , TrungTin Nguyen

We study the existence and properties of Lipschitz continuous weak solutions to the Neumann boundary value problem for a class of one-dimensional quasilinear forward-backward diffusion equations with linear convection and reaction. The…

Analysis of PDEs · Mathematics 2016-06-29 Seonghak Kim , Baisheng Yan

We obtain an explicit solution for the static Kullback--Leibler (KL) unbalanced optimal transport problem between finite non-degenerate Gaussian measures with quadratic cost, two independent positive marginal relaxation parameters, and no…

Optimization and Control · Mathematics 2026-05-05 Jiaping Yang , Yunxin Zhang

To characterize the Kullback-Leibler divergence and Fisher information in general parametrized hidden Markov models, in this paper, we first show that the log likelihood and its derivatives can be represented as an additive functional of a…

Statistics Theory · Mathematics 2023-03-15 Cheng-Der Fuh , Chu-Lan Michael Kao , Tianxiao Pang

We consider a boundary value problem involving conformable derivative of order $\alpha ,$ $1<\alpha <2$ and Dirichlet conditions. To prove the existence of solutions, we apply the method of upper and lower solutions together with Schauder's…

Classical Analysis and ODEs · Mathematics 2017-10-31 Rabah Khaldi , Guezane-Lakoud Assia

In this work we investigate a very weak solution to the initial-boundary value problem of an Euler-Bernoulli beam model. We allow for bending stiffness, axial- and transversal forces as well as for initial conditions to be irregular…

Analysis of PDEs · Mathematics 2022-06-22 Robin Blommaert , Srđan Lazendić , Ljubica Oparnica

We calculate exactly the Laplace transform of the Fr\'{e}chet distribution in the form $\gamma x^{-(1+\gamma)} \exp(-x^{-\gamma})$, $\gamma > 0$, $0 \leq x < \infty$, for arbitrary rational values of the shape parameter $\gamma$, i.e. for…

Probability · Mathematics 2015-06-19 K. A. Penson , K. Górska

The article presents new sup-sums principles for integral F-divergence for arbitrary convex function F and arbitrary (not necessarily positive and absolutely continuous) measures. As applications of these results we derive the corresponding…

Statistics Theory · Mathematics 2019-09-17 V. I. Bakhtin , A. V. Lebedev

We give a proper fractional extension of the classical calculus of variations by considering variational functionals with a Lagrangian depending on a combined Caputo fractional derivative and the classical derivative. Euler-Lagrange…

Optimization and Control · Mathematics 2011-11-11 Tatiana Odzijewicz , Agnieszka B. Malinowska , Delfim F. M. Torres

In this short note we will use the residue theorem to establish a formula for Euler's constant. In particular, we offer a slightly generalized version of an interesting infinite series due to Flajolet, Gourdon, and Dumas.

Number Theory · Mathematics 2010-06-10 Mathew D. Rogers

We consider the problem of stochastic optimal control, where the state-feedback control policies take the form of a probability distribution and where a penalty on the entropy is added. By viewing the cost function as a Kullback- Leibler…

Optimization and Control · Mathematics 2024-12-12 Marc Lambert , Francis Bach , Silvère Bonnabel

The Kullback-Leibler (KL) divergence is a foundational measure for comparing probability distributions. Yet in multivariate settings, its single value often obscures the underlying reasons for divergence, conflating mismatches in individual…

Other Computer Science · Computer Science 2025-05-06 William Cook

We introduce and study the Dirichlet problem for double divergence form elliptic equations with coefficients of low regularity and boundary conditions given by general Borel measures. Under broad assumptions we establish the solvability of…

Analysis of PDEs · Mathematics 2026-05-26 V. I. Bogachev , S. V. Shaposhnikov

We derive approximate expressions for the dispersion relation of the nonlinear Klein-Gordon equation in the case of strong nonlinearities using a method based on the Linear Delta Expansion. All the results obtained in this article are fully…

Mathematical Physics · Physics 2007-05-23 P. Amore , A. Raya

Maximum Likelihood Estimators (MLE) has many good properties. For example, the asymptotic variance of MLE solution attains equality of the asymptotic Cram{\'e}r-Rao lower bound (efficiency bound), which is the minimum possible variance for…

Machine Learning · Statistics 2019-11-05 Song Liu , Takafumi Kanamori , Wittawat Jitkrittum , Yu Chen