English
Related papers

Related papers: A Neural Network Algorithm for KL Divergence Estim…

200 papers

We study the minimax estimation of $\alpha$-divergences between discrete distributions for integer $\alpha\ge 1$, which include the Kullback--Leibler divergence and the $\chi^2$-divergences as special examples. Dropping the usual…

Information Theory · Computer Science 2021-03-04 Yanjun Han , Jiantao Jiao , Tsachy Weissman

Complex, high-dimensional data is ubiquitous across many scientific disciplines, including machine learning, biology, and the social sciences. One of the primary methods of visualizing these datasets is with two-dimensional scatter plots…

Machine Learning · Computer Science 2025-10-13 Kiran Smelser , Kaviru Gunaratne , Jacob Miller , Stephen Kobourov

We propose an algorithm to estimate the path-gradient of both the reverse and forward Kullback-Leibler divergence for an arbitrary manifestly invertible normalizing flow. The resulting path-gradient estimators are straightforward to…

Machine Learning · Computer Science 2022-07-19 Lorenz Vaitl , Kim A. Nicoli , Shinichi Nakajima , Pan Kessel

We derive a new variational formula for the R\'enyi family of divergences, $R_\alpha(Q\|P)$, between probability measures $Q$ and $P$. Our result generalizes the classical Donsker-Varadhan variational formula for the Kullback-Leibler…

Machine Learning · Statistics 2021-07-21 Jeremiah Birrell , Paul Dupuis , Markos A. Katsoulakis , Luc Rey-Bellet , Jie Wang

In this paper, we delve deeper into the Kullback-Leibler (KL) Divergence loss and mathematically prove that it is equivalent to the Decoupled Kullback-Leibler (DKL) Divergence loss that consists of (1) a weighted Mean Square Error (wMSE)…

Machine Learning · Computer Science 2025-03-12 Jiequan Cui , Beier Zhu , Qingshan Xu , Zhuotao Tian , Xiaojuan Qi , Bei Yu , Hanwang Zhang , Richang Hong

This work presents an upper-bound to value that the Kullback-Leibler (KL) divergence can reach for a class of probability distributions called quantum distributions (QD). The aim is to find a distribution $U$ which maximizes the KL…

Machine Learning · Computer Science 2020-12-11 Vincenzo Bonnici

The capability of a novel Kullback-Leibler divergence method is examined herein within the Kalman filter framework to select the input-parameter-state estimation execution with the most plausible results. This identification suffers from…

Signal Processing · Electrical Eng. & Systems 2025-11-05 Marios Impraimakis

We propose a method to fuse posterior distributions learned from heterogeneous datasets. Our algorithm relies on a mean field assumption for both the fused model and the individual dataset posteriors and proceeds using a simple…

Machine Learning · Computer Science 2020-07-14 Sebastian Claici , Mikhail Yurochkin , Soumya Ghosh , Justin Solomon

We study the problem of nonnegative rank-one approximation of a nonnegative tensor, and show that the globally optimal solution that minimizes the generalized Kullback-Leibler divergence can be efficiently obtained, i.e., it is not NP-hard.…

Signal Processing · Electrical Eng. & Systems 2017-11-22 Kejun Huang , Nicholas D. Sidiropoulos

We study the fundamental and timely problem of learning long sequences in autoregressive modeling and next-token prediction under model misspecification, measured by the joint Kullback--Leibler (KL) divergence. Our goal is to characterize…

Machine Learning · Computer Science 2026-05-13 Yunbei Xu , Yuzhe Yuan , Ruohan Zhan

We derive a deterministic, non-asymptotic upper bound on the Kullback-Leibler (KL) divergence of the flow-matching distribution approximation. In particular, if the $L_2$ flow-matching loss is bounded by $\epsilon^2 > 0$, then the KL…

Machine Learning · Computer Science 2025-11-10 Maojiang Su , Jerry Yao-Chieh Hu , Sophia Pi , Han Liu

We consider the nonlinear Kalman filtering problem using Kullback-Leibler (KL) and $\alpha$-divergence measures as optimization criteria. Unlike linear Kalman filters, nonlinear Kalman filters do not have closed form Gaussian posteriors…

Optimization and Control · Mathematics 2017-11-22 San Gultekin , John Paisley

Discrete normal distributions are defined as the distributions with prescribed means and covariance matrices which maximize entropy on the integer lattice support. The set of discrete normal distributions form an exponential family with…

Information Theory · Computer Science 2022-01-25 Frank Nielsen

Model averaging is a useful and robust method for dealing with model uncertainty in statistical analysis. Often, it is useful to consider data subset selection at the same time, in which model selection criteria are used to compare models…

Methodology · Statistics 2023-10-26 Ethan T. Neil , Jacob W. Sitison

Modern data analysis often involves massive datasets with hundreds of thousands of observations, making traditional inference algorithms computationally prohibitive. Coresets are selection methods designed to choose a smaller subset of…

Computation · Statistics 2025-02-13 Bernardo Flores

Kullback-Leibler (KL) divergence is one of the most important divergence measures between probability distributions. In this paper, we prove several properties of KL divergence between multivariate Gaussian distributions. First, for any two…

Information Theory · Computer Science 2023-01-24 Yufeng Zhang , Wanwei Liu , Zhenbang Chen , Ji Wang , Kenli Li

A key task in managing distributed, sensitive data is to measure the extent to which a distribution changes. Understanding this drift can effectively support a variety of federated learning and analytics tasks. However, in many practical…

Machine Learning · Computer Science 2024-12-02 Mary Scott , Sayan Biswas , Graham Cormode , Carsten Maple

Knowledge distillation has been widely adopted in computer vision task processing, since it can effectively enhance the performance of lightweight student networks by leveraging the knowledge transferred from cumbersome teacher networks.…

Computer Vision and Pattern Recognition · Computer Science 2025-01-15 Yafei Qi , Chen Wang , Zhaoning Zhang , Yaping Liu , Yongmin Zhang

Statistical distances (SDs), which quantify the dissimilarity between probability distributions, are central to machine learning and statistics. A modern method for estimating such distances from data relies on parametrizing a variational…

Statistics Theory · Mathematics 2021-03-18 Sreejith Sreekumar , Zhengxin Zhang , Ziv Goldfeld

Calibrated probabilistic classifiers are models whose predicted probabilities can directly be interpreted as uncertainty estimates. It has been shown recently that deep neural networks are poorly calibrated and tend to output overconfident…

Machine Learning · Statistics 2022-10-17 Teodora Popordanoska , Raphael Sayer , Matthew B. Blaschko