English
Related papers

Related papers: Deformed Statistics Kullback-Leibler Divergence Mi…

200 papers

In this paper, we propose some estimators for the parameters of a statistical model based on Kullback-Leibler divergence of the survival function in continuous setting. We prove that the proposed estimators are subclass of "generalized…

Statistics Theory · Mathematics 2016-07-01 Yaser Mehrali , Majid Asadi

Generalized linear (GL-) statistics are defined as functionals of an U-quantile process and unify different classes of statistics such as U-statistics and L-statistics. We derive a central limit theorem for GL-statistics of strongly mixing…

Statistics Theory · Mathematics 2014-12-02 Svenja Fischer , Roland Fried , Martin Wendler

Inferring and comparing complex, multivariable probability density functions is fundamental to problems in several fields, including probabilistic learning, network theory, and data analysis. Classification and prediction are the two faces…

Information Theory · Computer Science 2017-03-30 David J. Galas , T. Gregory Dewey , James Kunert-Graf , Nikita A. Sakhanenko

To characterize the Kullback-Leibler divergence and Fisher information in general parametrized hidden Markov models, in this paper, we first show that the log likelihood and its derivatives can be represented as an additive functional of a…

Statistics Theory · Mathematics 2023-03-15 Cheng-Der Fuh , Chu-Lan Michael Kao , Tianxiao Pang

Deep neural networks (DNNs) exhibit an exceptional capacity for generalization in practical applications. This work aims to capture the effect and benefits of depth for supervised learning via information-theoretic generalization bounds. We…

Machine Learning · Computer Science 2025-05-09 Haiyun He , Ziv Goldfeld

We consider the fundamental problem of estimating a discrete distribution on a domain of size $K$ with high probability in Kullback-Leibler divergence. We provide upper and lower bounds on the minimax estimation rate, which show that the…

Machine Learning · Statistics 2026-02-23 Dirk van der Hoeven , Julia Olkhovskaia , Tim van Erven

Blasiok (SODA'18) recently introduced the notion of a subgaussian sampler, defined as an averaging sampler for approximating the mean of functions $f:\{0,1\}^m \to \mathbb{R}$ such that $f(U_m)$ has subgaussian tails, and asked for explicit…

Computational Complexity · Computer Science 2019-09-19 Rohit Agrawal

We generalise the classical Pinsker inequality which relates variational divergence to Kullback-Liebler divergence in two ways: we consider arbitrary f-divergences in place of KL divergence, and we assume knowledge of a sequence of values…

Information Theory · Computer Science 2009-06-09 Mark D. Reid , Robert C. Williamson

Maximum regularized likelihood estimators (MRLEs) are arguably the most established class of estimators in high-dimensional statistics. In this paper, we derive guarantees for MRLEs in Kullback-Leibler divergence, a general measure of…

Machine Learning · Statistics 2018-10-18 Rui Zhuang , Johannes Lederer

In this paper, we derive some upper and lower bounds and inequalities for the total variation distance (TVD) and the Kullback-Leibler divergence (KLD), also known as the relative entropy, between two probability measures $\mu$ and $\nu$…

Probability · Mathematics 2025-01-07 Ievlev Pavel , Timofei Shashkov

Estimating Kullback-Leibler divergence from identical and independently distributed samples is an important problem in various domains. One simple and effective estimator is based on the k nearest neighbor distances between these samples.…

Information Theory · Computer Science 2020-02-27 Puning Zhao , Lifeng Lai

We show that the $f$-divergence between any two densities of potentially different location-scale families can be reduced to the calculation of the $f$-divergence between one standard density with another location-scale density. It follows…

Statistics Theory · Mathematics 2021-02-16 Frank Nielsen

We study the gradient flow for a relaxed approximation to the Kullback-Leibler (KL) divergence between a moving source and a fixed target distribution. This approximation, termed the KALE (KL approximate lower-bound estimator), solves a…

Machine Learning · Statistics 2021-11-01 Pierre Glaser , Michael Arbel , Arthur Gretton

Change of measure inequalities translate divergences between probability measures into explicit bounds on event probabilities, and play an important role in deriving probabilistic guarantees in learning theory, information theory, and…

Information Theory · Computer Science 2026-05-28 Yanxiao Liu , Yijun Fan , Deniz Gündüz

The forward Kullback-Leibler (KL) divergence is a ubiquitous objective for fitting a parameterized distribution to samples due to its tractability and equivalence to maximum likelihood estimation (MLE). Its inherent asymmetry, however, may…

Machine Learning · Computer Science 2026-05-12 Omri Ben-Dov , Luiz F. O. Chamon

This paper proposes two linear projection methods for supervised dimension reduction using only the first and second-order statistics. The methods, each catering to a different parameter regime, are derived under the general Gaussian model…

Information Theory · Computer Science 2024-08-13 Biao Chen , Joshua Kortje

We provide novel information-theoretic generalization bounds for stochastic gradient Langevin dynamics (SGLD) under the assumptions of smoothness and dissipativity, which are widely used in sampling and non-convex optimization studies. Our…

Machine Learning · Computer Science 2023-11-03 Futoshi Futami , Masahiro Fujisawa

In a variety of applications it is important to extract information from a probability measure $\mu$ on an infinite dimensional space. Examples include the Bayesian approach to inverse problems and possibly conditioned) continuous time…

Probability · Mathematics 2016-06-02 Frank Pinski , Gideon Simpson , Andrew Stuart , Hendrik Weber

Transfer learning, or domain adaptation, is concerned with machine learning problems in which training and testing data come from possibly different probability distributions. In this work, we give an information-theoretic analysis of the…

Information Theory · Computer Science 2024-08-09 Xuetong Wu , Jonathan H. Manton , Uwe Aickelin , Jingge Zhu

This paper provides a unified perspective for the Kullback-Leibler (KL)-divergence and the integral probability metrics (IPMs) from the perspective of maximum likelihood density-ratio estimation (DRE). Both the KL-divergence and the IPMs…

Machine Learning · Computer Science 2022-02-01 Masahiro Kato , Masaaki Imaizumi , Kentaro Minami