English
Related papers

Related papers: Robust Kullback-Leibler Divergence and Universal H…

200 papers

The forward Kullback-Leibler (KL) divergence is a ubiquitous objective for fitting a parameterized distribution to samples due to its tractability and equivalence to maximum likelihood estimation (MLE). Its inherent asymmetry, however, may…

Machine Learning · Computer Science 2026-05-12 Omri Ben-Dov , Luiz F. O. Chamon

We address the problem of Schr\"odinger potential estimation, which plays a crucial role in modern generative modelling approaches based on Schr\"odinger bridges and stochastic optimal control for SDEs. Given a simple prior diffusion…

Machine Learning · Computer Science 2025-06-04 Nikita Puchkin , Iurii Pustovalov , Yuri Sapronov , Denis Suchkov , Alexey Naumov , Denis Belomestny

We prove weak convergence in a separable Hilbert space for estimators of high-dimensional regression coefficients, which yields asymptotic normality and enables direct use of standard asymptotic tools such as the continuous mapping theorem.…

Statistics Theory · Mathematics 2026-05-05 Kou Fujimori , Koji Tsukuda

Knowledge distillation (KD), transferring knowledge from a cumbersome teacher model to a lightweight student model, has been investigated to design efficient neural architectures. Generally, the objective function of KD is the…

Machine Learning · Computer Science 2021-05-20 Taehyeon Kim , Jaehoon Oh , NakYil Kim , Sangwook Cho , Se-Young Yun

Inferring and comparing complex, multivariable probability density functions is fundamental to problems in several fields, including probabilistic learning, network theory, and data analysis. Classification and prediction are the two faces…

Information Theory · Computer Science 2017-03-30 David J. Galas , T. Gregory Dewey , James Kunert-Graf , Nikita A. Sakhanenko

We discuss a general approach to handling "multiple hypotheses" testing in the case when a particular hypothesis states that the vector of parameters identifying the distribution of observations belongs to a convex compact set associated…

Statistics Theory · Mathematics 2016-02-24 A. Goldenshluger , A. Juditski , A. Nemirovski

The Kullback-Leibler (KL) divergence is not a proper distance metric and does not satisfy the triangle inequality, posing theoretical challenges in certain practical applications. Existing work has demonstrated that KL divergence between…

Machine Learning · Statistics 2026-03-03 Shiji Xiao , Yufeng Zhang , Chubo Liu , Yan Ding , Keqin Li , Kenli Li

Given n observations, we study the consistency of a batch of k new observations, in terms of their distribution function. We propose a non-parametric, non-likelihood test based on Edgeworth expansion of the distribution function. The…

Statistics Theory · Mathematics 2009-06-08 Mahendra Mariadassou , Avner Bar-Hen

In this paper, we propose to solve a regularized distributionally robust learning problem in the decentralized setting, taking into account the data distribution shift. By adding a Kullback-Liebler regularization function to the robust…

Machine Learning · Computer Science 2022-09-13 Chaouki Ben Issaid , Anis Elgabli , Mehdi Bennis

We study the problem of testing identity against a given distribution with a focus on the high confidence regime. More precisely, given samples from an unknown distribution $p$ over $n$ elements, an explicitly given distribution $q$, and…

Data Structures and Algorithms · Computer Science 2019-01-17 Ilias Diakonikolas , Themis Gouleakis , John Peebles , Eric Price

Uniformity testing is one of the most well-studied problems in property testing, with many known test statistics, including ones based on counting collisions, singletons, and the empirical TV distance. It is known that the optimal sample…

Machine Learning · Statistics 2022-06-23 Shivam Gupta , Eric Price

The families of $f$-divergences (e.g. the Kullback-Leibler divergence) and Integral Probability Metrics (e.g. total variation distance or maximum mean discrepancies) are widely used to quantify the similarity between probability…

Statistics Theory · Mathematics 2021-06-08 Rohit Agrawal , Thibaut Horel

Multi-dimensional distributions whose marginal distributions are uniform are called copulas. Among them, the one that satisfies given constraints on expectation and is closest to the independent distribution in the sense of Kullback-Leibler…

Methodology · Statistics 2022-04-11 Yici Chen , Tomonari Sei

In testing of hypothesis the robustness of the tests is an important concern. Generally, the maximum likelihood based tests are most efficient under standard regularity conditions, but they are highly non-robust even under small deviations…

Methodology · Statistics 2018-05-01 Ayanendranath Basu , Abhijit Mandal , Nirian Martin , Leandro Pardo

Many two-sample problems call for a comparison of two distributions from an exponential family. Density ratio estimation methods provide ways to solve such problems through direct estimation of the differences in natural parameters. The…

Statistics Theory · Mathematics 2025-02-19 Erika Banzato , Mathias Drton , Kian Saraf-Poor , Hongjian Shi

Asymptotic methods for hypothesis testing in high-dimensional data usually require the dimension of the observations to increase to infinity, often with an additional condition on its rate of increase compared to the sample size. On the…

Statistics Theory · Mathematics 2024-03-26 Joydeep Chowdhury , Subhajit Dutta , Marc G. Genton

While powerful methods have been developed for high-dimensional hypothesis testing assuming orthogonal parameters, current approaches struggle to generalize to the more common non-orthogonal case. We propose Stable Distillation (SD), a…

Methodology · Statistics 2025-01-10 Ryan Christ , Ira Hall , David Steinsaltz

We study density estimation in Kullback-Leibler divergence: given an i.i.d. sample from an unknown density $p^\star$, the goal is to construct an estimator $\widehat{p}$ such that $\mathrm{KL}(p^\star,\widehat{p})$ is small with high…

Statistics Theory · Mathematics 2026-04-03 Spencer Compton , Gábor Lugosi , Jaouad Mourtada , Jian Qian , Nikita Zhivotovskiy

In this paper we deal with the problem of testing for the quality of $k$ probability distributions. We introduce a generalization of the maximum mean discrepancy that permits to characterize the null hypothesis. Then, an estimator of it is…

Statistics Theory · Mathematics 2018-11-26 Armando Sosthene Kali Balogoun , Guy Martial Nkiet , Carlos Ogouyandjou

Robust tests of general composite hypothesis under non-identically distributed observations is always a challenge. Ghosh and Basu (2018, Statistica Sinica, 28, 1133--1155) have proposed a new class of test statistics for such problems based…

Statistics Theory · Mathematics 2019-01-08 Abhik Ghosh , Ayanendranath Basu