English
Related papers

Related papers: Robust Kullback-Leibler Divergence and Universal H…

200 papers

Knowing if a model will generalize to data 'in the wild' is crucial for safe deployment. To this end, we study model disagreement notions that consider the full predictive distribution - specifically disagreement based on Hellinger…

Machine Learning · Computer Science 2023-12-14 Mona Schirmer , Dan Zhang , Eric Nalisnick

We suggest a new approach to hypothesis testing for ergodic and stationary processes. In contrast to standard methods, the suggested approach gives a possibility to make tests, based on any lossless data compression method even if the…

Information Theory · Computer Science 2007-07-13 Boris Ryabko , Jaakko Astola

The algorithmic theory of randomness is well developed when the underlying space is the set of finite or infinite sequences and the underlying probability distribution is the uniform distribution or a computable distribution. These…

Computational Complexity · Computer Science 2016-08-31 Peter Gacs

Recent research has revealed that deep generative models including flow-based models and Variational Autoencoders may assign higher likelihoods to out-of-distribution (OOD) data than in-distribution (ID) data. However, we cannot sample OOD…

Machine Learning · Computer Science 2023-03-03 Yufeng Zhang , Jialu Pan , Wanwei Liu , Zhenbang Chen , Ji Wang , Zhiming Liu , Kenli Li , Hongmei Wei

We initiate a systematic investigation of distribution testing in the framework of algorithmic replicability. Specifically, given independent samples from a collection of probability distributions, the goal is to characterize the sample…

Machine Learning · Computer Science 2025-07-04 Ilias Diakonikolas , Jingyi Gao , Daniel Kane , Sihan Liu , Christopher Ye

We study the problem of mismatched binary hypothesis testing between i.i.d. distributions. We analyze the tradeoff between the pairwise error probability exponents when the actual distributions generating the observation are different from…

Information Theory · Computer Science 2022-04-28 Parham Boroumand , Albert Guillén i Fàbregas

We investigate the problem of testing whether a discrete probability distribution over an ordered domain is a histogram on a specified number of bins. One of the most common tools for the succinct approximation of data, $k$-histograms over…

Data Structures and Algorithms · Computer Science 2022-07-15 Clément L. Canonne , Ilias Diakonikolas , Daniel M. Kane , Sihan Liu

How can we monitor, in real time, whether one uncertain prospect has any upside over another? To answer this question, we develop a novel family of sequential, anytime-valid tests for stochastic dominance (SD; also known as stochastic…

Methodology · Statistics 2026-04-24 Sebastian Arnold , Yo Joong Choe , Marco Scarsini , Ilia Tsetlin

While the traditional viewpoint in machine learning and statistics assumes training and testing samples come from the same population, practice belies this fiction. One strategy -- coming from robust statistics and optimization -- is thus…

Machine Learning · Statistics 2024-07-08 Maxime Cauchois , Suyash Gupta , Alnur Ali , John C. Duchi

The purpose of this paper is to examine the sampling problem through Euler discretization, where the potential function is assumed to be a mixture of locally smooth distributions and weakly dissipative. We introduce $\alpha_{G}$-mixture…

Computation · Statistics 2023-02-01 Dao Nguyen

We study when low coordinate degree functions (LCDF) -- linear combinations of functions depending on small subsets of entries of a vector -- can hypothesis test between high-dimensional probability measures. These functions are a…

Statistics Theory · Mathematics 2024-03-13 Dmitriy Kunisky

The design of asymptotically minimax robust hypothesis testing is formalized for the Bayesian and Neyman-Pearson tests of Type-I and Type-II. The uncertainty classes based on the KL-divergence, $\alpha$-divergence, symmetrized…

Information Theory · Computer Science 2026-04-08 Gökhan Gül

We consider the problem of uniformity testing of Lipschitz continuous distributions with bounded support. The alternative hypothesis is a composite set of Lipschitz continuous distributions that are at least $\varepsilon$ away in $\ell_1$…

Statistics Theory · Mathematics 2021-10-14 Sudeep Salgia , Qing Zhao , Lang Tong

Motivated by applications in deep learning, where the global Lipschitz continuity condition is often not satisfied, we examine the problem of sampling from distributions with super-linearly growing log-gradients. We propose a novel tamed…

Statistics Theory · Mathematics 2025-06-06 Iosif Lytras , Sotirios Sabanis , Ying Zhang

Since pioneering work of Hinton et al., knowledge distillation based on Kullback-Leibler Divergence (KL-Div) has been predominant, and recently its variants have achieved compelling performance. However, KL-Div only compares probabilities…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Jiaming Lv , Haoyuan Yang , Peihua Li

We investigate the problem of identity testing for multidimensional histogram distributions. A distribution $p: D \rightarrow \mathbb{R}_+$, where $D \subseteq \mathbb{R}^d$, is called a $k$-histogram if there exists a partition of the…

Data Structures and Algorithms · Computer Science 2019-02-20 Ilias Diakonikolas , Daniel M. Kane , John Peebles

We consider a robust version of the classical Wald test statistics for testing simple and composite null hypotheses for general parametric models. These test statistics are based on the minimum density power divergence estimators instead of…

Statistics Theory · Mathematics 2016-07-04 Abhik Ghosh , Abhijit Mandal , Nirian Martin , Leandro Pardo

Parametric hypothesis testing associated with two independent samples arises frequently in several applications in biology, medical sciences, epidemiology, reliability and many more. In this paper, we propose robust Wald-type tests for…

Methodology · Statistics 2019-05-09 Abhik Ghosh , Nirian Martin , Ayanendranath Basu , Leandro Pardo

The classical binary hypothesis testing problem is revisited. We notice that when one of the hypotheses is composite, there is an inherent difficulty in defining an optimality criterion that is both informative and well-justified. For…

Statistics Theory · Mathematics 2021-03-29 Michael Bell , Yuval Kochman

In many applications in biology, engineering and economics, identifying similarities and differences between distributions of data from complex processes requires comparing finite categorical samples of discrete counts. Statistical…

Methodology · Statistics 2023-07-11 Francesco Camaglia , Ilya Nemenman , Thierry Mora , Aleksandra M. Walczak