English
Related papers

Related papers: Robust Nonparametric Two-Sample Tests via Mutual I…

200 papers

Measuring divergence between two distributions is essential in machine learning and statistics and has various applications including binary classification, change point detection, and two-sample test. Furthermore, in the era of big data,…

The stochastic block model is a popular tool for detecting community structures in network data. Detecting the difference between two community structures is an important issue for stochastic block models. However, the two-sample test has…

Methodology · Statistics 2022-12-21 Kang Fu , Jianwei Hu , Seydou Keita , Hao Liu

This paper considers the problem of robust hypothesis testing under non-identically distributed data. We propose Wald-type tests for both simple and composite hypothesis for independent but non-homogeneous observations based on the robust…

Methodology · Statistics 2019-05-09 Ayanendranath Basu , Abhik Ghosh , Nirian Martin , Leandro Pardo

The paper introduces robust independence tests with non-asymptotically guaranteed significance levels for stochastic linear time-invariant systems, assuming that the observed outputs are synchronous, which means that the systems are driven…

Machine Learning · Statistics 2023-08-07 Ambrus Tamás , Dániel Ágoston Bálint , Balázs Csanád Csáji

Nonresponse after probability sampling is a universal challenge in survey sampling, often necessitating adjustments to mitigate sampling and selection bias simultaneously. This study explored the removal of bias and effective utilization of…

Methodology · Statistics 2025-11-13 Kosuke Morikawa , Kenji Beppu , Wataru Aida

This paper introduces the generalized Hausman test as a novel method for detecting non-normality of the latent variable distribution of unidimensional Item Response Theory (IRT) models for binary data. The test utilizes the pairwise maximum…

Methodology · Statistics 2024-02-14 Lucia Guastadisegni , Silvia Cagnone , Irini Moustaki , Vassilis Vasdekis

Deep metric learning techniques have been used for visual representation in various supervised and unsupervised learning tasks through learning embeddings of samples with deep networks. However, classic approaches, which employ a fixed…

Computer Vision and Pattern Recognition · Computer Science 2023-08-30 Zhiyuan Li , Ziru Liu , Anna Zou , Anca L. Ralescu

This paper develops a unified framework for asymptotically minimax robust hypothesis testing under distributional uncertainty, applicable to both Bayesian and Neyman--Pearson formulations (Type-I and Type-II). Uncertainty classes based on…

Statistics Theory · Mathematics 2026-02-10 Gökhan Gül

Nonparametric two sample testing is a decision theoretic problem that involves identifying differences between two random variables without making parametric assumptions about their underlying distributions. We refer to the most common…

Statistics Theory · Mathematics 2015-08-05 Aaditya Ramdas , Sashank J. Reddi , Barnabas Poczos , Aarti Singh , Larry Wasserman

We investigate the unsupervised node classification problem on random hypergraphs under the non-uniform Hypergraph Stochastic Block Model (HSBM) with two equal-sized communities. In this model, edges appear independently with probabilities…

Statistics Theory · Mathematics 2025-12-01 Hai-Xiao Wang

The family of f-divergences is ubiquitously applied to generative modeling in order to adapt the distribution of the model to that of the data. Well-definedness of f-divergences, however, requires the distributions of the data and model to…

Machine Learning · Statistics 2019-06-04 Akash Srivastava , Kristjan Greenewald , Farzaneh Mirzazadeh

Nonparametric two sample testing deals with the question of consistently deciding if two distributions are different, given samples from both, without making any parametric assumptions about the form of the distributions. The current…

Statistics Theory · Mathematics 2014-11-25 Aaditya Ramdas , Sashank J. Reddi , Barnabas Poczos , Aarti Singh , Larry Wasserman

Zhang (2019) presented a general estimation approach based on the Gaussian distribution for general parametric models where the likelihood of the data is difficult to obtain or unknown, but the mean and variance-covariance matrix are known.…

Statistics Theory · Mathematics 2023-02-15 Ángel Felipe , María Jaenada , Pedro Miranda , Leandro Pardo

Data-driven risk analysis involves the inference of probability distributions from measured or simulated data. In the case of a highly reliable system, such as the electricity grid, the amount of relevant data is often exceedingly limited,…

Methodology · Statistics 2017-07-11 Simon H. Tindemans , Goran Strbac

In recent years, Bayesian nonparametric statistics has gathered extraordinary attention. Nonetheless, a relatively little amount of work has been expended on Bayesian nonparametric hypothesis testing. In this paper, a novel Bayesian…

Statistics Theory · Mathematics 2015-05-08 Luai Al Labadi , Emad Masuadi , Mahmoud Zarepour

We propose a test of independence of two multivariate random vectors, given a sample from the underlying population. Our approach, which we call MINT, is based on the estimation of mutual information, whose decomposition into joint and…

Methodology · Statistics 2017-11-20 Thomas B. Berrett , Richard J. Samworth

The paper introduces scaled Bregman distances of probability distributions which admit non-uniform contributions of observed events. They are introduced in a general form covering not only the distances of discrete and continuous stochastic…

Information Theory · Computer Science 2021-05-12 Wolfgang Stummer , Igor Vajda

We propose a fully data-driven approach to designing mutual information (MI) estimators. Since any MI estimator is a function of the observed sample from two random variables, we parameterize this function with a neural network (MIST) and…

Machine Learning · Computer Science 2026-02-24 German Gritsai , Megan Richards , Maxime Méloux , Kyunghyun Cho , Maxime Peyrard

We investigate the problem of jointly testing two hypotheses and estimating a random parameter based on data that is observed sequentially by sensors in a distributed network. In particular, we assume the data to be drawn from a Gaussian…

Signal Processing · Electrical Eng. & Systems 2020-03-04 Dominik Reinhard , Michael Fauß , Abdelhak M. Zoubir

The main purpose of this paper is to introduce first a new family of empirical test statistics for testing a simple null hypothesis when the vector of parameters of interest are defined through a specific set of unbiased estimating…

Statistics Theory · Mathematics 2014-08-19 Narayanaswamy Balakrishnan , Nirian Martín , Leandro Pardo