English
Related papers

Related papers: Distribution free MMD tests for model selection wi…

200 papers

We extend a recently established asymptotic normality theorem for generalized linear mixed models to include the dispersion parameter. The new results show that the maximum likelihood estimators of all model parameters have asymptotically…

Statistics Theory · Mathematics 2022-08-11 Aishwarya Bhaskaran , Matt P. Wand

We present a general nonparametric approach for testing whether a statistical parameter defined through conditional distributions is constant across the conditioning variables. Such hypotheses arise naturally in problems such as assessing…

Methodology · Statistics 2026-04-23 Albert Osom , Ali Shojaie , Aaron Hudson

Comparing conditional distributions is a fundamental challenge in statistics and machine learning, with applications across a wide range of domains. While proposed methods for measuring discrepancies using kernel embeddings of distributions…

Machine Learning · Statistics 2026-05-05 Peter Moskvichev , Siu Lun Chau , Dino Sejdinovic

We consider tests of hypotheses when the parameters are not identifiable under the null in semiparametric models, where regularity conditions for profile likelihood theory fail. Exponential average tests based on integrated profile…

Statistics Theory · Mathematics 2009-08-25 Rui Song , Michael R. Kosorok , Jason P. Fine

Ordinary differential equations have been used to model dynamical systems in a broad range. Model checking for parametric ordinary differential equations is a necessary step to check whether the assumed models are plausible. In this paper…

Statistics Theory · Mathematics 2020-03-26 Ran Liu , Yun Fang , Lixing Zhu

In order to estimate causal effects in a randomized experiment where spillovers are suspected to occur, analysts must posit a model of interference. The most popular class of interference models are those based on exposure mappings. In…

Statistics Theory · Mathematics 2026-05-12 Chao Gao , Christopher Harshaw , Fredrik Sävje , Yitan Wang

When testing for the mean vector in a high dimensional setting, it is generally assumed that the observations are independently and identically distributed. However if the data are dependent, the existing test procedures fail to preserve…

Statistics Theory · Mathematics 2014-11-17 Deepak Nag Ayyala , Junyong Park , Anindya Roy

Do two data samples come from different distributions? Recent studies of this fundamental problem focused on embedding probability distributions into sufficiently rich characteristic Reproducing Kernel Hilbert Spaces (RKHSs), to compare…

Machine Learning · Computer Science 2013-05-03 Somayeh Danafar , Paola M. V. Rancoita , Tobias Glasmachers , Kevin Whittingstall , Juergen Schmidhuber

After variable selection, standard inferential procedures for regression parameters may not be uniformly valid; there is no finite-sample size at which a standard test is guaranteed to approximately attain its nominal size. This problem is…

Methodology · Statistics 2020-07-07 Oliver Dukes , Vahe Avagyan , Stijn Vansteelandt

We consider the problem of estimating the unconditional distribution of a post-model-selection estimator. The notion of a post-model-selection estimator here refers to the combined procedure resulting from first selecting a model (e.g., by…

Statistics Theory · Mathematics 2007-11-08 Hannes Leeb , Benedikt M. Poetscher

This paper proposes a new class of nonparametric tests for the correct specification of models based on conditional moment restrictions, paying particular attention to generalized propensity score models. The test procedure is based on two…

Econometrics · Economics 2023-04-18 Pedro H. C. Sant'Anna , Xiaojun Song

The Maximum Mean Discrepancy (MMD) is a cornerstone statistic for nonparametric two-sample testing, but its test power is dictated entirely by the chosen kernel. Because any fixed kernel inherently fails to distinguish certain…

Machine Learning · Statistics 2026-05-11 Yijin Ni , Xiaoming Huo

In model checking for regressions, nonparametric estimation-based tests usually have tractable limiting null distributions and are sensitive to oscillating alternative models, but suffer from the curse of dimensionality. In contrast,…

Methodology · Statistics 2019-03-12 Lingzhu Li , Xuehu Zhu , Lixing Zhu

Deterministic mathematical models, such as those specified via differential equations, are a powerful tool to communicate scientific insight. However, such models are necessarily simplified descriptions of the real world. Generalised…

Methodology · Statistics 2025-03-24 Zheyang Shen , Jeremias Knoblauch , Sam Power , Chris. J. Oates

Recent years have seen a surge in methods for two-sample testing, among which the Maximum Mean Discrepancy (MMD) test has emerged as an effective tool for handling complex and high-dimensional data. Despite its success and widespread…

Machine Learning · Statistics 2026-05-21 Ikjun Choi , Ilmun Kim

We consider the problem of estimating the missing mass, partition function or evidence and its probability distribution in the case that for each sample point in the discrete sample space its (unnormalized) probability mass is revealed.…

Statistics Theory · Mathematics 2026-03-16 Bastiaan J. Braams

We study two-sample variable selection: identifying variables that discriminate between the distributions of two sets of data vectors. Such variables help scientists understand the mechanisms behind dataset discrepancies. Although…

Machine Learning · Statistics 2025-11-06 Kensuke Mitsuzawa , Motonobu Kanagawa , Stefano Bortoli , Margherita Grossi , Paolo Papotti

Mixtures of generalized normal distributions (MGND) have gained popularity for modelling datasets with complex statistical behaviours. However, the estimation of the shape parameter within the maximum likelihood framework is quite complex,…

Methodology · Statistics 2025-06-03 Pierdomenico Duttilo , Stefano Antonio Gattone

Classical two-sample permutation tests for equality of distributions have exact size in finite samples, but they fail to control size for testing equality of parameters that summarize each distribution. This paper proposes permutation tests…

Econometrics · Economics 2022-04-22 Marinho Bertanha , EunYi Chung

In this article, a novel identification test is proposed, which can be applied to parameteric models such as Mixture of Normal (MN) distributions, Markow Switching(MS), or Structural Autoregressive (SVAR) models. In the approach, it is…

Methodology · Statistics 2022-06-09 Katarzyna Maciejowska