English
Related papers

Related papers: One Permutation Is All You Need: Fast, Reliable Va…

200 papers

Interpretable machine learning has become a very active area of research due to the rising popularity of machine learning algorithms and their inherently challenging interpretability. Most work in this area has been focused on the…

Machine Learning · Statistics 2023-11-09 Quay Au , Julia Herbinger , Clemens Stachl , Bernd Bischl , Giuseppe Casalicchio

Clinical machine learning applications are often plagued with confounders that are clinically irrelevant, but can still artificially boost the predictive performance of the algorithms. Confounding is especially problematic in mobile health…

Applications · Statistics 2018-11-29 Elias Chaibub Neto

Given a robust model trained to be resilient to one or multiple types of distribution shifts (e.g., natural image corruptions), how is that "robustness" encoded in the model weights, and how easily can it be disentangled and/or "zero-shot"…

Machine Learning · Computer Science 2023-02-27 Ruisi Cai , Zhenyu Zhang , Zhangyang Wang

Adaptive Monte Carlo methods are very efficient techniques designed to tune simulation estimators on-line. In this work, we present an alternative to stochastic approximation to tune the optimal change of measure in the context of…

Probability · Mathematics 2009-10-23 Benjamin Jourdain , Jérôme Lelong

A key task of data science is to identify relevant features linked to certain output variables that are supposed to be modeled or predicted. To obtain a small but meaningful model, it is important to find stochastically independent…

Methodology · Statistics 2021-12-23 Tim Breitenbach , Lauritz Rasbach , Chunguang Liang , Patrick Jahnke

In this paper, we propose an easy-to-implement residual-based specification testing procedure for detecting structural changes in factor models, which is powerful against both smooth and abrupt structural changes with unknown break dates.…

Econometrics · Economics 2025-01-22 Bin Peng , Liangjun Su , Yayi Yan

In qualitative statistics, permutation tests are very popular, mainly because of their finite-sample exactness under exchangeability. However, in non-exchangeable settings, the covariance structure of permuted statistics typically differs…

Methodology · Statistics 2026-04-09 Merle Munko , Paavo Sattler

Penalized regression models are popularly used in high-dimensional data analysis to conduct variable selection and model fitting simultaneously. Whereas success has been widely reported in literature, their performances largely depend on…

Machine Learning · Statistics 2013-12-16 Wei Sun , Junhui Wang , Yixin Fang

Hypothesis testing of random forest (RF) variable importance measures (VIMP) remains the subject of ongoing research. Among recent developments, heuristic approaches to parametric testing have been proposed whose distributional assumptions…

Methodology · Statistics 2023-07-20 Alexander Hapfelmeier , Roman Hornung , Bernhard Haller

In the era of Model-as-a-Service, organizations increasingly rely on third-party AI models for rapid deployment. However, the dynamic nature of emerging AI applications, the continual introduction of new datasets, and the growing number of…

Machine Learning · Computer Science 2026-02-10 Zihan Zhu , Yanqiu Wu , Qiongkai Xu

It is common to conduct causal inference in matched observational studies by proceeding as though treatment assignments within matched sets are assigned uniformly at random and using this distribution as the basis for inference. This…

Methodology · Statistics 2023-11-14 Samuel D. Pimentel , Yaxuan Huang

This paper proposes niching importance sampling, a framework that combines concepts from reliability analysis, e.g. Markov chains, importance sampling, and relative cross entropy minimisation, with niching techniques from evolutionary…

Computation · Statistics 2026-04-09 Hugh J. Kinnear , F. A. DiazDelaO

We propose a permutation-based method for testing a large collection of hypotheses simultaneously. Our method provides lower bounds for the number of true discoveries in any selected subset of hypotheses. These bounds are simultaneously…

Applications · Statistics 2023-01-30 Angela Andreella , Jesse Hemerik , Wouter Weeda , Livio Finos , Jelle Goeman

Model-based mutation testing uses altered test models to derive test cases that are able to reveal whether a modelled fault has been implemented. This requires conformance checking between the original and the mutated model. This paper…

Software Engineering · Computer Science 2012-02-29 Bernhard K. Aichernig , Elisabeth Jöbstl

Machine learning algorithms often assume that training samples are independent. When data points are connected by a network, the induced dependency between samples is both a challenge, reducing effective sample size, and an opportunity to…

Machine Learning · Statistics 2025-09-22 Tiffany M. Tang , Elizaveta Levina , Ji Zhu

Permutation tests are widely recognized as robust alternatives to tests based on normal theory. Random permutation tests have been frequently employed to assess the significance of variables in linear models. Despite their widespread use,…

Methodology · Statistics 2023-12-29 Leying Guan

Recent model-free reinforcement learning algorithms have proposed incorporating learned dynamics models as a source of additional data with the intention of reducing sample complexity. Such methods hold the promise of incorporating imagined…

Machine Learning · Computer Science 2018-03-02 Vladimir Feinberg , Alvin Wan , Ion Stoica , Michael I. Jordan , Joseph E. Gonzalez , Sergey Levine

Selective inference is a subfield of statistics that enables valid inference after selection of a data-dependent question. In this paper, we introduce selectively dominant p-values, a class of p-values that allow practitioners to easily…

Methodology · Statistics 2024-11-22 Anav Sood

Complex problems may require sophisticated, non-linear learning methods such as kernel machines or deep neural networks to achieve state of the art prediction accuracies. However, high prediction accuracies are not the only objective to…

Artificial Intelligence · Computer Science 2016-11-24 Marina M. -C. Vidovic , Nico Görnitz , Klaus-Robert Müller , Marius Kloft

A central challenge to applying many off-policy reinforcement learning algorithms to real world problems is the variance introduced by importance sampling. In off-policy learning, the agent learns about a different policy than the one being…

Machine Learning · Computer Science 2022-06-20 Eric Graves , Sina Ghiassian