English
Related papers

Related papers: A Machine Learning Alternative to P-values

200 papers

We propose a coupled bootstrap (CB) method for the test error of an arbitrary algorithm that estimates the mean in a Poisson sequence, often called the Poisson means problem. The idea behind our method is to generate two carefully-designed…

Methodology · Statistics 2024-08-20 Natalia L. Oliveira , Jing Lei , Ryan J. Tibshirani

Cross-validation is a widely used technique for evaluating the performance of prediction models, ranging from simple binary classification to complex precision medicine strategies. It helps correct for optimism bias in error estimates,…

Out-of-distribution (OOD) learning often relies heavily on statistical approaches or predefined assumptions about OOD data distributions, hindering their efficacy in addressing multifaceted challenges of OOD generalization and OOD detection…

Machine Learning · Computer Science 2024-08-16 Haoyue Bai , Xuefeng Du , Katie Rainey , Shibin Parameswaran , Yixuan Li

Out-of-distribution (OOD) detection is essential for determining when a supervised model encounters inputs that differ meaningfully from its training distribution. While widely studied in classification, OOD detection for regression and…

Machine Learning · Statistics 2025-12-16 Min Lu , Hemant Ishwaran

Off-policy evaluation (OPE) is a method for estimating the return of a target policy using some pre-collected observational data generated by a potentially different behavior policy. In some cases, there may be unmeasured variables that can…

Machine Learning · Statistics 2023-02-03 Yang Xu , Jin Zhu , Chengchun Shi , Shikai Luo , Rui Song

We explore off-policy evaluation and learning (OPE/L) in contextual combinatorial bandits (CCB), where a policy selects a subset in the action space. For example, it might choose a set of furniture pieces (a bed and a drawer) from available…

Machine Learning · Statistics 2024-08-22 Tatsuhiro Shimizu , Koichi Tanaka , Ren Kishimoto , Haruka Kiyohara , Masahiro Nomura , Yuta Saito

Estimating nonlinear functionals of probability distributions from samples is a fundamental statistical problem. The "plug-in" estimator obtained by applying the target functional to the empirical distribution of samples is biased.…

Statistics Theory · Mathematics 2026-02-20 Florian Schäfer

For an autonomous agent, executing a poor policy may be costly or even dangerous. For such agents, it is desirable to determine confidence interval lower bounds on the performance of any given policy without executing said policy. Current…

Artificial Intelligence · Computer Science 2018-09-25 Josiah P. Hanna , Peter Stone , Scott Niekum

Non-linear hierarchical models are commonly used in many disciplines. However, inference in the presence of non-nested effects and on large datasets is challenging and computationally burdensome. This paper provides two contributions to…

Methodology · Statistics 2021-10-22 Max Goplerud

Data anomalies are ubiquitous in real world datasets, and can have an adverse impact on machine learning (ML) systems, such as automated home valuation. Detecting anomalies could make ML applications more responsible and trustworthy.…

Machine Learning · Computer Science 2020-09-22 Egor Klevak , Sangdi Lin , Andy Martin , Ondrej Linda , Eric Ringger

In supervised learning, the estimation of prediction error on unlabeled test data is an important task. Existing methods are usually built on the assumption that the training and test data are sampled from the same distribution, which is…

Methodology · Statistics 2022-09-30 Hui Xu , Robert Tibshirani

A natural way to quantify uncertainties in Gaussian mixture models (GMMs) is through Bayesian methods. That said, sampling from the joint posterior distribution of GMMs via standard Markov chain Monte Carlo (MCMC) imposes several…

Methodology · Statistics 2024-05-20 Santiago Marin , Bronwyn Loong , Anton H. Westveld

Outcome Reporting Bias (ORB) poses significant threats to the validity of meta-analytic findings. It occurs when researchers selectively report outcomes based on the significance or direction of results, potentially leading to distorted…

Methodology · Statistics 2025-07-17 Alessandra Gaia Saracini , Leonhard Held

Out-of-distribution (OOD) detection is an important task in machine learning systems for ensuring their reliability and safety. Deep probabilistic generative models facilitate OOD detection by estimating the likelihood of a data sample.…

Machine Learning · Computer Science 2021-06-16 Jaemoo Choi , Changyeon Yoon , Jeongwoo Bae , Myungjoo Kang

We propose a metric -- Projection Norm -- to predict a model's performance on out-of-distribution (OOD) data without access to ground truth labels. Projection Norm first uses model predictions to pseudo-label test samples and then trains a…

Machine Learning · Computer Science 2022-02-14 Yaodong Yu , Zitong Yang , Alexander Wei , Yi Ma , Jacob Steinhardt

The logistic regression analysis proposed by Schouten et al. (Stat Med. 1993;12:1733-1745) has been a standard method in current statistical analysis of case-cohort studies, and it enables effective estimation of risk ratio from selected…

Methodology · Statistics 2023-01-19 Hisashi Noma

We study the problem of out-of-sample risk estimation in the high dimensional regime where both the sample size $n$ and number of features $p$ are large, and $n/p$ can be less than one. Extensive empirical evidence confirms the accuracy of…

Machine Learning · Statistics 2020-03-05 Kamiar Rahnama Rad , Wenda Zhou , Arian Maleki

A regression method for proportional, or fractional, data with mixed effects is outlined, designed for analysis of datasets in which the outcomes have substantial weight at the bounds. In such cases a normal approximation is particularly…

Methodology · Statistics 2018-05-23 Colman Humphrey , Dan Swingley

Bootstrap techniques (also called resampling computation techniques) have introduced new advances in modeling and model evaluation. Using resampling methods to construct a series of new samples which are based on the original data set,…

Statistics Theory · Mathematics 2007-06-13 Riadh Kallel , Marie Cottrell , Vincent Vigneron

We use p-values as a discrepancy criterion for identifying the threshold value at which a regression function takes off from its baseline value -- a problem that is motivated by applications in omics experiments, systems engineering,…

Methodology · Statistics 2010-08-26 Bodhisattva Sen , Moulinath Banerjee , George Michialidis