English
Related papers

Related papers: Why stratification may hurt, & how much

200 papers

Following Fisher, it is widely believed that randomization "relieves the experimenter from the anxiety of considering innumerable causes by which the data may be disturbed." In particular, it is said to control for known and unknown…

Methodology · Statistics 2017-10-02 Uwe Saint-Mont

The allocation problem for multivariate stratified random sampling as a problem of stochastic matrix integer mathematical programming is considered. With these aims the asymptotic normality of sample covariance matrices for each strata is…

Statistics Theory · Mathematics 2011-05-18 Jose A. Diaz-Garcia , Rogelio Ramos-Quiroga

Performance-based engineering for natural hazards facilitates the design and appraisal of structures with rigorous evaluation of their uncertain structural behavior under potentially extreme stochastic loads expressed in terms of failure…

Computational Engineering, Finance, and Science · Computer Science 2023-05-11 Srinivasan Arunachalam , Seymour M. J. Spence

Stratified sampling is a fast and simple method to generate point sets with uniform distribution in hypercubes. However, for the most common paraxial stratfication it has the prominent drawback that the number of sampled points in n…

Computation · Statistics 2018-06-14 Simon Wessing

Stratification in both the design and analysis of randomized clinical trials is common. Despite features in automated randomization systems to re-confirm the stratifying variables, incorrect values of these variables may be entered. These…

Methodology · Statistics 2023-07-24 Neal Thomas

We consider the problem of strategic classification, where a learner must build a model to classify agents based on features that have been strategically modified. Previous work in this area has concentrated on the case when the learner is…

Machine Learning · Computer Science 2025-05-19 Jack Geary , Henry Gouk

Simulation-based inference plays a major role in modern statistics, and often employs either reallocating (as in a randomization test) or resampling (as in bootstrapping). Reallocating mimics random allocation to treatment groups, while…

Statistics Theory · Mathematics 2017-08-08 Kari Lock Morgan

This paper investigates the use of stratified sampling as a variance reduction technique for approximating integrals over large dimensional spaces. The accuracy of this method critically depends on the choice of the space partition, the…

Probability · Mathematics 2009-09-15 Pierre Etoré , Gersende Fort , Benjamin Jourdain , Eric Moulines

Statistical samples, in order to be representative, have to be drawn from a population in a random and unbiased way. Nevertheless, it is common practice in the field of model-based diagnosis to make estimations from (biased) best-first…

Artificial Intelligence · Computer Science 2022-08-05 Patrick Rodler , Fatima Elichanova

Intuitively, sampling is likely to be more efficient for prevalence estimation, if the cases (or positives) have a relatively higher representation in the sample than in the population. In case the virus is transmitted via personal…

Applications · Statistics 2020-11-18 Li-Chun Zhang

In real-world applications, observations are often constrained to a small fraction of a system. Such spatial subsampling can be caused by the inaccessibility or the sheer size of the system, and cannot be overcome by longer sampling.…

Data Analysis, Statistics and Probability · Physics 2017-06-02 Anna Levina , Viola Priesemann

Almost every software system provides configuration options to tailor the system to the target platform and application scenario. Often, this configurability renders the analysis of every individual system configuration infeasible. To…

Software Engineering · Computer Science 2016-02-17 Flávio Medeiros , Christian Kästner , Márcio Ribeiro , Rohit Gheyi , Sven Apel

The estimated accuracy of a classifier is a random quantity with variability. A common practice in supervised machine learning, is thus to test if the estimated accuracy is significantly better than chance level. This method of signal…

Methodology · Statistics 2020-01-28 Jonathan D. Rosenblatt , Yuval Benjamini , Roee Gilron , Roy Mukamel , Jelle J. Goeman

When a mixture of two kinds of grains differing in size and shape is poured in a vertical two-dimensional cell, the mixture spontaneously stratifies in alternating layers of small and large grains, whenever the large grains are more faceted…

Statistical Mechanics · Physics 2009-10-31 Hernan A. Makse

In this paper we propose strategies for estimating performance of a classifier when labels cannot be obtained for the whole test set. The number of test instances which can be labeled is very small compared to the whole test data size. The…

Machine Learning · Computer Science 2018-02-21 Anurag Kumar , Bhiksha Raj

We study the estimation of treatment effects using samples stratified by treatment status. Standard estimators of the average treatment effect and the local average treatment effect are inconsistent in this setting. We propose consistent…

Econometrics · Economics 2025-04-28 Jinyong Hahn , John Ham , Geert Ridder , Shuyang Sheng

We study the often overlooked phenomenon, first noted in \cite{breiman2001random}, that random forests appear to reduce bias compared to bagging. Motivated by an interesting paper by \cite{mentch2020randomization}, where the authors explain…

Machine Learning · Statistics 2025-07-23 Brian Liu , Rahul Mazumder

A new approach of obtaining stratified random samples from statistically dependent random variables is described. The proposed method can be used to obtain samples from the input space of a computer forward model in estimating expectations…

Methodology · Statistics 2019-11-25 Anirban Mondal , Abhijit Mandal

Population stratification is a problem encountered in several areas of biology and public health. We tackle this problem by mapping a population and its elements attributes into a hypergraph, a natural extension of the concept of graph or…

Populations and Evolution · Quantitative Biology 2009-11-13 Alexei Vazquez

In many randomized trials, outcomes such as essays or open-ended responses must be manually scored as a preliminary step to impact analysis, a process that is costly and limiting. Model-assisted estimation offers a way to combine surrogate…

Methodology · Statistics 2026-02-16 Reagan Mozer , Nicole E. Pashley , Luke Miratrix