English
Related papers

Related papers: Optimal Sample Splitting for Observational Studies

200 papers

Simulation is a crucial tool for the evaluation and comparison of statistical methods. How to design fair and neutral simulation studies is therefore of great interest for researchers developing new methods and practitioners confronted with…

Classifiers are biased when trained on biased datasets. As a remedy, we propose Learning to Split (ls), an algorithm for automatic bias detection. Given a dataset with input-label pairs, ls learns to split this dataset so that predictors…

Machine Learning · Computer Science 2022-07-22 Yujia Bao , Regina Barzilay

Two-phase outcome dependent sampling (ODS) is widely used in many fields, especially when certain covariates are expensive and/or difficult to measure. For two-phase ODS, the conditional maximum likelihood (CML) method is very attractive…

Methodology · Statistics 2022-12-21 Menglu Che , Peisong Han , Jerald F. Lawless

We consider the optimization of an uncertain objective over continuous and multi-dimensional decision spaces in problems in which we are only provided with observational data. We propose a novel algorithmic framework that is tractable,…

Machine Learning · Statistics 2018-10-30 Dimitris Bertsimas , Christopher McCord

Offline evaluation plays a central role in benchmarking recommender systems when online testing is impractical or risky. However, it is susceptible to two key sources of bias: exposure bias, where users only interact with items they are…

Information Retrieval · Computer Science 2025-08-12 Bruno L. Pereira , Alan Said , Rodrygo L. T. Santos

There has been significant attention given to developing data-driven methods for tailoring patient care based on individual patient characteristics. Dynamic treatment regimes formalize this through a sequence of decision rules that map…

Methodology · Statistics 2022-02-22 Eric J. Rose , Erica E. M. Moodie , Susan Shortreed

Many ecological studies and conservation policies are based on field observations of species, which can be affected by systematic variability introduced by the observation process. A recently introduced causal modeling technique called…

Methodology · Statistics 2021-01-05 Shiv Shankar , Daniel Sheldon , Tao Sun , John Pickering , Thomas G. Dietterich

In this chapter, we discuss recent work on learning sparse approximations to high-dimensional functions on data, where the target functions may be scalar-, vector- or even Hilbert space-valued. Our main objective is to study how the…

Numerical Analysis · Mathematics 2022-02-08 Ben Adcock , Juan M. Cardenas , Nick Dexter , Sebastian Moraga

Classification rules can be severely affected by the presence of disturbing observations in the training sample. Looking for an optimal classifier with such data may lead to unnecessarily complex rules. So, simpler effective classification…

Statistics Theory · Mathematics 2017-01-19 Marina Antolín , Eustasio Del Barrio , Jean-Michel Loubes

Imbalanced data is a frequently encountered problem in machine learning. Despite a vast amount of literature on sampling techniques for imbalanced data, there is a limited number of studies that address the issue of the optimal sampling…

Machine Learning · Computer Science 2022-07-12 Firuz Kamalov , Amir F. Atiya , Dina Elreedy

We investigate the finite sample performance of sample splitting, cross-fitting and averaging for the estimation of the conditional average treatment effect. Recently proposed methods, so-called meta-learners, make use of machine learning…

Methodology · Statistics 2020-08-27 Daniel Jacob

We propose a prognostic stratum matching framework that addresses the deficiencies of Randomized trial data subgroup analysis and transforms ObservAtional Data to be used as if they were randomized, thus paving the road for precision…

Applications · Statistics 2023-11-06 Dimitris Bertsimas , Angelos G. Koulouras , Georgios Antonios Margonis

The manuscript discusses how to incorporate random effects for quantile regression models for clustered data with focus on settings with many but small clusters. The paper has three contributions: (i) documenting that existing methods may…

Methodology · Statistics 2022-02-24 Maria Laura Battagliola , Helle Sørensen , Anders Tolver , Ana-Maria Staicu

We propose a new modeling and estimation approach to select the optimal treatment regime from different options through constructing a robust estimating equation. The method is protected against misspecification of the propensity score…

Methodology · Statistics 2022-11-15 Trinetri Ghosh , Yanyuan Ma , Wensheng Zhu , Yuanjia Wang

To conduct causal inference in observational settings, researchers must rely on certain identifying assumptions. In practice, these assumptions are unlikely to hold exactly. This paper considers the bias of selection-on-observables,…

Methodology · Statistics 2026-03-26 Melody Huang , Cory McCartan

We consider online change detection of high dimensional data streams with sparse changes, where only a subset of data streams can be observed at each sensing time point due to limited sensing capacities. On the one hand, the detection…

Machine Learning · Statistics 2020-09-23 Jie Guo , Hao Yan , Chen Zhang , Steven Hoi

Statistical matching methods are widely used in the social and health sciences to estimate causal effects using observational data. Often the objective is to find comparable groups with similar covariate distributions in a dataset, with the…

Applications · Statistics 2021-01-19 Felix Bestehorn , Maike Bestehorn , Christian Kirches

Estimation frameworks for statistical inference are preferred to hypothesis testing when quantifying uncertainty and precise estimation are more valuable than binary decisions about statistical significance. Study design for…

Methodology · Statistics 2025-10-29 Luke Hagar , Nathaniel T. Stevens

Predictive analytics is increasingly used to guide decision-making in many applications. However, in practice, we often have limited data on the true predictive task of interest, and must instead rely on more abundant data on a…

Machine Learning · Statistics 2020-05-07 Hamsa Bastani

Clinical machine learning applications are often plagued with confounders that are clinically irrelevant, but can still artificially boost the predictive performance of the algorithms. Confounding is especially problematic in mobile health…

Applications · Statistics 2018-11-29 Elias Chaibub Neto