English
Related papers

Related papers: Overlap violations in external validity

200 papers

Covariate balance is crucial for unconfounded descriptive or causal comparisons. However, lack of balance is common in observational studies. This article considers weighting strategies for balancing covariates. We define a general class of…

Methodology · Statistics 2016-11-17 Fan Li , Kari Lock Morgan , Alan M. Zaslavsky

External validity is often questionable in empirical research, especially in randomized experiments due to the trade-off between internal validity and external validity. To quantify the robustness of external validity, one must first…

Methodology · Statistics 2022-06-20 Tenglong Li

The intuitive motivation for employing a sibling comparison design is to adjust for confounding that is constant within families. Such confounding can be caused by variables that otherwise might prove difficult to measure, for example…

We investigate the task of estimating the conditional average causal effect of treatment-dosage pairs from a combination of observational data and assumptions on the causal relationships in the underlying system. This has been a…

Machine Learning · Computer Science 2022-05-31 Alexis Bellot , Anish Dhir , Giulia Prando

In empirical studies with time-to-event outcomes, investigators often leverage observational data to conduct causal inference on the effect of exposure when randomized controlled trial data is unavailable. Model misspecification and lack of…

Methodology · Statistics 2023-05-05 Shenbo Xu , Bang Zheng , Bowen Su , Stan Finkelstein , Roy Welsch , Kenney Ng , Ioanna Tzoulaki , Zach Shahn

There has been a recent surge in statistical methods for handling the lack of adequate positivity when using inverse probability weights (IPW). However, these nascent developments have raised a number of questions. Thus, we demonstrate the…

Methodology · Statistics 2024-02-05 Roland A. Matsouaka , Yi Liu , Yunji Zhou

Practitioners in diverse fields such as healthcare, economics and education are eager to apply machine learning to improve decision making. The cost and impracticality of performing experiments and a recent monumental increase in electronic…

Machine Learning · Computer Science 2023-08-01 Fredrik D. Johansson , Uri Shalit , Nathan Kallus , David Sontag

It has been shown that NLI models are usually biased with respect to the word-overlap between premise and hypothesis; they take this feature as a primary cue for predicting the entailment label. In this paper, we focus on an overlooked…

Computation and Language · Computer Science 2022-11-09 Sara Rajaee , Yadollah Yaghoobzadeh , Mohammad Taher Pilehvar

Complex systems research is becomingly increasingly data-driven, particularly in the social and biological domains. Many of the systems from which sample data are collected feature structural heterogeneity at the mesoscopic scale (i.e.…

Physics and Society · Physics 2009-11-13 Jukka-Pekka Onnela , Neil F. Johnson , Sean Gourley , Gesine Reinert , Michael Spagat

Externally controlled trials are crucial in clinical development when randomized controlled trials are unethical or impractical. These trials consist of a full treatment arm with the experimental treatment and a full external control arm.…

Methodology · Statistics 2025-03-11 Chenyin Gao , Xiang Zhang , Shu Yang

In most nonrandomized observational studies, differences between treatment groups may arise not only due to the treatment but also because of the effect of confounders. Therefore, causal inference regarding the treatment effect is not as…

Methodology · Statistics 2018-07-04 Debashis Ghosh

The case-crossover design (Maclure, 1991) is widely used in epidemiology and other fields to study causal effects of transient treatments on acute outcomes. However, its validity and causal interpretation have only been justified under…

Methodology · Statistics 2021-11-22 Zach Shahn , Miguel A. Hernan , James M. Robins

Understanding and characterizing treatment effect variation in randomized experiments has become essential for going beyond the "black box" of the average treatment effect. Nonetheless, traditional statistical approaches often ignore or…

Statistics Theory · Mathematics 2017-07-31 Peng Ding , Avi Feller , Luke Miratrix

Causal inference with observational studies often relies on the assumptions of unconfoundedness and overlap of covariate distributions in different treatment groups. The overlap assumption is violated when some units have propensity scores…

Methodology · Statistics 2022-07-19 Shu Yang , Peng Ding

The generalizability of empirical findings to new environments, settings or populations, often called "external validity," is essential in most scientific explorations. This paper treats a particular problem of generalizability, called…

Methodology · Statistics 2015-03-06 Judea Pearl , Elias Bareinboim

Causal inference in modern largescale systems faces growing challenges, including highdimensional covariates, multi-valued treatments, massive observational (OBS) data, and limited randomized controlled trial (RCT) samples due to cost…

Methodology · Statistics 2026-02-27 Yuxi Du , Zhiheng Zhang , Haoxuan Li , Cong Fang , Jixing Xu , Peng Zhen , Jiecheng Guo

Diagnostic datasets that can detect biased models are an important prerequisite for bias reduction within natural language processing. However, undesired patterns in the collected data can make such tests incorrect. For example, if the…

Computation and Language · Computer Science 2020-12-16 Vid Kocijan , Oana-Maria Camburu , Thomas Lukasiewicz

A fundamental challenge in causal inference with observational data is correct specification of a causal model. When there is model uncertainty, analysts may seek to use estimates from multiple candidate models that rely on distinct, and…

Methodology · Statistics 2026-03-03 Rohit Bhattacharya , Ina Ocelli , Ted Westling

Exposure measurement error is a ubiquitous but often overlooked challenge in causal inference with observational data. Existing methods accounting for exposure measurement error largely rely on restrictive parametric assumptions, while…

Meta-analysis of genome-wide association studies is increasingly popular and many meta-analytic methods have been recently proposed. A majority of meta-analytic methods combine information from multiple studies by assuming that studies are…

Quantitative Methods · Quantitative Biology 2014-01-20 Buhm Han , Jae Hoon Sul , Eleazar Eskin , Paul I. W. de Bakker , Soumya Raychaudhuri