English
Related papers

Related papers: Sensitivity analysis for studies transporting pred…

200 papers

Spurious association arises from covariance between propensity for the treatment and individual risk for the outcome. For sensitivity analysis with stochastic counterfactuals we introduce a methodology to characterize uncertainty in causal…

Methodology · Statistics 2021-03-11 Brian Knaeble , Braxton Osting , Placede Tshiaba

Performance estimation aims at estimating the loss that a predictive model will incur on unseen data. These procedures are part of the pipeline in every machine learning project and are used for assessing the overall generalisation ability…

Machine Learning · Computer Science 2021-08-31 Vitor Cerqueira , Luis Torgo , Igor Mozetic

We consider situations where data have been collected such that the sampling depends on the outcome of interest and possibly further covariates, as for instance in case-control studies. Graphical models represent assumptions about the…

Methodology · Statistics 2011-01-06 Vanessa Didelez , Svend Kreiner , Niels Keiding

This study introduces a data-driven, machine learning-based method to detect suitable control variables and instruments for assessing the causal effect of a treatment on an outcome in observational data. Our approach tests the joint…

Econometrics · Economics 2026-05-20 Nicolas Apfel , Julia Hatamyar , Martin Huber , Jannis Kueck

The quality of training data is critical to the performance of machine learning models. In this paper, the Error Sensitivity Profile (ESP) is proposed. It quantifies the sensitivity of model performance to errors in a single feature or in…

Machine Learning · Computer Science 2026-04-29 Andrea Maurino

Difference-in-differences (DiD) is one of the most popular approaches for empirical research in economics, political science, and beyond. Identification in these models is based on the conditional parallel trends assumption: In the absence…

Econometrics · Economics 2025-10-13 Philipp Bach , Sven Klaassen , Jannis Kueck , Mara Mattes , Martin Spindler

Estimation of the intensity of a point process is considered within a nonparametric framework. The intensity measure is unknown and depends on covariates, possibly many more than the observed number of jumps. Only a single trajectory of the…

Statistics Theory · Mathematics 2017-02-20 Alessio Sancetta

When assessing causal effects, determining the target population to which the results are intended to generalize is a critical decision. Randomized and observational studies each have strengths and limitations for estimating causal effects…

Methodology · Statistics 2022-10-21 Irina Degtiar , Sherri Rose

For observational studies, we study the sensitivity of causal inference when treatment assignments may depend on unobserved confounders. We develop a loss minimization approach for estimating bounds on the conditional average treatment…

Methodology · Statistics 2022-03-11 Steve Yadlowsky , Hongseok Namkoong , Sanjay Basu , John Duchi , Lu Tian

In observational studies, the observed association between an exposure and outcome of interest may be distorted by unobserved confounding. Causal sensitivity analysis can be used to assess the robustness of observed associations to…

Methodology · Statistics 2025-11-04 Rui Hu , Ted Westling

When teaching and discussing statistical assumptions, our focus is oftentimes placed on how to test and address potential violations rather than the effects of violating assumptions on the estimates produced by our statistical models. The…

Methodology · Statistics 2022-06-14 Ian A Silver

There exist many methods for sensitivity analysis readily available to the practitioner. While each seeks to help the modeler answer the same general question -- How do sources of uncertainty or changes in the model inputs relate to…

Methodology · Statistics 2025-06-16 Devin Francom , Abigael Nachtsheim

Over the last decades, many prognostic models based on artificial intelligence techniques have been used to provide detailed predictions in healthcare. Unfortunately, the real-world observational data used to train and validate these models…

Machine Learning · Computer Science 2023-11-21 Alice Bernasconi , Alessio Zanga , Peter J. F. Lucas , Marco Scutari , Fabio Stella

When estimating causal effects, it is important to assess external validity, i.e., determine how useful a given study is to inform a practical question for a specific target population. One challenge is that the covariate distribution in…

Methodology · Statistics 2025-01-03 Zhenghao Zeng , Edward H. Kennedy , Lisa M. Bodnar , Ashley I. Naimi

We develop a general theory of omitted variable bias for a wide range of common causal parameters, including (but not limited to) averages of potential outcomes, average treatment effects, average causal derivatives, and policy effects from…

Econometrics · Economics 2024-05-28 Victor Chernozhukov , Carlos Cinelli , Whitney Newey , Amit Sharma , Vasilis Syrgkanis

A probabilistic expert system emulates the decision-making ability of a human expert through a directional graphical model. The first step in building such systems is to understand data generation mechanism. To this end, one may try to…

Methodology · Statistics 2021-09-29 Vahid Partovi Nia , Xinlin Li , Masoud Asgharian , Shoubo Hu , Zhitang Chen , Yanhui Geng

Clinical prediction models are estimated using a sample of limited size from the target population, leading to uncertainty in predictions, even when the model is correctly specified. Generally, not all patient profiles are observed…

Methodology · Statistics 2024-02-09 Doranne Thomassen , Saskia le Cessie , Hans van Houwelingen , Ewout Steyerberg

Consider a semi-supervised setting with a labeled dataset of binary responses and predictors and an unlabeled dataset with only the predictors. Logistic regression is equivalent to an exponential tilt model in the labeled population. For…

Machine Learning · Statistics 2023-11-16 Ye Tian , Xinwei Zhang , Zhiqiang Tan

This paper studies the identification, estimation, and hypothesis testing problem in complete and incomplete economic models with testable assumptions. Testable assumptions ($A$) give strong and interpretable empirical content to the models…

Econometrics · Economics 2022-03-11 Moyu Liao

In order to trust the predictions of a machine learning algorithm, it is necessary to understand the factors that contribute to those predictions. In the case of probabilistic and uncertainty-aware models, it is necessary to understand not…

Machine Learning · Statistics 2024-08-19 Danny Wood , Theodore Papamarkou , Matt Benatan , Richard Allmendinger