English
Related papers

Related papers: Analyzing Error Sources in Global Feature Effect E…

200 papers

Causal inference starts with a simple idea: compare groups that differ by treatment, not much else. Traditionally, similar groups are constructed using only observed covariates; however, it remains a long-standing challenge to incorporate…

Methodology · Statistics 2025-11-21 Ying Jin , José Zubizarreta

Cross-validation is a common method for estimating the predictive performance of machine learning models. In a data-scarce regime, where one typically wishes to maximize the number of instances used for training the model, an approach…

Methodology · Statistics 2025-03-25 George I. Austin , Itsik Pe'er , Tal Korem

Data-trained predictive models see widespread use, but for the most part they are used as black boxes which output a prediction or score. It is therefore hard to acquire a deeper understanding of model behavior, and in particular how…

A shortcoming of black-box supervised learning models is their lack of interpretability or transparency. To facilitate interpretation, post-hoc global variable importance measures (VIMs) are widely used to assign to each predictor or input…

Methodology · Statistics 2025-12-25 Jingyu Zhu , Daniel W. Apley

Empirical work often uses treatment assigned following geographic boundaries. When the effects of treatment cross over borders, classical difference-in-differences estimation produces biased estimates for the average treatment effect. In…

Econometrics · Economics 2023-06-13 Kyle Butts

I study identification, estimation and inference for spillover effects in experiments where units' outcomes may depend on the treatment assignments of other units within a group. I show that the commonly-used reduced-form linear-in-means…

Econometrics · Economics 2022-01-21 Gonzalo Vazquez-Bare

Estimation of causal effects using machine learning methods has become an active research field in econometrics. In this paper, we study the finite sample performance of meta-learners for estimation of heterogeneous treatment effects under…

Econometrics · Economics 2022-02-01 Gabriel Okasa

Algorithmic fairness has emphasized the role of biased data in automated decision outcomes. Recently, there has been a shift in attention to sources of bias that implicate fairness in other stages in the ML pipeline. We contend that one…

Machine Learning · Computer Science 2021-09-09 Jessica Zosa Forde , A. Feder Cooper , Kweku Kwegyir-Aggrey , Chris De Sa , Michael Littman

Reliable treatment effect estimation from observational data depends on the availability of all confounding information. While much work has targeted treatment effect estimation from observational data, there is relatively little work in…

Machine Learning · Statistics 2020-11-18 Shirly Wang , Seung Eun Yi , Shalmali Joshi , Marzyeh Ghassemi

Data in the real world often has an evolving distribution. Thus, machine learning models trained on such data get outdated over time. This phenomenon is called model drift. Knowledge of this drift serves two purposes: (i) Retain an accurate…

Machine Learning · Computer Science 2025-03-11 Pranoy Panda , Kancheti Sai Srinivas , Vineeth N Balasubramanian , Gaurav Sinha

Estimating how a treatment affects units individually, known as heterogeneous treatment effect (HTE) estimation, is an essential part of decision-making and policy implementation. The accumulation of large amounts of data in many domains,…

Machine Learning · Computer Science 2022-06-28 Christopher Tran , Elena Zheleva

Measurement error is a pervasive challenge across many disciplines, yet its impact on sample size determination and the accuracy and precision of estimators regarding the association between an exposure and an outcome remains understudied…

Methodology · Statistics 2025-05-27 Honghyok Kim

The cause-to-effect analysis can help us decompose all the likely causes of a problem, such as an undesirable business situation or unintended harm to the individual(s). This implies that we can identify how the problems are inherited, rank…

Machine Learning · Computer Science 2023-10-20 Moses Openja , Gabriel Laberge , Foutse Khomh

Data science projects often involve various machine learning (ML) methods that depend on data, code, and models. One of the key activities in these projects is the selection of a model or algorithm that is appropriate for the data analysis…

Machine Learning · Computer Science 2023-11-27 Cristina Tavares , Nathalia Nascimento , Paulo Alencar , Donald Cowan

The present work provides an application of Global Sensitivity Analysis to supervised machine learning methods such as Random Forests. These methods act as black boxes, selecting features in high--dimensional data sets as to provide…

Machine Learning · Statistics 2024-07-22 Giulia Vannucci , Roberta Siciliano , Andrea Saltelli

Generalization to out-of-distribution (OOD) data is a critical challenge in machine learning. Ensemble-based methods, like weight space ensembles that interpolate model parameters, have been shown to achieve superior OOD performance.…

Machine Learning · Computer Science 2024-07-16 Yong Lin , Lu Tan , Yifan Hao , Honam Wong , Hanze Dong , Weizhong Zhang , Yujiu Yang , Tong Zhang

We investigate the finite sample performance of sample splitting, cross-fitting and averaging for the estimation of the conditional average treatment effect. Recently proposed methods, so-called meta-learners, make use of machine learning…

Methodology · Statistics 2020-08-27 Daniel Jacob

For many applications, an ensemble of base classifiers is an effective solution. The tuning of its parameters(number of classes, amount of data on which each classifier is to be trained on, etc.) requires G, the generalization error of a…

Estimating average causal effect (ACE) is useful whenever we want to know the effect of an intervention on a given outcome. In the absence of a randomized experiment, many methods such as stratification and inverse propensity weighting have…

Machine Learning · Computer Science 2019-07-11 Rathin Desai , Amit Sharma

Machine learning models have achieved widespread success but often inherit and amplify historical biases, resulting in unfair outcomes. Traditional fairness methods typically impose constraints at the prediction level, without addressing…

Machine Learning · Statistics 2026-02-10 Enze Shi , Pankaj Bhagwat , Zhixian Yang , Linglong Kong , Bei Jiang