English
Related papers

Related papers: Multi-Source Conformal Inference Under Distributio…

200 papers

Conformal Prediction is a machine learning methodology that produces valid prediction regions under mild conditions. In this paper, we explore the application of making predictions over multiple data sources of different sizes without…

Machine Learning · Statistics 2018-06-15 Ola Spjuth , Lars Carlsson , Niharika Gauraha

Conformal prediction builds marginally valid prediction intervals that cover the unknown outcome of a randomly drawn test point with a prescribed probability. However, in practice, data-driven methods are often used to identify specific…

Methodology · Statistics 2025-04-21 Ying Jin , Zhimei Ren

Federated or multi-site studies have distinct advantages over single-site studies, including increased generalizability, the ability to study underrepresented populations, and the opportunity to study rare exposures and outcomes. However,…

Machine Learning · Statistics 2023-09-25 Larry Han , Zhu Shen , Jose Zubizarreta

Integrating information from multiple data sources can enable more precise, timely, and generalizable decisions. However, it is challenging to make valid causal inferences using observational data from multiple data sources. For example, in…

Methodology · Statistics 2023-02-08 Larry Han , Yige Li , Bijan A. Niknam , Jose R. Zubizarreta

Causal effect estimation from observational data is a challenging problem, especially with high dimensional data and in the presence of unobserved variables. The available data-driven methods for tackling the problem either provide an…

Methodology · Statistics 2022-07-25 Debo Cheng , Jiuyong Li , Lin Liu , Jiji Zhang , Jixue Liu , Thuc Duy Le

In longitudinal studies where units are embedded in space or a social network, interference may arise, meaning that a unit's outcome can depend on treatment histories of others. The presence of interference poses significant challenges for…

Methodology · Statistics 2025-08-26 Ye Wang , Michael Jetsupphasuk

Machine learning algorithms have grown in sophistication over the years and are increasingly deployed for real-life applications. However, when using machine learning techniques in practical settings, particularly in high-risk applications…

Machine Learning · Computer Science 2023-10-06 Sukrita Singh , Neeraj Sarna , Yuanyuan Li , Yang Li , Agni Orfanoudaki , Michael Berger

Causal inference from observational data plays critical role in many applications in trustworthy machine learning. While sound and complete algorithms exist to compute causal effects, many of them assume access to conditional likelihoods,…

Machine Learning · Computer Science 2024-11-04 Md Musfiqur Rahman , Matt Jordan , Murat Kocaoglu

We study high-confidence off-policy evaluation in the context of infinite-horizon Markov decision processes, where the objective is to establish a confidence interval (CI) for the target policy value using only offline data pre-collected…

Machine Learning · Statistics 2023-10-03 Wenzhuo Zhou , Yuhan Li , Ruoqing Zhu , Annie Qu

Regression problems with bounded continuous outcomes frequently arise in real-world statistical and machine learning applications, such as the analysis of rates and proportions. A central challenge in this setting is predicting a response…

Machine Learning · Statistics 2025-07-21 Zhanli Wu , Fabrizio Leisen , F. Javier Rubio

Estimating treatment effects from observational data is of central interest across numerous application domains. Individual treatment effect offers the most granular measure of treatment effect on an individual level, and is the most useful…

Machine Learning · Statistics 2024-08-06 Hengrui Cai , Huaqing Jin , Lexin Li

We address the problem of integrating data from multiple, possibly biased, observational and interventional studies, to eventually compute counterfactuals in structural causal models. We start from the case of a single observational dataset…

Artificial Intelligence · Computer Science 2023-03-17 Marco Zaffalon , Alessandro Antonucci , David Huber , Rafael Cabañas

Many observational studies feature irregular longitudinal data, where the observation times are not common across individuals in the study. Further, the observation times may be related to the longitudinal outcome. In this setting, failing…

Methodology · Statistics 2024-05-27 Grace Tompkins , Joel A Dubin , Michael Wallace

The abundance of modern health data provides many opportunities for the use of machine learning techniques to build better statistical models to improve clinical decision making. Predicting time-to-event distributions, also known as…

Machine Learning · Statistics 2020-12-15 Zidi Xiu , Chenyang Tao , Benjamin A. Goldstein , Ricardo Henao

In data analysis problems where we are not able to rely on distributional assumptions, what types of inference guarantees can still be obtained? Many popular methods, such as holdout methods, cross-validation methods, and conformal…

Statistics Theory · Mathematics 2022-05-31 Yonghoon Lee , Rina Foygel Barber

In various statistical settings, the goal is to estimate a function which is restricted by the statistical model only through a conditional moment restriction. Prominent examples include the nonparametric instrumental variable framework for…

Methodology · Statistics 2025-05-28 AmirEmad Ghassami , James M. Robins , Andrea Rotnitzky

Unobserved confounding is one of the main challenges when estimating causal effects. We propose a causal reduction method that, given a causal model, replaces an arbitrary number of possibly high-dimensional latent confounders with a single…

Machine Learning · Statistics 2023-02-24 Maximilian Ilse , Patrick Forré , Max Welling , Joris M. Mooij

Most of statistics and AI draw insights through modelling discord or variance between sources of information (i.e., inter-source uncertainty). Increasingly, however, research is focusing upon uncertainty arising at the level of individual…

Machine Learning · Computer Science 2023-03-01 Shaily Kabir , Christian Wagner , Zack Ellerby

While much of the causal inference literature has focused on addressing internal validity biases, both internal and external validity are necessary for unbiased estimates in a target population of interest. However, few generalizability…

Methodology · Statistics 2023-04-07 Irina Degtiar , Tim Layton , Jacob Wallace , Sherri Rose

Estimating an individual treatment effect (ITE) is essential to personalized decision making. However, existing methods for estimating the ITE often rely on unconfoundedness, an assumption that is fundamentally untestable with observed…

Methodology · Statistics 2022-07-13 Mingzhang Yin , Claudia Shi , Yixin Wang , David M. Blei