English
Related papers

Related papers: Improving uplift model evaluation on RCT data

200 papers

The weighted average treatment effect (WATE) is a causal measure for the comparison of interventions in a specific target population, which may be different from the population where data are sampled from. For instance, when the goal is to…

Methodology · Statistics 2018-04-17 Yebin Tao , Haoda Fu

The ability to predict individualized treatment effects (ITEs) based on a given patient's profile is essential for personalized medicine. We propose a hypothesis testing approach to choosing between two potential treatments for a given…

Methodology · Statistics 2020-08-11 Tianxi Cai , Tony Cai , Zijian Guo

This paper considers an empirical risk minimization problem under heavy-tailed settings, where data does not have finite variance, but only has $p$-th moment with $p \in (1,2)$. Instead of using estimation procedure based on truncated…

Machine Learning · Statistics 2023-09-08 Guanhua Fang , Ping Li , Gennady Samorodnitsky

The clinical explainability of convolutional neural networks (CNN) heavily relies on the joint interpretation of a model's predicted diagnostic label and associated confidence. A highly certain or uncertain model can significantly impact…

Image and Video Processing · Electrical Eng. & Systems 2023-08-24 Adrit Rao , Joon-Young Lee , Oliver Aalami

Vision transformers (ViTs) have demonstrated remarkable performance in a variety of vision tasks. Despite their promising capabilities, training a ViT requires a large amount of diverse data. Several studies empirically found that using…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Bum Jun Kim , Sang Woo Kim

Randomized controlled trials (RCTs) can be used to generate guarantees on treatment effects. However, RCTs often spend unnecessary resources exploring sub-optimal treatments, which can reduce the power of treatment guarantees. To address…

Computers and Society · Computer Science 2024-10-16 Santiago Cortes-Gomez , Naveen Raman , Aarti Singh , Bryan Wilder

For randomized controlled trials to be conclusive, it is important to set the target sample size accurately at the design stage. Comparing two normal populations, the sample size calculation requires specification of the variance other than…

Methodology · Statistics 2026-02-04 Hirotada Maeda , Satoshi Hattori , Tim Friede

Current practices in metric evaluation focus on one single dataset, e.g., Newstest dataset in each year's WMT Metrics Shared Task. However, in this paper, we qualitatively and quantitatively show that the performances of metrics are…

Computation and Language · Computer Science 2022-04-21 Jiannan Xiang , Huayang Li , Yahui Liu , Lemao Liu , Guoping Huang , Defu Lian , Shuming Shi

Recent research in causal inference under network interference has explored various experimental designs and estimation techniques to address this issue. However, existing methods, which typically rely on single experiments, often reach a…

Methodology · Statistics 2025-03-10 Qianyi Chen , Bo Li

RCTs sometimes test interventions that aim to improve existing services targeted to a subset of individuals identified after randomization. Accordingly, the treatment could affect the composition of service recipients and the offered…

Methodology · Statistics 2022-05-18 Peter Z. Schochet

Methods that address data shifts usually assume full access to multiple datasets. In the healthcare domain, however, privacy-preserving regulations as well as commercial interests limit data availability and, as a result, researchers can…

Machine Learning · Statistics 2022-05-03 Tal El-Hay , Chen Yanover

Subgroup analyses of randomized controlled trials (RCTs) constitute an important component of the drug development process in precision medicine. In particular, subgroup analyses of early-stage trials often influence the design and…

Methodology · Statistics 2025-02-12 Daniel Schwartz , Riddhiman Saha , Steffen Ventz , Lorenzo Trippa

The integration of deep learning based systems in clinical practice is often impeded by challenges rooted in limited and heterogeneous medical datasets. In addition, the field has increasingly prioritized marginal performance gains on a…

Image and Video Processing · Electrical Eng. & Systems 2025-03-18 Sebastian Doerrich , Francesco Di Salvo , Julius Brockmann , Christian Ledig

Manipulating data, such as weighting data examples or augmenting with new instances, has been increasingly used to improve model training. Previous work has studied various rule- or learning-based approaches designed for specific types of…

Machine Learning · Computer Science 2019-10-29 Zhiting Hu , Bowen Tan , Ruslan Salakhutdinov , Tom Mitchell , Eric P. Xing

Multistate process data are common in studies of chronic diseases such as cancer. These data are ideal for precision medicine purposes as they can be leveraged to improve more refined health outcomes, compared to standard survival outcomes,…

Methodology · Statistics 2022-11-28 Giorgos Bakoyannis

Adaptive designs are commonly used in clinical and drug development studies for optimum utilization of available resources. In this article, we consider the problem of estimating the effect of the selected (better) treatment using a…

Statistics Theory · Mathematics 2023-01-24 Masihuddin , Neeraj Misra

Randomized experiments can provide unbiased estimates of sample average treatment effects. However, estimates of population treatment effects can be biased when the experimental sample and the target population differ. In this case, the…

Methodology · Statistics 2022-11-10 Wenqi Shi , Xi Lin

Practitioners in diverse fields such as healthcare, economics and education are eager to apply machine learning to improve decision making. The cost and impracticality of performing experiments and a recent monumental increase in electronic…

Machine Learning · Computer Science 2023-08-01 Fredrik D. Johansson , Uri Shalit , Nathan Kallus , David Sontag

Obtaining valid treatment effect inference remains a challenging problem when dealing with numerous instruments and non-sparse control variables. In this paper, we propose a novel ridge regularization-based instrumental variables method for…

Econometrics · Economics 2025-10-17 Xiduo Chen , Xingdong Feng , Antonio F. Galvao , Yeheng Ge

Randomized controlled trials (RCTs) are the gold standard for evaluating the causal effect of a treatment; however, they often have limited sample sizes and sometimes poor generalizability. On the other hand, non-randomized, observational…

Methodology · Statistics 2021-09-23 Shuxiao Chen , Bo Zhang , Ting Ye