English
Related papers

Related papers: How and Why to Use Experimental Data to Evaluate M…

200 papers

Causal inference for testing clinical hypotheses from observational data presents many difficulties because the underlying data-generating model and the associated causal graph are not usually available. Furthermore, observational data may…

Fault diagnosis is critical in many domains, as faults may lead to safety threats or economic losses. In the field of online service systems, operators rely on enormous monitoring data to detect and mitigate failures. Quickly recognizing a…

Software Engineering · Computer Science 2022-06-14 Mingjie Li , Zeyan Li , Kanglin Yin , Xiaohui Nie , Wenchi Zhang , Kaixin Sui , Dan Pei

We consider the challenges associated with causal inference in settings where data from a randomized trial is augmented with control data from an external source to improve efficiency in estimating the average treatment effect (ATE).…

Data from observational studies (OSs) is widely available and readily obtainable yet frequently contains confounding biases. On the other hand, data derived from randomized controlled trials (RCTs) helps to reduce these biases; however, it…

Methodology · Statistics 2024-10-30 Dong Yao , Caizhi Tang , Qing Cui , Longfei Li

We argue that randomized controlled trials (RCTs) are special even among settings where average treatment effects are identified by a nonparametric unconfoundedness assumption. This claim follows from two results of Robins and Ritov (1997):…

Methodology · Statistics 2021-09-28 P. M. Aronow , James M. Robins , Theo Saarinen , Fredrik Sävje , Jasjeet Sekhon

Background. Starting from the 1960s, practitioners and researchers have looked for ways to empirically investigate new technologies such as inspecting the effectiveness of new methods, tools, or practices. With this purpose, the empirical…

Software Engineering · Computer Science 2019-08-14 Nyyti Saarimäki

The use of causal language in observational studies has raised concerns about overstatement in scientific communication. While some argue that such language should be reserved for randomized controlled trials, others contend that rigorous…

Physics and Society · Physics 2025-08-18 Jun Wang , Bei Yu

Simulation methods are among the most ubiquitous methodological tools in statistical science. In particular, statisticians often is simulation to explore properties of statistical functionals in models for which developed statistical theory…

Methodology · Statistics 2023-08-22 Tyrel Stokes , Ian Shrier , Russell Steele

We examine the role of textual data as study units when conducting causal inference by drawing parallels between human subjects and organized texts. %in human population research. We elaborate on key causal concepts and principles, and…

Computation and Language · Computer Science 2022-02-03 Bo Zhang , Jiayao Zhang

Machine learning (ML) models are increasingly used as decision-support tools in high-risk domains. Evaluating the causal impact of deploying such models can be done with a randomized controlled trial (RCT) that randomizes users to ML vs.…

Methodology · Statistics 2025-07-17 Jacob M. Chen , Michael Oberst

Explanatory studies, such as randomized controlled trials, are targeted to extract the true causal effect of interventions on outcomes and are by design adjusted for covariates through randomization. On the contrary, observational studies…

Methodology · Statistics 2022-05-02 Riddhiman Adib , Sheikh Iqbal Ahamed , Mohammad Adibuzzaman

Autonomous robots are required to reason about the behaviour of dynamic agents in their environment. The creation of models to describe these relationships is typically accomplished through the application of causal discovery techniques.…

Artificial Intelligence · Computer Science 2024-03-07 Rhys Howard , Lars Kunze

In the context of having an instrumental variable, the standard practice in causal inference begins by targeting an effect of interest and proceeds by formulating assumptions enabling its identification. We turn this around by adhering to…

Statistics Theory · Mathematics 2026-05-25 Carlos García Meixide , Mark J. van der Laan

This paper reviews existing work in software engineering that applies statistical causal inference methods. These methods aim at estimating causal effects from observational data. The review covers 32 papers published between 2010 and 2022.…

Software Engineering · Computer Science 2023-03-24 Julien Siebert

Observational data is increasingly used as a means for making individual-level causal predictions and intervention recommendations. The foremost challenge of causal inference from observational data is hidden confounding, whose presence…

Machine Learning · Statistics 2018-10-30 Nathan Kallus , Aahlad Manas Puli , Uri Shalit

Estimating how a treatment affects different individuals, known as heterogeneous treatment effect estimation, is an important problem in empirical sciences. In the last few years, there has been a considerable interest in adapting machine…

Machine Learning · Computer Science 2024-10-18 Christopher Tran , Keith Burghardt , Kristina Lerman , Elena Zheleva

Causal inference from observational data is an ambitious but highly relevant task, with diverse applications ranging from natural to social sciences. Within the scope of nonparametric time series, causal inference defined through…

Methodology · Statistics 2016-12-22 Shu Li , Jan Ernest , Peter Bühlmann

Causal inference from observational data is the goal of many data analyses in the health and social sciences. However, academic statistics has often frowned upon data analyses with a causal objective. The introduction of the term "data…

Machine Learning · Statistics 2019-04-11 Miguel A. Hernán , John Hsu , Brian Healy

Research in Cognitive Science suggests that humans understand and represent knowledge of the world through causal relationships. In addition to observations, they can rely on experimenting and counterfactual reasoning -- i.e. referring to…

Artificial Intelligence · Computer Science 2021-05-24 Kanvaly Fadiga , Etienne Houzé , Ada Diaconescu , Jean-Louis Dessalles

Randomized trials typically estimate average relative treatment effects, but decisions on the benefit of a treatment are possibly better informed by more individualized predictions of the absolute treatment effect. In case of a binary…

Methodology · Statistics 2021-08-20 J Hoogland , J IntHout , M Belias , MM Rovers , RD Riley , FE Harrell , KGM Moons , TPA Debray , JB Reitsma