English
Related papers

Related papers: Policy Learning with Observational Data

200 papers

Recent work on policy learning from observational data has highlighted the importance of efficient policy evaluation and has proposed reductions to weighted (cost-sensitive) classification. But, efficient policy evaluation need not yield…

Machine Learning · Computer Science 2020-02-13 Andrew Bennett , Nathan Kallus

A further understanding of cause and effect within observational data is critical across many domains, such as economics, health care, public policy, web mining, online advertising, and marketing campaigns. Although significant advances…

Machine Learning · Computer Science 2023-04-11 Zhixuan Chu , Sheng Li

Building models of human decision-making from observed behaviour is critical to better understand, diagnose and support real-world policies such as clinical care. As established policy learning approaches remain focused on imitation…

Machine Learning · Computer Science 2022-10-03 Alizée Pace , Alex J. Chan , Mihaela van der Schaar

We develop a novel method for personalized off-policy learning in scenarios with unobserved confounding. Thereby, we address a key limitation of standard policy learning: standard policy learning assumes unconfoundedness, meaning that no…

Machine Learning · Computer Science 2026-02-18 Konstantin Hess , Dennis Frauen , Valentyn Melnychuk , Stefan Feuerriegel

In several medical decision-making problems, such as antibiotic prescription, laboratory testing can provide precise indications for how a patient will respond to different treatment options. This enables us to "fully observe" all potential…

Machine Learning · Computer Science 2020-08-14 Soorajnath Boominathan , Michael Oberst , Helen Zhou , Sanjat Kanjilal , David Sontag

Many scientific questions in biomedical, environmental, and psychological research involve understanding the effects of multiple factors on outcomes. While factorial experiments are ideal for this purpose, randomized controlled treatment…

Methodology · Statistics 2025-12-03 Ruoqi Yu , Peng Ding

Evaluating the causal impacts of possible interventions is crucial for informing decision-making, especially towards improving access to opportunity. However, if causal effects are heterogeneous and predictable from covariates, personalized…

Machine Learning · Computer Science 2024-04-30 Ezinne Nwankwo , Michael I. Jordan , Angela Zhou

Searching the space of policies directly for the optimal policy has been one popular method for solving partially observable reinforcement learning problems. Typically, with each change of the target policy, its value is estimated from the…

Artificial Intelligence · Computer Science 2007-05-23 Leonid Peshkin , Christian R. Shelton

Many applications of causal inference require using treatment effects estimated on a study population to make decisions in a separate target population. We consider the challenging setting where there are covariates that are observed in the…

Machine Learning · Computer Science 2024-10-22 Khurram Yamin , Vibhhu Sharma , Ed Kennedy , Bryan Wilder

Finding an effective medical treatment often requires a search by trial and error. Making this search more efficient by minimizing the number of unnecessary trials could lower both costs and patient suffering. We formalize this problem as…

Machine Learning · Computer Science 2021-02-18 Samuel Håkansson , Viktor Lindblom , Omer Gottesman , Fredrik D. Johansson

Choosing optimal (or at least better) policies is an important problem in domains from medicine to education to finance and many others. One approach to this problem is through controlled experiments/trials - but controlled experiments are…

Artificial Intelligence · Computer Science 2018-02-26 Onur Atan , William R. Zame , M van der Schaar

Data from both a randomized trial and an observational study are sometimes simultaneously available for evaluating the effect of an intervention. The randomized data typically allows for reliable estimation of average treatment effects but…

Methodology · Statistics 2021-12-01 David Cheng , Tianxi Cai

The propensity score is a common tool for estimating the causal effect of a binary treatment in observational data. In this setting, matching, subclassification, imputation, or inverse probability weighting on the propensity score can…

Methodology · Statistics 2018-01-03 Michael J Lopez , Roee Gutman

Empirical researchers and decision-makers spanning various domains frequently seek profound insights into the long-term impacts of interventions. While the significance of long-term outcomes is undeniable, an overemphasis on them may…

Machine Learning · Computer Science 2024-09-17 Peng Wu , Ziyu Shen , Feng Xie , Zhongyao Wang , Chunchen Liu , Yan Zeng

Policy learning using historical observational data is an important problem that has found widespread applications. Examples include selecting offers, prices, advertisements to send to customers, as well as selecting which medication to…

Machine Learning · Computer Science 2023-09-13 Nian Si , Fan Zhang , Zhengyuan Zhou , Jose Blanchet

The beneficial effects of treatments vary across individuals in most studies. Treatment heterogeneity motivates practitioners to search for the optimal policy based on personal characteristics. A long-standing common practice in policy…

Statistics Theory · Mathematics 2025-01-06 Xuqiao Li , Ying Yan

This paper considers conducting inference about the effect of a treatment (or exposure) on an outcome of interest. In the ideal setting where treatment is assigned randomly, under certain assumptions the treatment effect is identifiable…

Methodology · Statistics 2015-03-06 Amy Richardson , Michael G. Hudgens , Peter B. Gilbert , Jason P. Fine

Undertaking causal inference with observational data is incredibly useful across a wide range of tasks including the development of medical treatments, advertisements and marketing, and policy making. There are two significant challenges…

Machine Learning · Statistics 2022-01-19 Matthew James Vowels , Necati Cihan Camgoz , Richard Bowden

Conventional treatment policies map patient covariates to a single recommended intervention in order to maximize expected clinical outcomes. Although a rich body of causal inference methods has been developed to estimate such policies,…

Machine Learning · Computer Science 2026-05-20 Laura Fuentes-Vicente , Mathieu Even , Gaëlle Dormion , Antoine Chambaz , Uri Shalit , Julie Josse

We develop new semiparametric methods for estimating treatment effects. We focus on settings where the outcome distributions may be thick tailed, where treatment effects may be small, where sample sizes are large and where assignment is…

Methodology · Statistics 2023-08-24 Susan Athey , Peter J. Bickel , Aiyou Chen , Guido W. Imbens , Michael Pollmann