English
Related papers

Related papers: Learning Treatment Allocations with Risk Control U…

200 papers

Although learning-based methods have great potential for robotics, one concern is that a robot that updates its parameters might cause large amounts of damage before it learns the optimal policy. We formalize the idea of safe learning in a…

Robotics · Computer Science 2017-05-17 David Held , Zoe McCarthy , Michael Zhang , Fred Shentu , Pieter Abbeel

Personalized decision-making, aiming to derive optimal treatment regimes based on individual characteristics, has recently attracted increasing attention in many fields, such as medicine, social services, and economics. Current literature…

Methodology · Statistics 2023-02-28 Jianing Chu , Wenbin Lu , Shu Yang

Individualized treatment rules (ITRs) are considered a promising recipe to deliver better policy interventions. One key ingredient in optimal ITR estimation problems is to estimate the average treatment effect conditional on a subject's…

Methodology · Statistics 2021-03-16 Hongming Pu , Bo Zhang

Learning-based control has attracted significant attention in recent years, especially for plants that are difficult to model based on first-principles. A key issue in learning-based control is how to make efficient use of data as the…

Systems and Control · Electrical Eng. & Systems 2025-08-05 Kaikai Zheng , Dawei Shi , Sandra Hirche , Yang Shi

Deploying the idea of long-term cumulative return, reinforcement learning has shown remarkable performance in various fields. We propose a formulation of the landmark localization in 3D medical images as a reinforcement learning problem.…

Computer Vision and Pattern Recognition · Computer Science 2019-01-03 Walid Abdullah Al , Il Dong Yun

A dynamic treatment regime effectively incorporates both accrued information and long-term effects of treatment from specially designed clinical trials. As these become more and more popular in conjunction with longitudinal data from…

Methodology · Statistics 2011-08-29 Rui Song , Weiwei Wang , Donglin Zeng , Michael R. Kosorok

I study the problem of a decision maker choosing a policy which allocates treatment to a heterogeneous population on the basis of experimental data that includes only a subset of possible treatment values. The effects of new treatments are…

Econometrics · Economics 2025-07-17 Samuel Higbee

In recent years, real-world external controls have grown in popularity as a tool to empower randomized placebo-controlled trials, particularly in rare diseases or cases where balanced randomization is unethical or impractical. However, as…

Methodology · Statistics 2024-11-14 Chenyin Gao , Shu Yang , Mingyang Shan , Wenyu Ye , Ilya Lipkovich , Douglas Faries

Public service programs often allocate limited resources under uncertainty about their benefits, creating a need for randomization to support credible evaluation. In practice, however, applicants commonly enter waitlists where resources are…

Machine Learning · Computer Science 2026-05-26 JungHo Lee , Johnna Sundberg , Pim Welle , Bryan Wilder

We propose to meta-learn an a self-supervised patient trajectory forecast learning rule by meta-training on a meta-objective that directly optimizes the utility of the patient representation over the subsequent clinical outcome prediction.…

Machine Learning · Computer Science 2024-07-30 Yuan Xue , Nan Du , Anne Mottram , Martin Seneviratne , Andrew M. Dai

We study a class of binary treatment choice problems with partial identification through the lens of robust (multiple prior) Bayesian analysis. We use a convenient set of prior distributions to derive ex-ante and ex-post robust Bayes…

Partial label learning (PLL) is a typical weakly supervised learning problem, where each training example is associated with a set of candidate labels among which only one is true. Most existing PLL approaches assume that the incorrect…

Machine Learning · Computer Science 2021-10-27 Ning Xu , Congyu Qiao , Xin Geng , Min-Ling Zhang

An individualized treatment rule (ITR) tailors treatments to a patient's specific characteristics. However, randomized controlled trials (RCTs) are often underpowered to detect the treatment effect heterogeneity needed for reliable ITR…

Methodology · Statistics 2026-04-14 Yuan Bian , Donglin Zeng , Hyun-Joon Yang , Leanne M. Williams , Yuanjia Wang

We introduce a simple but effective method for managing risk in model-based reinforcement learning with trajectory sampling that involves probabilistic safety constraints and balancing of optimism in the face of epistemic uncertainty and…

Machine Learning · Computer Science 2023-09-12 Marin Vlastelica , Sebastian Blaes , Cristina Pineri , Georg Martius

As a natural extension to the standard conformal prediction method, several conformal risk control methods have been recently developed and applied to various learning problems. In this work, we seek to control the conformal risk in…

Machine Learning · Computer Science 2024-05-02 Yunpeng Xu , Wenge Guo , Zhi Wei

We study the problem of a decision maker who must provide the best possible treatment recommendation based on an experiment. The desirability of the outcome distribution resulting from the policy recommendation is measured through a…

Econometrics · Economics 2022-04-06 Anders Bredahl Kock , David Preinerstorfer , Bezirgen Veliyev

The empirical risk minimization approach to data-driven decision making requires access to training data drawn under the same conditions as those that will be faced when the decision rule is deployed. However, in a number of settings, we…

Methodology · Statistics 2025-09-17 Roshni Sahoo , Lihua Lei , Stefan Wager

To provide safety guarantees for learning-based control systems, recent work has developed formal verification methods to apply after training ends. However, if the trained policy does not meet the specifications, or there is conservatism…

Systems and Control · Electrical Eng. & Systems 2025-04-24 Puja Chaudhury , Alexander Estornell , Michael Everett

We study a security threat to batch reinforcement learning and control where the attacker aims to poison the learned policy. The victim is a reinforcement learner / controller which first estimates the dynamics and the rewards from a batch…

Machine Learning · Computer Science 2019-11-01 Yuzhe Ma , Xuezhou Zhang , Wen Sun , Xiaojin Zhu

We consider the problem of learning optimal solutions of a partially known linear optimization problem and recovering its underlying cost function where a set of past decisions and the feasible set are known. We develop a new framework,…

Optimization and Control · Mathematics 2023-01-10 Farzin Ahmadi , Fardin Ganjkhanloo , Kimia Ghobadi