English
Related papers

Related papers: Optimizing Digital Therapeutic Interventions: Onli…

200 papers

Dynamic treatment regimes (DTRs) are used in medicine to tailor sequential treatment decisions to patients by considering patient heterogeneity. Common methods for learning optimal DTRs, however, have shortcomings: they are typically based…

Machine Learning · Statistics 2023-06-21 Theresa Blümlein , Joel Persson , Stefan Feuerriegel

Offline reinforcement learning has shown promise for solving tasks in safety-critical settings, such as clinical decision support. Its application, however, has been limited by the lack of interpretability and interactivity for clinicians.…

Machine Learning · Computer Science 2024-07-30 Aamer Abdul Rahman , Pranav Agarwal , Rita Noumeir , Philippe Jouvet , Vincent Michalski , Samira Ebrahimi Kahou

We consider online reinforcement learning in episodic Markov decision process (MDP) with unknown transition function and stochastic rewards drawn from some fixed but unknown distribution. The learner aims to learn the optimal policy and…

Machine Learning · Computer Science 2024-03-12 Vincent Leon , S. Rasoul Etesami

Digital Behavior Change Interventions (DBCIs) are supporting development of new health behaviors. Evaluating their effectiveness is crucial for their improvement and understanding of success factors. However, comprehensive guidance for…

Human-Computer Interaction · Computer Science 2024-04-22 Aneta Lisowska , Szymon Wilk , Laura Locati , Mimma Rizzo , Lucia Sacchi , Silvana Quaglini , Matteo Terzaghi , Valentina Tibollo , Mor Peleg

Temporal difference (TD) learning is a foundational algorithm in reinforcement learning (RL). For nearly forty years, TD learning has served as a workhorse for applied RL as well as a building block for more complex and specialized…

Machine Learning · Computer Science 2025-06-24 Hwanwoo Kim , Panos Toulis , Eric Laber

Many applied decision-making problems have a dynamic component: The policymaker needs not only to choose whom to treat, but also when to start which treatment. For example, a medical doctor may choose between postponing treatment (watchful…

Methodology · Statistics 2020-05-01 Xinkun Nie , Emma Brunskill , Stefan Wager

Behavioral health interventions, delivered through digital platforms, have the potential to significantly improve health outcomes, through education, motivation, reminders, and outreach. We study the problem of optimizing personalized…

Machine Learning · Computer Science 2024-07-19 Jackie Baek , Justin J. Boutilier , Vivek F. Farias , Jonas Oddur Jonasson , Erez Yoeli

Dynamic treatment regimens (DTRs) are sequential decision rules tailored at each stage by potentially time-varying patient features and intermediate outcomes observed in previous stages. The complexity, patient heterogeneity and chronicity…

Methodology · Statistics 2016-11-09 Ying Liu , Yuanjia Wang , Michael R. Kosorok , Yingqi Zhao , Donglin Zeng

Adherence can be defined as "the extent to which patients take their medications as prescribed by their healthcare providers"[Osterberg and Blaschke, 2005]. World Health Organization's reports point out that, in developed countries, only…

Machine Learning · Computer Science 2018-11-30 Thomas Janssoone , Clémence Bic , Dorra Kanoun , Pierre Hornus , Pierre Rinder

In networks, effective dynamic treatment allocation requires deciding both whom to treat and also when, so as to amplify policy impact through spillovers. An early intervention at a well-connected node can trigger cascades that change which…

Machine Learning · Statistics 2026-05-08 Bengusu Nar , Jiguang Li , Veronika Ročková , Panos Toulis

This paper presents the first deep reinforcement learning (DRL) framework to estimate the optimal Dynamic Treatment Regimes from observational medical data. This framework is more flexible and adaptive for high dimensional action and state…

Artificial Intelligence · Computer Science 2018-01-30 Ning Liu , Ying Liu , Brent Logan , Zhiyuan Xu , Jian Tang , Yanzhi Wang

To achieve the goal of providing the best possible care to each patient, physicians need to customize treatments for patients with the same diagnosis, especially when treating diseases that can progress further and require additional…

Methodology · Statistics 2022-10-25 Xiao Li , Brent R Logan , S M Ferdous Hossain , Erica E M Moodie

One of the most significant barriers to medication treatment is patients' non-adherence to a prescribed medication regimen. The extent of the impact of poor adherence on resulting health measures is often unknown, and typical analyses…

Applications · Statistics 2018-12-04 Luis F. Campos , Mark E. Glickman , Kristen B. Hunter

Decision-focused learning (DFL) is an increasingly popular paradigm for training predictive models whose outputs are used in decision-making tasks. Instead of merely optimizing for predictive accuracy, DFL trains models to directly minimize…

Machine Learning · Computer Science 2026-03-10 Aymeric Capitaine , Maxime Haddouche , Eric Moulines , Michael I. Jordan , Etienne Boursier , Alain Durmus

The task of predicting long-term patient outcomes using supervised machine learning is a challenging one, in part because of the high variance of each patient's trajectory, which can result in the model over-fitting to the training data.…

Machine Learning · Computer Science 2026-02-09 Thomas Frost , Kezhi Li , Steve Harris

Decision support systems based on clinical notes have the potential to improve patient care by pointing doctors towards overseen risks. Predicting a patient's outcome is an essential part of such systems, for which the use of deep neural…

Computation and Language · Computer Science 2021-12-01 Betty van Aken , Sebastian Herrmann , Alexander Löser

Improving user retention with reinforcement learning~(RL) has attracted increasing attention due to its significant importance in boosting user engagement. However, training the RL policy from scratch without hurting users' experience is…

Information Retrieval · Computer Science 2023-03-14 Kesen Zhao , Lixin Zou , Xiangyu Zhao , Maolin Wang , Dawei yin

In many modern applications, a system must dynamically choose between several adaptive learning algorithms that are trained online. Examples include model selection in streaming environments, switching between trading strategies in finance,…

Machine Learning · Computer Science 2026-01-19 Ilgam Latypov , Alexandra Suvorikova , Alexey Kroshnin , Alexander Gasnikov , Yuriy Dorn

Online learning is a powerful tool for analyzing iterative algorithms. However, the classic adversarial setup sometimes fails to capture certain regularity in online problems in practice. Motivated by this, we establish a new setup, called…

Machine Learning · Computer Science 2022-04-06 Ching-An Cheng , Jonathan Lee , Ken Goldberg , Byron Boots

Mobile health aims to enhance health outcomes by delivering interventions to individuals as they go about their daily life. The involvement of care partners and social support networks often proves crucial in helping individuals managing…

Machine Learning · Computer Science 2024-08-13 Shuangning Li , Lluis Salvat Niell , Sung Won Choi , Inbal Nahum-Shani , Guy Shani , Susan Murphy