English
Related papers

Related papers: Penalized Q-Learning for Dynamic Treatment Regimes

200 papers

In modern industrial systems, diagnosing faults in time and using the best methods becomes more and more crucial. It is possible to fail a system or to waste resources if faults are not detected or are detected late. Machine learning and…

Machine Learning · Computer Science 2022-10-13 M. H. Modirrousta , M. Aliyari Shoorehdeli , M. Yari , A. Ghahremani

Reinforcement Learning algorithms have recently been proposed to learn time-sequential control policies in the field of autonomous driving. Direct applications of Reinforcement Learning algorithms with discrete action space will yield…

Machine Learning · Computer Science 2019-12-03 Pin Wang , Hanhan Li , Ching-Yao Chan

Model-free reinforcement learning based methods such as Proximal Policy Optimization, or Q-learning typically require thousands of interactions with the environment to approximate the optimum controller which may not always be feasible in…

Machine Learning · Computer Science 2019-05-16 Narendra Patwardhan , Zequn Wang

Randomized experiments (a.k.a. A/B tests) are a powerful tool for estimating treatment effects, to inform decisions making in business, healthcare and other applications. In many problems, the treatment has a lasting effect that evolves…

Machine Learning · Computer Science 2022-10-17 Ziyang Tang , Yiheng Duan , Stephanie Zhang , Lihong Li

Model-based representations recently stand out as a promising framework that embeds latent dynamics information into the representations for downstream off-policy actor-critic learning. It implicitly combines the advantages of both…

Machine Learning · Computer Science 2026-05-13 Jiafei Lyu , Zichuan Lin , Scott Fujimoto , Kai Yang , Yangkun Chen , Saiyong Yang , Zongqing Lu , Deheng Ye

Co-training is a popular semi-supervised learning framework to utilize a large amount of unlabeled data in addition to a small labeled set. Co-training methods exploit predicted labels on the unlabeled data and select samples based on…

Computation and Language · Computer Science 2018-04-18 Jiawei Wu , Lei Li , William Yang Wang

While Bayesian-based exploration often demonstrates superior empirical performance compared to bonus-based methods in model-based reinforcement learning (RL), its theoretical understanding remains limited for model-free settings. Existing…

Machine Learning · Computer Science 2026-02-05 He Wang , Xingyu Xu , Yuejie Chi

Multistate process data are common in studies of chronic diseases such as cancer. These data are ideal for precision medicine purposes as they can be leveraged to improve more refined health outcomes, compared to standard survival outcomes,…

Methodology · Statistics 2022-11-28 Giorgos Bakoyannis

Federated Learning is a fast growing area of ML where the training datasets are extremely distributed, all while dynamically changing over time. Models need to be trained on clients' devices without any guarantees for either homogeneity or…

Machine Learning · Computer Science 2021-10-20 Tae Jin Park , Kenichi Kumatani , Dimitrios Dimitriadis

In this paper, we propose a novel Reinforcement Learning approach for solving the Active Information Acquisition problem, which requires an agent to choose a sequence of actions in order to acquire information about a process of interest…

Machine Learning · Computer Science 2019-10-25 Heejin Jeong , Brent Schlotfeldt , Hamed Hassani , Manfred Morari , Daniel D. Lee , George J. Pappas

Recent developments in sequential experimental design look to construct a policy that can efficiently navigate the design space, in a way that maximises the expected information gain. Whilst there is work on achieving tractable policies for…

Machine Learning · Computer Science 2025-08-20 Yasir Zubayr Barlas , Kizito Salako

Clinical trials involving multiple treatments utilize randomization of the treatment assignments to enable the evaluation of treatment efficacies in an unbiased manner. Such evaluation is performed in post hoc studies that usually use…

Artificial Intelligence · Computer Science 2018-09-10 Yogatheesan Varatharajah , Brent Berry , Sanmi Koyejo , Ravishankar Iyer

With the recent advancements of technology in facilitating real-time monitoring and data collection, "just-in-time" interventions can be delivered via mobile devices to achieve both real-time and long-term management and control.…

Methodology · Statistics 2023-09-26 Wenzhuo Zhou , Yuhan Li , Ruoqing Zhu

Learning representations for reinforcement learning (RL) has shown much promise for continuous control. We propose an efficient representation learning method using only a self-supervised latent-state consistency loss. Our approach employs…

Machine Learning · Computer Science 2024-06-06 Aidan Scannell , Kalle Kujanpää , Yi Zhao , Mohammadreza Nakhaei , Arno Solin , Joni Pajarinen

Many applied decision-making problems have a dynamic component: The policymaker needs not only to choose whom to treat, but also when to start which treatment. For example, a medical doctor may choose between postponing treatment (watchful…

Methodology · Statistics 2020-05-01 Xinkun Nie , Emma Brunskill , Stefan Wager

In dynamic decision-making scenarios across business and healthcare, leveraging sample trajectories from diverse populations can significantly enhance reinforcement learning (RL) performance for specific target populations, especially when…

Machine Learning · Statistics 2025-04-15 Jinhang Chai , Elynn Chen , Jianqing Fan

Q-learning is a popular Reinforcement Learning (RL) algorithm which is widely used in practice with function approximation (Mnih et al., 2015). In contrast, existing theoretical results are pessimistic about Q-learning. For example, (Baird,…

Machine Learning · Computer Science 2021-10-20 Naman Agarwal , Syomantak Chaudhuri , Prateek Jain , Dheeraj Nagaraj , Praneeth Netrapalli

We introduce a Reinforcement Learning Psychotherapy AI Companion that generates topic recommendations for therapists based on patient responses. The system uses Deep Reinforcement Learning (DRL) to generate multi-objective policies for four…

Machine Learning · Computer Science 2023-03-20 Baihan Lin , Guillermo Cecchi , Djallel Bouneffouf

We propose a Buckley James (BJ) Boost Q learning framework for estimating optimal dynamic treatment regimes from right censored survival outcomes in longitudinal randomized clinical trials, motivated by the clinical need to support patient…

Machine Learning · Statistics 2026-02-18 Jeongjin Lee , Jong-Min Kim

Reinforcement learning (RL) has achieved phenomenal success in various domains. However, its data-driven nature also introduces new vulnerabilities that can be exploited by malicious opponents. Recent work shows that a well-trained RL agent…

Machine Learning · Computer Science 2024-03-08 Xiaolin Sun , Zizhan Zheng