English
Related papers

Related papers: Deconfounding Actor-Critic Network with Policy Ada…

200 papers

Reinforcement learning (RL) has garnered increasing recognition for its potential to optimise dynamic treatment regimes (DTRs) in personalised medicine, particularly for drug dosage prescriptions and medication recommendations. However, a…

Machine Learning · Computer Science 2024-05-30 Zhiyao Luo , Mingcheng Zhu , Fenglin Liu , Jiali Li , Yangchen Pan , Jiandong Zhou , Tingting Zhu

Discrete reinforcement learning (RL) algorithms have demonstrated exceptional performance in solving sequential decision tasks with discrete action spaces, such as Atari games. However, their effectiveness is hindered when applied to…

Machine Learning · Computer Science 2023-08-22 Yechen Zhang , Jian Sun , Gang Wang , Zhuo Li , Wei Chen

We study robust reinforcement learning (RL) with the goal of determining a well-performing policy that is robust against model mismatch between the training simulator and the testing environment. Previous policy-based robust RL algorithms…

Machine Learning · Computer Science 2023-12-12 Ruida Zhou , Tao Liu , Min Cheng , Dileep Kalathil , P. R. Kumar , Chao Tian

A widely-studied deep reinforcement learning (RL) technique known as Prioritized Experience Replay (PER) allows agents to learn from transitions sampled with non-uniform probability proportional to their temporal-difference (TD) error.…

Machine Learning · Computer Science 2022-09-02 Baturay Saglam , Furkan B. Mutlu , Dogan C. Cicek , Suleyman S. Kozat

The treatment effects of medications play a key role in guiding medical prescriptions. They are usually assessed with randomized controlled trials (RCTs), which are expensive. Recently, large-scale electronic health records (EHRs) have…

Machine Learning · Statistics 2019-08-20 Linying Zhang , Yixin Wang , Anna Ostropolets , Jami J. Mulgrave , David M. Blei , George Hripcsak

Deterministic policy gradient algorithms for continuous control suffer from value estimation biases that degrade performance. While double critics reduce such biases, the exploration potential of double actors remains underexplored.…

Machine Learning · Computer Science 2025-11-21 Haohui Chen , Zhiyong Chen , Aoxiang Liu , Wentuo Fang

Hidden confounders that influence both states and actions can bias policy learning in reinforcement learning (RL), leading to suboptimal or non-generalizable behavior. Most RL algorithms ignore this issue, learning policies from…

Machine Learning · Computer Science 2025-06-09 Thanh Vinh Vo , Young Lee , Haozhe Ma , Chien Lu , Tze-Yun Leong

The effectiveness of credit assignment in reinforcement learning (RL) when dealing with high-dimensional data is influenced by the success of representation learning via deep neural networks, and has implications for the sample efficiency…

Machine Learning · Computer Science 2025-02-03 Burcu Küçükoğlu , Sander Dalm , Marcel van Gerven

Mechanical ventilation is a key form of life support for patients with pulmonary impairment. Healthcare workers are required to continuously adjust ventilator settings for each patient, a challenging and time consuming task. Hence, it would…

Machine Learning · Computer Science 2022-10-07 Flemming Kondrup , Thomas Jiralerspong , Elaine Lau , Nathan de Lara , Jacob Shkrob , My Duc Tran , Doina Precup , Sumana Basu

To make efficient use of limited spectral resources, we in this work propose a deep actor-critic reinforcement learning based framework for dynamic multichannel access. We consider both a single-user case and a scenario in which multiple…

Machine Learning · Computer Science 2019-08-23 Chen Zhong , Ziyang Lu , M. Cenk Gursoy , Senem Velipasalar

Reinforcement learning (RL) has proven highly effective in addressing complex decision-making and control tasks. However, in most traditional RL algorithms, the policy is typically parameterized as a diagonal Gaussian distribution with…

Machine Learning · Computer Science 2024-12-24 Yinuo Wang , Likun Wang , Yuxuan Jiang , Wenjun Zou , Tong Liu , Xujie Song , Wenxuan Wang , Liming Xiao , Jiang Wu , Jingliang Duan , Shengbo Eben Li

Estimating dynamic treatment regimes (DTRs) from retrospective observational data is challenging as some degree of unmeasured confounding is often expected. In this work, we develop a framework of estimating properly defined "optimal" DTRs…

Methodology · Statistics 2021-04-19 Shuxiao Chen , Bo Zhang

This research is concerned with the novel application and investigation of `Soft Actor Critic' (SAC) based Deep Reinforcement Learning (DRL) to control the cooling setpoint (and hence cooling loads) of a large commercial building to harness…

Machine Learning · Computer Science 2021-07-08 Anjukan Kathirgamanathan , Eleni Mangina , Donal P. Finn

For those seeking healthcare advice online, AI based dialogue agents capable of interacting with patients to perform automatic disease diagnosis are a viable option. This application necessitates efficient inquiry of relevant disease…

Machine Learning · Computer Science 2022-06-09 Weijie He , Ting Chen

Chemotherapy dose optimization can be formulated as a dynamic treatment regime, requiring sequential decisions under uncertainty that must balance tumor suppression against toxicity. However, most reinforcement learning approaches assume…

Machine Learning · Computer Science 2026-05-05 Firas Mohamed Elamine Kiram , Imane Youkana , Rachida Saouli , Gian Antonio Susto , Laid Kahloul

An optimal dynamic treatment regime (DTR) is a sequence of decision rules aimed at providing the best course of treatments individualized to patients. While conventional DTR estimation uses longitudinal data, such data can also be…

Methodology · Statistics 2025-02-06 Larry Dong , Eleanor Pullenayegum , Rodolphe Thiébaut , Olli Saarela

We develop and evaluate tolerance interval methods for dynamic treatment regimes (DTRs) that can provide more detailed prognostic information to patients who will follow an estimated optimal regime. Although the problem of constructing…

Methodology · Statistics 2017-04-26 Daniel J. Lizotte , Arezoo Tahmasebi

We introduce a Reinforcement Learning Psychotherapy AI Companion that generates topic recommendations for therapists based on patient responses. The system uses Deep Reinforcement Learning (DRL) to generate multi-objective policies for four…

Machine Learning · Computer Science 2023-03-20 Baihan Lin , Guillermo Cecchi , Djallel Bouneffouf

This paper presents the Relaxed Continuous-Time Actor-critic (RCTAC) algorithm, a method for finding the nearly optimal policy for nonlinear continuous-time (CT) systems with known dynamics and infinite horizon, such as the path-tracking…

Systems and Control · Electrical Eng. & Systems 2023-03-31 Jingliang Duan , Jie Li , Qiang Ge , Shengbo Eben Li , Monimoy Bujarbaruah , Fei Ma , Dezhao Zhang

Actor-critic deep reinforcement learning (DRL) algorithms have recently achieved prominent success in tackling various challenging reinforcement learning (RL) problems, particularly complex control tasks with high-dimensional continuous…

Machine Learning · Computer Science 2023-05-04 Gang Chen , Victoria Huang