English
Related papers

Related papers: Deconfounding Actor-Critic Network with Policy Ada…

200 papers

A dynamic treatment regimen (DTR) is a set of decision rules to personalize treatments for an individual using their medical history. The Q-learning-based Q-shared algorithm has been used to develop DTRs that involve decision rules shared…

Machine Learning · Statistics 2024-12-05 Palash Ghosh , Xinru Wang , Trikay Nalamada , Shruti Agarwal , Maria Jahja , Bibhas Chakraborty

Robust Reinforcement Learning aims to derive optimal behavior that accounts for model uncertainty in dynamical systems. However, previous studies have shown that by considering the worst case scenario, robust policies can be overly…

Machine Learning · Computer Science 2018-10-25 Esther Derman , Daniel J. Mankowitz , Timothy A. Mann , Shie Mannor

Actor-critic methods constitute a central paradigm in reinforcement learning (RL), coupling policy evaluation with policy improvement. While effective across many domains, these methods rely on separate actor and critic networks, which…

Machine Learning · Computer Science 2025-09-26 Donghyeon Ki , Hee-Jun Ahn , Kyungyoon Kim , Byung-Jun Lee

Large health care data repositories such as electronic health records (EHR) open new opportunities to derive individualized treatment strategies for complicated diseases such as sepsis. In this paper, we consider the problem of estimating…

Statistics Theory · Mathematics 2023-10-03 Nilanjana Laha , Aaron Sonabend-W , Rajarshi Mukherjee , Tianxi Cai

Policy gradient methods in actor-critic reinforcement learning (RL) have become perhaps the most promising approaches to solving continuous optimal control problems. However, the trial-and-error nature of RL and the inherent randomness…

Machine Learning · Computer Science 2024-04-19 Ruofan Wu , Junmin Zhong , Jennie Si

Timely and personalized treatment decisions are essential across a wide range of healthcare settings where patient responses can vary significantly and evolve over time. Clinical data used to support these treatment decisions are often…

Machine Learning · Computer Science 2025-12-03 Qianyi Xu , Gousia Habib , Feng Wu , Dilruk Perera , Mengling Feng

To obtain better value estimation in reinforcement learning, we propose a novel algorithm based on the double actor-critic framework with temporal difference error-driven regularization, abbreviated as TDDR. TDDR employs double actors, with…

Machine Learning · Computer Science 2024-10-01 Haohui Chen , Zhiyong Chen , Aoxiang Liu , Wentuo Fang

The study of precision medicine involves dynamic treatment regimes (DTRs), which are sequences of treatment decision rules recommended by taking patient-level information as input. The primary goal of the DTR study is to identify an optimal…

Methodology · Statistics 2024-12-11 Dan Liu , Wenqing He

In recent years, dual-target Cross-Domain Recommendation (CDR) has been proposed to capture comprehensive user preferences in order to ultimately enhance the recommendation accuracy in both data-richer and data-sparser domains…

Information Retrieval · Computer Science 2025-05-23 Jiajie Zhu , Yan Wang , Feng Zhu , Zhu Sun

We introduce D2AC, a new model-free reinforcement learning (RL) algorithm designed to train expressive diffusion policies online effectively. At its core is a policy improvement objective that avoids the high variance of typical policy…

Machine Learning · Computer Science 2026-05-25 Lunjun Zhang , Shuo Han , Hanrui Lyu , Bradly C Stadie

Due to their complex nonlinear dynamics and batch-to-batch variability, batch processes pose a challenge for process control. Due to the absence of accurate models and resulting plant-model mismatch, these problems become harder to address…

Machine Learning · Computer Science 2022-05-03 Tanuja Joshi , Hariprasad Kodamana , Harikumar Kandath , Niket Kaisare

Observational studies have recently received significant attention from the machine learning community due to the increasingly available non-experimental observational data and the limitations of the experimental studies, such as…

Machine Learning · Computer Science 2023-01-26 Vinod Kumar Chauhan , Soheila Molaei , Marzia Hoque Tania , Anshul Thakur , Tingting Zhu , David A. Clifton

Robotic manipulation remains challenging for reinforcement learning due to contact-rich dynamics, long horizons, and training instability. Although off-policy actor-critic algorithms such as SAC and TD3 perform well in simulation, they…

Robotics · Computer Science 2026-04-03 Yu Zhang , Karl Mason

Scarcity of health care resources could result in the unavoidable consequence of rationing. For example, ventilators are often limited in supply, especially during public health emergencies or in resource-constrained health care settings,…

Machine Learning · Computer Science 2024-08-23 Yikuan Li , Chengsheng Mao , Kaixuan Huang , Hanyin Wang , Zheng Yu , Mengdi Wang , Yuan Luo

Dynamic treatment recommendation systems based on large-scale electronic health records (EHRs) become a key to successfully improve practical clinical outcomes. Prior relevant studies recommend treatments either use supervised learning…

Machine Learning · Computer Science 2018-09-18 Lu Wang , Wei Zhang , Xiaofeng He , Hongyuan Zha

This paper studies the cumulative causal effects of sequential treatments in the presence of unmeasured confounders. It is a critical issue in sequential decision-making scenarios where treatment decisions and outcomes dynamically evolve…

Machine Learning · Computer Science 2025-05-15 Yingrong Wang , Anpeng Wu , Baohong Li , Ziyang Xiao , Ruoxuan Xiong , Qing Han , Kun Kuang

Estimating individual-level treatment effect from observational data is a fundamental problem in causal inference and has attracted increasing attention in the fields of education, healthcare, and public policy.In this work, we concentrate…

Machine Learning · Computer Science 2025-07-10 Hui Meng , Keping Yang , Xuyu Peng , Bo Zheng

A dynamic treatment regimen (DTR) is a pre-specified sequence of decision rules which maps baseline or time-varying measurements on an individual to a recommended intervention or set of interventions. Sequential multiple assignment…

Methodology · Statistics 2019-10-23 Brook Luers , Min Qian , Inbal Nahum-Shani , Connie Kasari , Daniel Almirall

Deep Reinforcement Learning (DRL) has been a promising solution to many complex decision-making problems. Nevertheless, the notorious weakness in generalization among environments prevent widespread application of DRL agents in real-world…

Machine Learning · Computer Science 2022-05-31 Tong Sang , Hongyao Tang , Yi Ma , Jianye Hao , Yan Zheng , Zhaopeng Meng , Boyan Li , Zhen Wang

Online reinforcement learning is becoming increasingly important for aligning diffusion models with non-differentiable objectives. However, existing methods still face limitations in assigning fine-grained credit along denoising…

Machine Learning · Computer Science 2026-05-28 Zhengyang Liang , Qihang Zhang , Ceyuan Yang