English

A Batch, Off-Policy, Actor-Critic Algorithm for Optimizing the Average Reward

Machine Learning 2016-07-19 v1 Machine Learning
Authors: S. A. Murphy , Y. Deng , E. B. Laber , H. R. Maei , R. S. Sutton , K. Witkiewitz
View on arXiv ↗ PDF ↗

Abstract

We develop an off-policy actor-critic algorithm for learning an optimal policy from a training set composed of data from multiple individuals. This algorithm is developed with a view towards its use in mobile health.

Keywords

decision making under uncertainty sports analytics

Cite

@article{arxiv.1607.05047,
  title  = {A Batch, Off-Policy, Actor-Critic Algorithm for Optimizing the Average Reward},
  author = {S. A. Murphy and Y. Deng and E. B. Laber and H. R. Maei and R. S. Sutton and K. Witkiewitz},
  journal= {arXiv preprint arXiv:1607.05047},
  year   = {2016}
}

Related papers

View all related →
Machine Learning · Computer Science
Off-Policy Actor-Critic
Thomas Degris, Martha White, Richard S. Sutton
2015-03-20
Machine Learning · Computer Science
Distributed off-Policy Actor-Critic Reinforcement Learning with Policy Consensus
Yan Zhang, Michael M. Zavlanos
2019-03-25
Machine Learning · Computer Science
A Multi-Agent Off-Policy Actor-Critic Algorithm for Distributed Reinforcement Learning
Wesley Suttle, Zhuoran Yang, Kaiqing Zhang, Zhaoran Wang +2
2019-11-20
Machine Learning · Statistics
Revisiting stochastic off-policy action-value gradients
Yemi Okesanjo, Victor Kofia
2017-03-14
Machine Learning · Computer Science
Doubly Robust Off-Policy Actor-Critic Algorithms for Reinforcement Learning
Riashat Islam, Raihan Seraj, Samin Yeasar Arnob, Doina Precup
2019-12-12
Machine Learning · Computer Science
Explaining Off-Policy Actor-Critic From A Bias-Variance Perspective
Ting-Han Fan, Peter J. Ramadge
2021-10-07
Machine Learning · Computer Science
Optimal Actor-Critic Policy with Optimized Training Datasets
Chayan Banerjee, Zhiyong Chen, Nasimul Noman, Mohsen Zamani
2021-12-02
Machine Learning · Computer Science
Off-Policy Average Reward Actor-Critic with Deterministic Policy Search
Naman Saxena, Subhojyoti Khastigir, Shishir Kolathaya, Shalabh Bhatnagar
2023-07-20
Machine Learning · Computer Science
Neural Network Compatible Off-Policy Natural Actor-Critic Algorithm
Raghuram Bharadwaj Diddigi, Prateek Jain, Prabuchandran K. J., Shalabh Bhatnagar
2022-06-16
Machine Learning · Computer Science
Variance Penalized On-Policy and Off-Policy Actor-Critic
Arushi Jain, Gandharv Patil, Ayush Jain, Khimya Khetarpal +1
2021-02-04
Statistics Theory · Mathematics
Batch Policy Learning in Average Reward Markov Decision Processes
Peng Liao, Zhengling Qi, Runzhe Wan, Predrag Klasnja +1
2022-09-20
Artificial Intelligence · Computer Science
Convergent Actor-Critic Algorithms Under Off-Policy Training and Function Approximation
Hamid Reza Maei
2018-02-23
Machine Learning · Computer Science
Off-Policy Actor-Critic with Shared Experience Replay
Simon Schmitt, Matteo Hessel, Karen Simonyan
2019-11-19
Machine Learning · Computer Science
Distillation Policy Optimization
Jianfei Ma
2023-09-28
Machine Learning · Computer Science
An Actor-Critic Method for Simulation-Based Optimization
Kuo Li, Qing-Shan Jia, Jiaqi Yan
2021-11-02
Machine Learning · Computer Science
Off-policy Reinforcement Learning with Optimistic Exploration and Distribution Correction
Jiachen Li, Shuo Cheng, Zhenyu Liao, Huayan Wang +2
2022-11-23
Machine Learning · Computer Science
Reliable Off-policy Evaluation for Reinforcement Learning
Jie Wang, Rui Gao, Hongyuan Zha
2022-11-04
Machine Learning · Computer Science
Multi-agent Off-policy Actor-Critic Reinforcement Learning for Partially Observable Environments
Ainur Zhaikhan, Ali H. Sayed
2024-07-09
Machine Learning · Computer Science
Actor-Attention-Critic for Multi-Agent Reinforcement Learning
Shariq Iqbal, Fei Sha
2019-05-29
Machine Learning · Computer Science
An Off-policy Policy Gradient Theorem Using Emphatic Weightings
Ehsan Imani, Eric Graves, Martha White
2019-06-21
Machine Learning · Computer Science
Discriminator-Actor-Critic: Addressing Sample Inefficiency and Reward Bias in Adversarial Imitation Learning
Ilya Kostrikov, Kumar Krishna Agrawal, Debidatta Dwibedi, Sergey Levine +1
2018-10-16
Machine Learning · Computer Science
Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actor
Tuomas Haarnoja, Aurick Zhou, Pieter Abbeel, Sergey Levine
2018-08-10
Machine Learning · Computer Science
Frugal Actor-Critic: Sample Efficient Off-Policy Deep Reinforcement Learning Using Unique Experiences
Nikhil Kumar Singh, Indranil Saha
2024-02-13
Machine Learning · Computer Science
Actor-Critic Policy Optimization in Partially Observable Multiagent Environments
Sriram Srinivasan, Marc Lanctot, Vinicius Zambaldi, Julien Perolat +3
2020-06-15
Machine Learning · Computer Science
Causality and Batch Reinforcement Learning: Complementary Approaches To Planning In Unknown Domains
James Bannon, Brad Windsor, Wenbo Song, Tao Li
2020-06-05
R2 v1 2026-06-22T14:57:08.057Z