English

A Survey on Offline Model-Based Reinforcement Learning

Machine Learning 2023-05-08 v1 Artificial Intelligence Systems and Control Systems and Control

Abstract

Model-based approaches are becoming increasingly popular in the field of offline reinforcement learning, with high potential in real-world applications due to the model's capability of thoroughly utilizing the large historical datasets available with supervised learning techniques. This paper presents a literature review of recent work in offline model-based reinforcement learning, a field that utilizes model-based approaches in offline reinforcement learning. The survey provides a brief overview of the concepts and recent developments in both offline reinforcement learning and model-based reinforcement learning, and discuss the intersection of the two fields. We then presents key relevant papers in the field of offline model-based reinforcement learning and discuss their methods, particularly their approaches in solving the issue of distributional shift, the main problem faced by all current offline model-based reinforcement learning methods. We further discuss key challenges faced by the field, and suggest possible directions for future work.

Keywords

Cite

@article{arxiv.2305.03360,
  title  = {A Survey on Offline Model-Based Reinforcement Learning},
  author = {Haoyang He},
  journal= {arXiv preprint arXiv:2305.03360},
  year   = {2023}
}
R2 v1 2026-06-28T10:26:36.109Z