English

On Predictive planning and counterfactual learning in active inference

Artificial Intelligence 2024-06-12 v1 Machine Learning Methodology

Abstract

Given the rapid advancement of artificial intelligence, understanding the foundations of intelligent behaviour is increasingly important. Active inference, regarded as a general theory of behaviour, offers a principled approach to probing the basis of sophistication in planning and decision-making. In this paper, we examine two decision-making schemes in active inference based on 'planning' and 'learning from experience'. Furthermore, we also introduce a mixed model that navigates the data-complexity trade-off between these strategies, leveraging the strengths of both to facilitate balanced decision-making. We evaluate our proposed model in a challenging grid-world scenario that requires adaptability from the agent. Additionally, our model provides the opportunity to analyze the evolution of various parameters, offering valuable insights and contributing to an explainable framework for intelligent decision-making.

Keywords

Cite

@article{arxiv.2403.12417,
  title  = {On Predictive planning and counterfactual learning in active inference},
  author = {Aswin Paul and Takuya Isomura and Adeel Razi},
  journal= {arXiv preprint arXiv:2403.12417},
  year   = {2024}
}

Comments

13 pages, 8 figures

R2 v1 2026-06-28T15:25:15.251Z