English

Enhancing Analogical Reasoning in the Abstraction and Reasoning Corpus via Model-Based RL

Artificial Intelligence 2024-08-28 v1 Logic in Computer Science

Abstract

This paper demonstrates that model-based reinforcement learning (model-based RL) is a suitable approach for the task of analogical reasoning. We hypothesize that model-based RL can solve analogical reasoning tasks more efficiently through the creation of internal models. To test this, we compared DreamerV3, a model-based RL method, with Proximal Policy Optimization, a model-free RL method, on the Abstraction and Reasoning Corpus (ARC) tasks. Our results indicate that model-based RL not only outperforms model-free RL in learning and generalizing from single tasks but also shows significant advantages in reasoning across similar tasks.

Keywords

Cite

@article{arxiv.2408.14855,
  title  = {Enhancing Analogical Reasoning in the Abstraction and Reasoning Corpus via Model-Based RL},
  author = {Jihwan Lee and Woochang Sim and Sejin Kim and Sundong Kim},
  journal= {arXiv preprint arXiv:2408.14855},
  year   = {2024}
}

Comments

Accepted to IJCAI 2024 IARML Workshop