English

An Evaluation of ChatGPT-4's Qualitative Spatial Reasoning Capabilities in RCC-8

Artificial Intelligence 2023-09-28 v1

Abstract

Qualitative Spatial Reasoning (QSR) is well explored area of Commonsense Reasoning and has multiple applications ranging from Geographical Information Systems to Robotics and Computer Vision. Recently many claims have been made for the capabilities of Large Language Models (LLMs). In this paper we investigate the extent to which one particular LLM can perform classical qualitative spatial reasoning tasks on the mereotopological calculus, RCC-8.

Keywords

Cite

@article{arxiv.2309.15577,
  title  = {An Evaluation of ChatGPT-4's Qualitative Spatial Reasoning Capabilities in RCC-8},
  author = {Anthony G Cohn},
  journal= {arXiv preprint arXiv:2309.15577},
  year   = {2023}
}

Comments

10 figures. 8 pages. Accepted for presentation at 36th International Workshop on Qualitative Reasoning (QR-23), in conjunction with ECAI2023 in Krakow, Poland