English

Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matrices

Computer Vision and Pattern Recognition 2023-03-22 v1 Artificial Intelligence Symbolic Computation Commutative Algebra

Abstract

We introduce algebraic machine reasoning, a new reasoning framework that is well-suited for abstract reasoning. Effectively, algebraic machine reasoning reduces the difficult process of novel problem-solving to routine algebraic computation. The fundamental algebraic objects of interest are the ideals of some suitably initialized polynomial ring. We shall explain how solving Raven's Progressive Matrices (RPMs) can be realized as computational problems in algebra, which combine various well-known algebraic subroutines that include: Computing the Gr\"obner basis of an ideal, checking for ideal containment, etc. Crucially, the additional algebraic structure satisfied by ideals allows for more operations on ideals beyond set-theoretic operations. Our algebraic machine reasoning framework is not only able to select the correct answer from a given answer set, but also able to generate the correct answer with only the question matrix given. Experiments on the I-RAVEN dataset yield an overall 93.2%93.2\% accuracy, which significantly outperforms the current state-of-the-art accuracy of 77.0%77.0\% and exceeds human performance at 84.4%84.4\% accuracy.

Keywords

Cite

@article{arxiv.2303.11730,
  title  = {Abstract Visual Reasoning: An Algebraic Approach for Solving Raven's Progressive Matrices},
  author = {Jingyi Xu and Tushar Vaidya and Yufei Wu and Saket Chandra and Zhangsheng Lai and Kai Fong Ernest Chong},
  journal= {arXiv preprint arXiv:2303.11730},
  year   = {2023}
}

Comments

Accepted at IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2023. 30 pages, 7 figures (including supplementary material). First three authors contributed equally. Code is available at: https://github.com/Xu-Jingyi/AlgebraicMR

R2 v1 2026-06-28T09:25:56.428Z