LLAMA LIMA: A Living Meta-Analysis on the Effects of Generative AI on Learning Mathematics
Abstract
The capabilities of generative AI in mathematics education are rapidly evolving, posing significant challenges for research to keep pace. Research syntheses remain scarce and risk being outdated by the time of publication. To address this issue, we present a Living Meta-Analysis (LIMA) on the effects of generative AI-based interventions for learning mathematics. Following PRISMA-LSR guidelines, we continuously update the literature base, apply a Bayesian multilevel meta-regression model to account for nested and cumulative data, and publish updated versions on a preprint server at regular intervals. This paper reports results from the third version, including 24 studies, 3 of which were newly included since the second version. The analyses indicate a positive effect (g = 0.40) with a wide credible interval [0.14, 0.67], reflecting the still limited evidence base. Results indicate no publication bias. Moderator analyses indicate moderate evidence that generative AI is more beneficial when it complements regular instruction rather than replacing teachers.
Keywords
Cite
@article{arxiv.2601.18685,
title = {LLAMA LIMA: A Living Meta-Analysis on the Effects of Generative AI on Learning Mathematics},
author = {Anselm Strohmaier and Samira Bödefeld and Oliver Straser and Frank Reinhold},
journal= {arXiv preprint arXiv:2601.18685},
year = {2026}
}
Comments
This is a living publication. See the first page of the PDF for more information