English

Beyond the AI Tutor: Social Learning with LLM Agents

Human-Computer Interaction 2026-04-06 v1 Computers and Society

Abstract

Most AI-based educational tools today adopt a one-on-one tutoring paradigm, pairing a single LLM with a single learner. Yet decades of learning science research suggest that multi-party interaction -- through peer modeling, co-construction, and exposure to diverse perspectives -- can produce learning benefits that dyadic tutoring alone cannot. In this paper, we investigate whether multi-agent LLM configurations can enhance learning outcomes beyond what a single LLM tutor provides. We present two controlled experiments spanning distinct learning contexts. In a convergent problem-solving study (N=315N=315), participants tackle SAT-level math problems in a 2×\times2 design that varies the presence of an LLM tutor and LLM peers, each making different kinds of errors (conceptual vs.\ arithmetic); participants who interacted with both a tutor and peers achieved the highest unassisted test accuracy. In a divergent composition study (N=247N=247), participants write argumentative and creative essays with either no AI assistance, a single LLM (Claude or ChatGPT), or both Claude and ChatGPT together; while both LLM conditions improved essay quality, only the two-agent condition avoided the idea-level homogeneity that single-model assistance was found to produce. Together, these studies offer one of the first controlled investigations of multi-agent LLM learning environments, probing whether the move from one-on-one AI tutoring toward richer agent configurations can unlock the collaborative and observational benefits long documented in human social learning research.

Keywords

Cite

@article{arxiv.2604.02677,
  title  = {Beyond the AI Tutor: Social Learning with LLM Agents},
  author = {Harsh Kumar and Zi Kang and Mu and Jonathan Vincentius and Ashton Anderson},
  journal= {arXiv preprint arXiv:2604.02677},
  year   = {2026}
}

Comments

Working draft

R2 v1 2026-07-01T11:52:16.570Z