English

Exploring the Psychometric Validity of AI-Generated Student Responses: A Study on Virtual Personas' Learning Motivation

Computers and Society 2025-11-12 v1 Artificial Intelligence

Abstract

This study explores whether large language models (LLMs) can simulate valid student responses for educational measurement. Using GPT -4o, 2000 virtual student personas were generated. Each persona completed the Academic Motivation Scale (AMS). Factor analyses(EFA and CFA) and clustering showed GPT -4o reproduced the AMS structure and distinct motivational subgroups.

Keywords

Cite

@article{arxiv.2511.07451,
  title  = {Exploring the Psychometric Validity of AI-Generated Student Responses: A Study on Virtual Personas' Learning Motivation},
  author = {Huanxiao Wang},
  journal= {arXiv preprint arXiv:2511.07451},
  year   = {2025}
}

Comments

The paper has been accepted as proceedings of Artificial Intelligence in Measurement and Education Conference (AIME-Con) (2025)