English

Multi-Agent Collaborative Framework For Math Problem Generation

Multiagent Systems 2025-11-07 v1 Computation and Language Human-Computer Interaction

Abstract

Automatic question generation (AQG) for mathematics education remains an elusive goal for Intelligent Tutoring Systems and educators. While pre-trained transformer-based language models have significantly advanced natural language generation, they often struggle to precisely control problem complexity and cognitive demands. In this paper, we introduce a collaborative multi-agent framework as a novel method of incorporating inference-time computation into AQG. This approach leverages multiple agents that iteratively refine generated question-answer pairs to better balance complexity and cognitive demand. We evaluate the generated questions on five meta-evaluation criteria: relevance, importance, clarity, difficulty matching, answerability, to assess the system's ability to control the required complexity and quality of the questions. Preliminary evaluations show that this collaborative multi-agent framework elevates the quality of generated educational content by fostering a more nuanced balance between cognitive challenge and clarity. These promising outcomes suggest that integrating collaborative multi-agent workflows can yield more controlled, pedagogically valuable content that can help advance automated educational content generation and adaptive learning environments.

Keywords

Cite

@article{arxiv.2511.03958,
  title  = {Multi-Agent Collaborative Framework For Math Problem Generation},
  author = {Kia Karbasi and Kevin Hong and Mohammad Amin Samadi and Gregory Pottie},
  journal= {arXiv preprint arXiv:2511.03958},
  year   = {2025}
}

Comments

Published in the Proceedings of the 18th International Conference on Educational Data Mining, 6 pages, 5 figures