English

Classroom Final Exam: An Instructor-Tested Reasoning Benchmark

Artificial Intelligence 2026-03-04 v2 Computational Engineering, Finance, and Science Computation and Language Computer Vision and Pattern Recognition

Abstract

We introduce CFE-Bench (Classroom Final Exam), a multimodal benchmark for evaluating the reasoning capabilities of large language models across more than 20 STEM domains. CFE-Bench is curated from repeatedly used, authentic university homework and exam problems, paired with reference solutions provided by course instructors. CFE-Bench remains challenging for frontier models: the newly released Gemini-3.1-pro-preview achieves 59.69% overall accuracy, while the second-best model, Gemini-3-flash-preview, reaches 55.46%, leaving substantial room for improvement. Beyond aggregate scores, we conduct a diagnostic analysis by decomposing instructor reference solutions into structured reasoning flows. We find that while frontier models often answer intermediate sub-questions correctly, they struggle to reliably derive and maintain correct intermediate states throughout multi-step solutions. We further observe that model-generated solutions typically contain more reasoning steps than instructor solutions, indicating lower step efficiency and a higher risk of error accumulation. Data and code are available at https://github.com/Analogy-AI/CFE_Bench.

Keywords

Cite

@article{arxiv.2602.19517,
  title  = {Classroom Final Exam: An Instructor-Tested Reasoning Benchmark},
  author = {Chongyang Gao and Diji Yang and Shuyan Zhou and Xichen Yan and Luchuan Song and Shuo Li and Kezhen Chen},
  journal= {arXiv preprint arXiv:2602.19517},
  year   = {2026}
}
R2 v1 2026-07-01T10:46:53.604Z