Undergraduate graders are frequently important contributors to the teaching team in post-secondary education settings. This study set out to investigate agreement for a team of undergraduate graders as they acquired training and experience for scoring responses to open-ended tasks. Results demonstrate compelling evidence that undergraduate students can develop the ability to establish and sustain substantial agreement with an instructor, especially when equipped with proper training and a high-quality scoring rubric.
@article{arxiv.2410.18062,
title = {Developing Consistency Among Undergraduate Graders Scoring Open-Ended Statistics Tasks},
author = {Matthew D. Beckman and Sean Burke and Jack Fiochetta and Benjamin Fry and Susan E. Lloyd and Luke Patterson and Elle Tang},
journal= {arXiv preprint arXiv:2410.18062},
year = {2024}
}
Comments
Supplemental materials for the preprint available by request from the first author