Providing feedback, both assessing final work and giving hints to stuck students, is difficult for open-ended assignments in massive online classes which can range from thousands to millions of students. We introduce a neural network method to encode programs as a linear mapping from an embedded precondition space to an embedded postcondition space and propose an algorithm for feedback at scale using these linear maps as features. We apply our algorithm to assessments from the Code.org Hour of Code and Stanford University's CS1 course, where we propagate human comments on student assignments to orders of magnitude more submissions.
@article{arxiv.1505.05969,
title = {Learning Program Embeddings to Propagate Feedback on Student Code},
author = {Chris Piech and Jonathan Huang and Andy Nguyen and Mike Phulsuksombati and Mehran Sahami and Leonidas Guibas},
journal= {arXiv preprint arXiv:1505.05969},
year = {2015}
}
Comments
Accepted to International Conference on Machine Learning (ICML 2015)