English
Related papers

Related papers: CoGrader: Transforming Instructors' Assessment of …

200 papers

While Large Language Models (LLMs) have demonstrated remarkable capabilities in code generation, they often produce solutions that lack guarantees of correctness, robustness, and efficiency. This limitation is particularly acute in domains…

Software Engineering · Computer Science 2025-09-04 Yueke Zhang , Yifan Zhang , Kevin Leach , Yu Huang

The rapid adoption of AI powered coding assistants like ChatGPT and other coding copilots is transforming programming education, raising questions about assessment practices, academic integrity, and skill development. As educators seek…

Computers and Society · Computer Science 2025-05-29 Santiago Berrezueta-Guzman , Stephan Krusche , Stefan Wagner

Organizations and educational institutions use time-bound assessment tasks to evaluate coding and problem-solving skills. These assessments measure not only the correctness of the solutions, but also their efficiency. Problem setters…

Software Engineering · Computer Science 2026-04-07 Hridoy Sankar Dutta , Sana Ansari , Swati Kumari , Shounak Ravi Bhalerao

Programmers increasingly rely on Large Language Models (LLMs) for code generation. However, misalignment between programmers' goals and generated code complicates the code evaluation process and demands frequent switching between prompt…

Software Engineering · Computer Science 2023-12-27 Ryan Yen , Jiawen Zhu , Sangho Suh , Haijun Xia , Jian Zhao

Objective and scalable measurement of teaching quality is a persistent challenge in education. While Large Language Models (LLMs) offer potential, general-purpose models have struggled to reliably apply complex, authentic classroom…

Computation and Language · Computer Science 2025-11-07 Michael Hardy

Reflection is widely recognized as a cornerstone of student development, fostering critical thinking, self-regulation, and deep conceptual understanding. Traditionally, reflective skills have been cultivated through structured feedback,…

Human-Computer Interaction · Computer Science 2025-09-10 Bo Yuan , Jiazi Hu

Evaluating teaching effectiveness at scale remains a persistent challenge for large universities, particularly within engineering programs that enroll tens of thousands of students. Traditional methods, such as manual review of student…

Computers and Society · Computer Science 2025-08-06 Jean-Francois Chamberland , Martin C. Carlisle , Arul Jayaraman , Krishna R. Narayanan , Sunay Palsole , Karan Watson

This study explores the classroom implementation of an AI-powered grading platform in K-12 settings through a co-design pilot with 19 teachers. We combine platform usage logs, surveys, and qualitative interviews to examine how teachers use…

Human-Computer Interaction · Computer Science 2025-11-06 Zewei Tian , Alex Liu , Lief Esbenshade , Shawon Sarkar , Zachary Zhang , Kevin He , Min Sun

Identifying logical errors in complex, incomplete or even contradictory and overall heterogeneous data like students' experimentation protocols is challenging. Recognizing the limitations of current evaluation methods, we investigate the…

Artificial Intelligence · Computer Science 2024-09-20 Arne Bewersdorff , Kathrin Seßler , Armin Baur , Enkelejda Kasneci , Claudia Nerdel

Ensuring large language models' (LLMs) responses align with prompt instructions is crucial for application development. Based on our formative study with industry professionals, the alignment requires heavy human involvement and tedious…

Human-Computer Interaction · Computer Science 2024-11-12 Ishika Joshi , Simra Shahid , Shreeya Venneti , Manushree Vasu , Yantao Zheng , Yunyao Li , Balaji Krishnamurthy , Gromit Yeuk-Yin Chan

Providing timely and individualised feedback on handwritten student work is highly beneficial for learning but difficult to achieve at scale. This challenge has become more pressing as generative AI undermines the reliability of take-home…

Integrating Large Language Models (LLMs) in educational technology presents unprecedented opportunities to improve instructional design (ID), yet existing approaches often prioritize automation over pedagogical rigor and human agency. This…

Computers and Society · Computer Science 2025-03-13 Hongming Li , Yizirui Fang , Shan Zhang , Seiyon M. Lee , Yiming Wang , Mark Trexler , Anthony F. Botelho

Large language models (LLMs) have demonstrated strong potential in performing automatic scoring for constructed response assessments. While constructed responses graded by humans are usually based on given grading rubrics, the methods by…

Computation and Language · Computer Science 2025-02-24 Xuansheng Wu , Padmaja Pravin Saraf , Gyeonggeon Lee , Ehsan Latif , Ninghao Liu , Xiaoming Zhai

Machine Learning models have many potentially beneficial applications in education settings, but a key barrier to their development is securing enough data to train these models. Labelling educational data has traditionally relied on highly…

Computation and Language · Computer Science 2023-11-10 Owen Henkel , Libby Hills

The increasing use of Artificial Intelligence (AI) by students in learning presents new challenges for assessing their learning outcomes in project-based learning (PBL). This paper introduces a co-design study to explore the potential of…

Human-Computer Interaction · Computer Science 2024-01-30 Chengbo Zheng , Kangyu Yuan , Bingcan Guo , Reza Hadi Mogavi , Zhenhui Peng , Shuai Ma , Xiaojuan Ma

Behavioral analysis of tutoring dialogues is essential for understanding student learning, yet manual coding remains a bottleneck. We present a methodology where LLM coding agents autonomously improve the prompts used by LLM classifiers to…

Human-Computer Interaction · Computer Science 2026-03-31 Eason Chen , Isabel Wang , Nina Yuan , Sophia Judicke , Kayla Beigh , Xinyi Tang

Educational games can foster critical thinking, problem-solving, and motivation, yet instructors often find it difficult to design games that reliably achieve specific learning outcomes. Existing authoring environments reduce the need for…

Human-Computer Interaction · Computer Science 2026-03-05 Daijin Yang , Erica Kleinman , Casper Harteveld

As generative AI models, particularly large language models (LLMs), transform educational feedback practices in higher education (HE) contexts, understanding students' perceptions of different sources of feedback becomes crucial for their…

Human-Computer Interaction · Computer Science 2025-08-13 Audrey Zhang , Yifei Gao , Wannapon Suraworachet , Tanya Nazaretsky , Mutlu Cukurova

The landscape of education is changing rapidly, shaped by emerging pedagogical approaches, technological innovations such as artificial intelligence (AI), and evolving societal expectations, all of which demand thorough evaluation of new…

Computers and Society · Computer Science 2026-03-19 Fiammetta Caccavale , Carina L. Gargalo , Julian Kager , Magdalena Skowyra , Steen Larsen , Krist V. Gernaey , Ulrich Krühne

Course evaluation plays a critical role in ensuring instructional quality and guiding curriculum development in higher education. However, traditional evaluation methods, such as student surveys, classroom observations, and expert reviews,…

Computation and Language · Computer Science 2025-12-29 Bo Yuan , Jiazi Hu