English
Related papers

Related papers: Evaluating GPT-4 at Grading Handwritten Solutions …

200 papers

We evaluate the effectiveness of GPT-4 Turbo in generating educational questions from NCERT textbooks in zero-shot mode. Our study highlights GPT-4 Turbo's ability to generate questions that require higher-order thinking skills, especially…

Computation and Language · Computer Science 2024-06-24 Subhankar Maity , Aniket Deroy , Sudeshna Sarkar

Sudden access to the rapidly improving large language model GPT by open-ai forces educational institutions worldwide to revisit their exam procedures. In the pre-GPT era, we successfully applied oral and open-book home exams for two courses…

Computers and Society · Computer Science 2023-05-04 Felix Dobslaw , Peter Bergh

Automatic essay grading (AEG) has attracted the the attention of the NLP community because of its applications to several educational applications, such as scoring essays, short answers, etc. AEG systems can save significant time and money…

Computation and Language · Computer Science 2024-10-15 Maisha Maliha , Vishal Pramanik

In courses that involve programming assignments, giving meaningful feedback to students is an important challenge. Human beings can give useful feedback by manually grading the programs but this is a time-consuming, labor intensive, and…

Programming Languages · Computer Science 2020-10-19 Joshua Clune , Vijay Ramamurthy , Ruben Martins , Umut A. Acar

Generative Artificial Intelligence (AI) is revolutionizing educational technology by enabling highly personalized and adaptive learning environments within Intelligent Tutoring Systems (ITS). This report delves into the integration of…

Computation and Language · Computer Science 2024-10-15 Subhankar Maity , Aniket Deroy

The development in Artificial Intelligence (AI) offers transformative potential for redefining student assessment methodologies. This paper aims to establish the idea of the advancement of Artificial Intelligence (AI) and its prospect in…

Computers and Society · Computer Science 2025-03-10 Pushpalatha K S , Abhishek Mangalur , Ketan Hegde , Chetan Badachi , Mohammad Aamir

Large Language Models (LLMs) show promise for automated grading, but their outputs can be unreliable. Rather than improving grading accuracy directly, we address a complementary problem: \textit{predicting when an LLM grader is likely to be…

Computation and Language · Computer Science 2026-04-01 Robinson Ferrer , Damla Turgut , Zhongzhou Chen , Shashank Sonkar

We evaluated the capability of generative pre-trained transformers~(GPT-4) in analysis of textual data in tasks that require highly specialized domain expertise. Specifically, we focused on the task of analyzing court opinions to interpret…

Computation and Language · Computer Science 2023-10-05 Jaromir Savelka , Kevin D. Ashley , Morgan A Gray , Hannes Westermann , Huihui Xu

Generative AI and large language models have the potential to drastically improve the landscape of computing education by automatically generating personalized feedback and content. Recent works have studied the capabilities of these models…

Machine Learning · Computer Science 2023-08-08 Adish Singla

Recent advances in multimodal large language models (MLLMs) raise the question of their potential for grading, analyzing, and offering feedback on handwritten student classwork. This capability would be particularly beneficial in elementary…

Computer Vision and Pattern Recognition · Computer Science 2025-10-08 Owen Henkel , Bill Roberts , Doug Jaffe , Laurence Holt

While large language models (LLMs) have been used for automated grading, they have not yet achieved the same level of performance as humans, especially when it comes to grading complex questions. Existing research on this topic focuses on a…

Artificial Intelligence · Computer Science 2024-05-31 Wenjing Xie , Juxin Niu , Chun Jason Xue , Nan Guan

While Large Language Models (LLMs) are increasingly envisioned as intelligent assistants for personalized learning, systematic head-to-head evaluations in authentic learning scenarios remain scarce. This study presents an empirical…

Artificial Intelligence · Computer Science 2025-10-23 Bo Yuan , Jiazi Hu

The widespread availability of generative artificial intelligence tools poses new challenges for school mathematics education, particularly regarding the formative role of traditional mathematical tasks. In post-AI educational contexts,…

History and Overview · Mathematics 2026-02-11 Felix De la Cruz Serrano

This study aimed to determine if ChatGPT's large language models could match the scoring accuracy of human and machine scores from the ASAP competition. The investigation focused on various prediction models, including linear regression,…

Computation and Language · Computer Science 2024-08-20 Mark D. Shermis

Data augmentation can mitigate limited training data in machine-learning automated scoring engines for constructed response items. This study seeks to determine how well three approaches to large language model prompting produce essays that…

Machine Learning · Computer Science 2026-02-09 Edward W. Wolfe , Justin O. Barber

This work delved into the realm of automatic text generation, exploring a variety of techniques ranging from traditional deterministic approaches to more modern stochastic methods. Through analysis of greedy search, beam search, top-k…

Computation and Language · Computer Science 2024-04-03 Rohit Pandey , Hetvi Waghela , Sneha Rakshit , Aparna Rangari , Anjali Singh , Rahul Kumar , Ratnadeep Ghosal , Jaydip Sen

A college education historically has been seen as method of moving upward with regards to income brackets and social status. Indeed, many colleges recognize this connection and seek to enroll talented low income students. While these…

Other Statistics · Statistics 2024-12-18 Monnie McGee , Bivin Sadler

AI-powered education technologies can support students and teachers in computer science education. However, with the recent developments in generative AI, and especially the increasingly emerging popularity of ChatGPT, the effectiveness of…

Artificial Intelligence · Computer Science 2023-12-05 Nora Dunder , Saga Lundborg , Olga Viberg , Jacqueline Wong

This study evaluates the potential of ChatGPT-4, an artificial intelligence language model developed by OpenAI, as an editing tool for Spanish literary and academic books. The need for efficient and accessible reviewing and editing…

Artificial Intelligence · Computer Science 2023-09-21 Jonnathan Berrezueta-Guzman , Laura Malache-Silva , Stephan Krusche