English
Related papers

Related papers: Assessing Large Language Models for Automated Feed…

200 papers

Large language models (LLMs) present an opportunity to scale high-quality personalized education to all. A promising approach towards this means is to build dialog tutoring models that scaffold students' problem-solving. However, even…

Computation and Language · Computer Science 2024-07-15 Nico Daheim , Jakub Macina , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

The increasing reliance on Large Language Models (LLMs) across various domains extends to education, where students progressively use generative AI as a tool for learning. While prior work has examined LLMs' mathematical ability, their…

Computation and Language · Computer Science 2026-01-21 Wei-Ling Hsu , Yu-Chien Tang , An-Zi Yen

Feedback is one of the most crucial components to facilitate effective learning. With the rise of large language models (LLMs) in recent years, research in programming education has increasingly focused on automated feedback generation to…

Computers and Society · Computer Science 2025-09-05 Niklas Scholz , Manh Hung Nguyen , Adish Singla , Tomohiro Nagashima

Large language models (LLMs) have demonstrated the ability to generate formative feedback and instructional hints in English, making them increasingly relevant for AI-assisted education. However, their ability to provide effective…

Computation and Language · Computer Science 2025-06-06 Junior Cedric Tonga , KV Aditya Srivatsa , Kaushal Kumar Maurya , Fajri Koto , Ekaterina Kochmar

Identifying and resolving logic errors can be one of the most frustrating challenges for novices programmers. Unlike syntax errors, for which a compiler or interpreter can issue a message, logic errors can be subtle. In certain conditions,…

Human-Computer Interaction · Computer Science 2023-11-28 Stephen MacNeil , Paul Denny , Andrew Tran , Juho Leinonen , Seth Bernstein , Arto Hellas , Sami Sarsa , Joanne Kim

The effectiveness of feedback in enhancing learning outcomes is well documented within Educational Data Mining (EDM). Various prior research has explored methodologies to enhance the effectiveness of feedback. Recent developments in Large…

Computers and Society · Computer Science 2024-11-15 Sami Baral , Eamon Worden , Wen-Chiang Lim , Zhuang Luo , Christopher Santorelli , Ashish Gurung , Neil Heffernan

The sudden emergence of large language models (LLMs) such as ChatGPT has had a disruptive impact throughout the computing education community. LLMs have been shown to excel at producing correct code to CS1 and CS2 problems, and can even act…

Artificial Intelligence · Computer Science 2024-09-30 Eddie Antonio Santos , Brett A. Becker

The impressive performance of Large Language Models (LLMs) has consistently surpassed numerous human-designed benchmarks, presenting new challenges in assessing the shortcomings of LLMs. Designing tasks and finding LLMs' limitations are…

Computation and Language · Computer Science 2024-10-02 Yulong Chen , Yang Liu , Jianhao Yan , Xuefeng Bai , Ming Zhong , Yinghao Yang , Ziyi Yang , Chenguang Zhu , Yue Zhang

The emergence of large language models (LLMs) has transformed research and practice across a wide range of domains. Within the computing education research (CER) domain, LLMs have garnered significant attention, particularly in the context…

Artificial Intelligence · Computer Science 2024-11-25 Charles Koutcheme , Nicola Dainese , Arto Hellas , Sami Sarsa , Juho Leinonen , Syed Ashraf , Paul Denny

Large Language Models (LLMs) have recently been widely used for code generation. Due to the complexity and opacity of LLMs, little is known about how these models generate code. We made the first attempt to bridge this knowledge gap by…

Software Engineering · Computer Science 2024-05-24 Bonan Kou , Shengmai Chen , Zhijie Wang , Lei Ma , Tianyi Zhang

The automatic generation of hints by Large Language Models (LLMs) within Intelligent Tutoring Systems (ITSs) has shown potential to enhance student learning. However, generating pedagogically sound hints that address student misconceptions…

Computation and Language · Computer Science 2024-11-07 Junior Cedric Tonga , Benjamin Clement , Pierre-Yves Oudeyer

Large Language Models have introduced new possibilities for programming education through personalized support, content creation, and automated feedback. While recent studies have demonstrated the potential for feedback generation, many…

Software Engineering · Computer Science 2026-05-14 Smitha S Kumar , Michael A Lones , Manuel Maarek , Hind Zantout

The role of Large Language Models (LLMs) has not been extensively explored in analog circuit design, which could benefit from a reasoning-based approach that transcends traditional optimization techniques. In particular, despite their…

Machine Learning · Computer Science 2025-02-13 Lejla Skelic , Yan Xu , Matthew Cox , Wenjie Lu , Tao Yu , Ruonan Han

Researchers have made notable progress in applying Large Language Models (LLMs) to solve math problems, as demonstrated through efforts like GSM8k, ProofNet, AlphaGeometry, and MathOdyssey. This progress has sparked interest in their…

Human-Computer Interaction · Computer Science 2025-03-24 Adit Gupta , Jennifer Reddig , Tommaso Calo , Daniel Weitekamp , Christopher J. MacLellan

Large Language Models (LLMs) have advanced rapidly as tools for automating code generation in scientific research, yet their ability to interpret and use unfamiliar Python APIs for complex computational experiments remains poorly…

Software Engineering · Computer Science 2025-09-17 Nuno Fachada , Daniel Fernandes , Carlos M. Fernandes , Bruno D. Ferreira-Saraiva , João P. Matos-Carvalho

Educational interventions are effective tools for enhancing student learning. While Large Language Models (LLMs) allow for generating adaptive feedback at scale, current studies lack clear methodologies for providing Just-in-Time (JiT)…

Computation and Language · Computer Science 2026-05-27 Younghun Lee , Amir Bralin , Nobel Sanjay Rebello , Dan Goldwasser

This paper presents a comprehensive performance evaluation of Large Language Models (LLMs) in solving programming challenges from Leetcode, a widely used platform for algorithm practice and technical interviews. We began by crawling the…

Software Engineering · Computer Science 2025-03-04 Lun Wang , Chuanqi Shi , Shaoshui Du , Yiyi Tao , Yixian Shen , Hang Zheng , Yanxin Shen , Xinyu Qiu

Making errors is part of the programming process -- even for the most seasoned professionals. Novices in particular are bound to make many errors while learning. It is well known that traditional (compiler/interpreter) programming error…

Software Engineering · Computer Science 2025-01-13 Audrey Salmon , Katie Hammer , Eddie Antonio Santos , Brett A. Becker

The adoption of generative AI and large language models (LLMs) in education is still emerging. In this study, we explore the development and evaluation of AI teaching assistants that provide curriculum-based guidance using a…

Computation and Language · Computer Science 2025-10-06 Konstantinos Katharakis , Sippo Rossi , Raghava Rao Mukkamala

Large Language Models (LLMs) are increasingly used by undergraduate students as on-demand tutors, yet their reliability on circuit- and diagram-based digital logic problems remains unclear. We present a human- AI study evaluating three…

Hardware Architecture · Computer Science 2026-02-18 Yogeswar Reddy Thota , Setareh Rafatirad , Homayoun Houman , Tooraj Nikoubin