English
Related papers

Related papers: Integrating Large Language Models and Evaluating S…

200 papers

Evaluating teaching effectiveness at scale remains a persistent challenge for large universities, particularly within engineering programs that enroll tens of thousands of students. Traditional methods, such as manual review of student…

Computers and Society · Computer Science 2025-08-06 Jean-Francois Chamberland , Martin C. Carlisle , Arul Jayaraman , Krishna R. Narayanan , Sunay Palsole , Karan Watson

Large Language Models (LLMs) have been subject to extensive research in the past few years. This is particularly true for the potential of LLMs to generate formative programming feedback for novice learners at university. In contrast to…

Computers and Society · Computer Science 2025-04-03 Imen Azaiz , Natalie Kiesler , Sven Strickroth , Anni Zhang

Help-seeking is a critical way for students to learn new concepts, acquire new skills, and get unstuck when problem-solving in their computing courses. The recent proliferation of generative AI tools, such as ChatGPT, offers students a new…

Human-Computer Interaction · Computer Science 2024-01-05 Irene Hou , Sophia Metille , Zhuo Li , Owen Man , Cynthia Zastudil , Stephen MacNeil

An advantage of Large Language Models (LLMs) is their contextualization capability - providing different responses based on student inputs like solution strategy or prior discussion, to potentially better engage students than standard…

Large language models (LLMs) are increasingly embedded in AI-based tutoring systems. Can they faithfully model novice reasoning and metacognitive judgments? Existing evaluations emphasize problem-solving accuracy, overlooking the fragmented…

Computation and Language · Computer Science 2026-05-12 Conrad Borchers , Jill-Jênn Vie , Roger Azevedo

Despite universal GenAI adoption, students cannot distinguish task performance from actual learning and lack skills to leverage AI for learning, leading to worse exam performance when AI use remains unreflective. Yet few interventions…

Human-Computer Interaction · Computer Science 2026-02-19 Ruiwei Xiao , Runlong Ye , Xinying Hou , Jessica Wen , Harsh Kumar , Michael Liut , John Stamper

Artificial Intelligence (AI) holds transformative potential in education, enabling personalized learning, enhancing inclusivity, and encouraging creativity and curiosity. In this paper, we explore how Large Language Models (LLMs) can act as…

Computers and Society · Computer Science 2026-05-18 Eleonora Grassucci , Gualtiero Grassucci , Aurelio Uncini , Danilo Comminiello

Providing personalized assistance at scale is a long-standing challenge for computing educators, but a new generation of tools powered by large language models (LLMs) offers immense promise. Such tools can, in theory, provide on-demand help…

Computers and Society · Computer Science 2024-01-09 Brad Sheese , Mark Liffiton , Jaromir Savelka , Paul Denny

The adoption of large language models (LLMs) and autonomous agents in software engineering marks an enduring paradigm shift. These systems create new opportunities for tool design, workflow orchestration, and empirical observation, while…

Software Engineering · Computer Science 2025-11-04 Christoph Treude , Margaret-Anne Storey

Self-reflection on learning experiences constitutes a fundamental cognitive process, essential for the consolidation of knowledge and the enhancement of learning efficacy. However, traditional methods to facilitate reflection often face…

The recent release of very large language models such as PaLM and GPT-4 has made an unprecedented impact in the popular media and public consciousness, giving rise to a mixture of excitement and fear as to their capabilities and potential…

The adoption of generative AI and large language models (LLMs) in education is still emerging. In this study, we explore the development and evaluation of AI teaching assistants that provide curriculum-based guidance using a…

Computation and Language · Computer Science 2025-10-06 Konstantinos Katharakis , Sippo Rossi , Raghava Rao Mukkamala

In the rapidly evolving landscape of artificial intelligence (AI), generative large language models (LLMs) stand at the forefront, revolutionizing how we interact with our data. However, the computational intensity and memory consumption of…

Machine Learning · Computer Science 2025-07-24 Xupeng Miao , Gabriele Oliaro , Zhihao Zhang , Xinhao Cheng , Hongyi Jin , Tianqi Chen , Zhihao Jia

K-12 educators are increasingly using Large Language Models (LLMs) to create instructional materials. These systems excel at producing fluent, coherent content, but often lack support for high-quality teaching. The reason is twofold: first,…

Computers and Society · Computer Science 2025-08-26 Jiayi Wang , Ruiwei Xiao , Xinying Hou , John Stamper

Large Language Models (LLMs) have been widely applied to student-facing educational tools, this work explores their use in supporting instructors by presenting a practical adaptation of the Framework for Adaptive Content using Educational…

Human-Computer Interaction · Computer Science 2026-05-01 Franco Ortiz , Runlong Ye , Michael Liut

This study explores the integration of Large Language Models (LLMs) into the grading and appeal resolution process in computer science education. We introduce AI-PAT, an AI-powered assessment tool that leverages LLMs to evaluate computer…

Human-Computer Interaction · Computer Science 2025-04-21 I. Aytutuldu , O. Yol , Y. S. Akgul

Modern software systems are subjected to various types of uncertainties arising from context, environment, etc. To this end, self-adaptation techniques have been sought out as potential solutions. Although recent advances in self-adaptation…

Software Engineering · Computer Science 2024-04-16 Raghav Donakanti , Prakhar Jain , Shubham Kulkarni , Karthik Vaidhyanathan

The rapid evolution of Large Language Models (LLMs) has made them powerful tools for enhancing student writing. This study explores the extent and limitations of LLMs in assisting secondary-level English as a Foreign Language (EFL) students…

Human-Computer Interaction · Computer Science 2026-04-20 Hengky Susanto , David James Woo , Chingyi Yeung , Stephanie Wing Yan Lo-Philip , Chi Ho Yeung

Background: Feedback as one of the most influential factors for learning has been subject to a great body of research. It plays a key role in the development of educational technology systems and is traditionally rooted in deterministic…

Artificial Intelligence · Computer Science 2024-12-05 Dominic Lohr , Hieke Keuning , Natalie Kiesler

Providing students with individualized feedback through assignments is a cornerstone of education that supports their learning and development. Studies have shown that timely, high-quality feedback plays a critical role in improving…

Machine Learning · Computer Science 2025-01-27 Pavlin G. Poličar , Martin Špendl , Tomaž Curk , Blaž Zupan