English
Related papers

Related papers: Evaluating LLMs for Answering Student Questions in…

200 papers

Large Language Models possess skills such as answering questions, writing essays or solving programming exercises. Since these models are easily accessible, researchers have investigated their capabilities and risks for programming…

Computers and Society · Computer Science 2023-12-19 Lianne Roest , Hieke Keuning , Johan Jeuring

Intelligent tutoring systems have demonstrated effectiveness in teaching formal propositional logic proofs, but their reliance on template-based explanations limits their ability to provide personalized student feedback. While large…

Artificial Intelligence · Computer Science 2025-11-24 Sutapa Dey Tithi , Arun Kumar Ramesh , Clara DiMarco , Xiaoyi Tian , Nazia Alam , Kimia Fazeli , Tiffany Barnes

Ever since Large Language Models (LLMs) and related applications have become broadly available, several studies investigated their potential for assisting educators and supporting students in higher education. LLMs such as Codex, GPT-3.5,…

Artificial Intelligence · Computer Science 2024-07-08 Imen Azaiz , Natalie Kiesler , Sven Strickroth

This study investigates how K-12 educators use generative AI tools in real-world instructional contexts and how large language models (LLMs) can support scalable qualitative analysis of these interactions. Drawing on over 13,000 unscripted…

Human-Computer Interaction · Computer Science 2025-12-17 Alex Liu , Lief Esbenshade , Shawon Sarkar , Victor Tian , Zachary Zhang , Kevin He , Min Sun

Integration of Large Language Models (LLMs) with Learning Management Systems (LMSs) can enhance task automation and accessibility in education. However, hallucination where LLMs generate inaccurate or misleading information remains a…

Computers and Society · Computer Science 2025-11-14 Kovan Mzwri , Márta Turcsányi-Szabo

As research in large language models (LLMs) continues to accelerate, LLM-based evaluation has emerged as a scalable and cost-effective alternative to human evaluations for comparing the ever increasing list of models. This paper…

Computation and Language · Computer Science 2024-04-17 Zhiyuan Zeng , Jiatong Yu , Tianyu Gao , Yu Meng , Tanya Goyal , Danqi Chen

Large Language Models (LLMs) represent a leap in artificial intelligence, excelling in tasks using human language(s). Although the main focus of general-purpose LLMs is not code generation, they have shown promising results in the domain.…

Software Engineering · Computer Science 2024-01-30 Sanka Rasnayaka , Guanlin Wang , Ridwan Shariffdeen , Ganesh Neelakanta Iyer

The advent of Large Language Models (LLMs) has brought in a new era of possibilities in the realm of education. This survey paper summarizes the various technologies of LLMs in educational settings from multifaceted perspectives,…

Computation and Language · Computer Science 2024-04-03 Shen Wang , Tianlong Xu , Hang Li , Chaoli Zhang , Joleen Liang , Jiliang Tang , Philip S. Yu , Qingsong Wen

Large language models (LLMs) are increasingly being explored in higher education, yet their effectiveness as teaching agents remains underexamined. In this paper, we present the development of GuideLM, a fine-tuned LLM designed for…

Computation and Language · Computer Science 2025-03-03 Emily Ross , Yuval Kansal , Jake Renzella , Alexandra Vassar , Andrew Taylor

Large Language Models (LLMs) are increasingly used as proxy students in the development of Intelligent Tutoring Systems (ITSs) and in piloting test questions. However, to what extent these proxy students accurately emulate the behavior and…

Computation and Language · Computer Science 2025-07-14 KV Aditya Srivatsa , Kaushal Kumar Maurya , Ekaterina Kochmar

Evaluating open-ended written examination responses from students is an essential yet time-intensive task for educators, requiring a high degree of effort, consistency, and precision. Recent developments in Large Language Models (LLMs)…

Computation and Language · Computer Science 2024-05-10 Jussi S. Jauhiainen , Agustín Garagorry Guerra

Large language models (LLMs) are rapidly transforming knowledge work by improving the quality and efficiency of tasks such as writing, coding, and data analysis. However, their growing use in education has exposed a learning-performance…

While recent efforts have begun integrating large language models (LLMs) into English education, they often rely on traditional approaches to learning tasks without fully embracing educational methodologies, thus lacking adaptability to…

Computation and Language · Computer Science 2025-09-09 Jingheng Ye , Shen Wang , Deqing Zou , Yibo Yan , Kun Wang , Hai-Tao Zheng , Ruitong Liu , Zenglin Xu , Irwin King , Philip S. Yu , Qingsong Wen

Large Language Models (LLMs) are transforming scholarly tasks like search and summarization, but their reliability remains uncertain. Current evaluation metrics for testing LLM reliability are primarily automated approaches that prioritize…

Human-Computer Interaction · Computer Science 2026-02-25 Anna Martin-Boyle , William Humphreys , Martha Brown , Cara Leckey , Harmanpreet Kaur

The progress of Large Language Models (LLMs) like ChatGPT raises the question of how they can be integrated into education. One hope is that they can support mathematics learning, including word-problem solving. Since LLMs can handle…

Computation and Language · Computer Science 2025-08-12 Anselm R. Strohmaier , Wim Van Dooren , Kathrin Seßler , Brian Greer , Lieven Verschaffel

The use of LLM tutors to provide automated educational feedback to students on student assignment submissions has received much attention in the AI in Education field. However, the stochastic nature and tendency for hallucinations in LLMs…

Computers and Society · Computer Science 2025-08-11 Keyang Qian , Yixin Cheng , Rui Guan , Wei Dai , Flora Jin , Kaixun Yang , Sadia Nawaz , Zachari Swiecki , Guanliang Chen , Lixiang Yan , Dragan Gašević

The proliferation of Large Language Models (LLMs), such as ChatGPT, has raised concerns about their potential impact on academic integrity, prompting the need for LLM-resistant exam designs. This article investigates the performance of LLMs…

Computation and Language · Computer Science 2023-04-25 Simon kaare Larsen

The rapid development of Large Language Models (LLMs) opens up the possibility of using them as personal tutors. This has led to the development of several intelligent tutoring systems and learning assistants that use LLMs as back-ends with…

Emerging Technologies · Computer Science 2025-06-11 Sankalan Pal Chowdhury , Terry Jingchen Zhang , Donya Rooein , Dirk Hovy , Tanja Käser , Mrinmaya Sachan

Recent advances in generative AI have led to remarkable interest in using systems that rely on large language models (LLMs) for practical applications. However, meaningful evaluation of these systems in real-world scenarios comes with a…

Artificial Intelligence · Computer Science 2025-07-22 Ethan M. Rudd , Christopher Andrews , Philip Tully

Large Language Models (LLMs), such as GPT-4, have demonstrated impressive mathematical reasoning capabilities, achieving near-perfect performance on benchmarks like GSM8K. However, their application in personalized education remains limited…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Yi-Fan Zhang , Hang Li , Dingjie Song , Lichao Sun , Tianlong Xu , Qingsong Wen