English
Related papers

Related papers: Using Large Language Models to Assess Tutors' Perf…

200 papers

Large language models (LLMs) have been proposed as scalable tools to address the gap between the importance of individualized written feedback and the practical challenges of providing it at scale. However, concerns persist regarding the…

Other Statistics · Statistics 2025-11-12 Niklas Ippisch , Markus Herklotz , Anna-Carolina Haensch , Carsten Schwemmer

The accurate classification of student help requests with respect to the type of help being sought can enable the tailoring of effective responses. Automatically classifying such requests is non-trivial, but large language models (LLMs)…

Computers and Society · Computer Science 2023-11-01 Jaromir Savelka , Paul Denny , Mark Liffiton , Brad Sheese

Scaling high-quality tutoring remains a major challenge in education. Due to growing demand, many platforms employ novice tutors who, unlike experienced educators, struggle to address student mistakes and thus fail to seize prime learning…

Computation and Language · Computer Science 2024-04-09 Rose E. Wang , Qingyang Zhang , Carly Robinson , Susanna Loeb , Dorottya Demszky

One-to-one tutoring is one of the most efficient methods of teaching. With the growing popularity of Large Language Models (LLMs), there have been efforts to create LLM based conversational tutors which can expand the benefits of one to one…

Human-Computer Interaction · Computer Science 2025-03-20 Romain Puech , Jakub Macina , Julia Chatain , Mrinmaya Sachan , Manu Kapur

Ever since the emergence of large language models (LLMs) and related applications, such as ChatGPT, its performance and error analysis for programming tasks have been subject to research. In this work-in-progress paper, we explore the…

Artificial Intelligence · Computer Science 2023-09-04 Natalie Kiesler , Dominic Lohr , Hieke Keuning

Timely formative feedback is considered as one of the most important drivers for effective learning. Delivering timely and individualized feedback is particularly challenging in large classes in higher education. Recently Large Language…

Computers and Society · Computer Science 2023-12-15 Imen Azaiz , Oliver Deckarm , Sven Strickroth

The evolving pedagogy paradigms are leading toward educational transformations. One fundamental aspect of effective learning is relevant, immediate, and constructive feedback to students. Providing constructive feedback to large cohorts in…

Computers and Society · Computer Science 2025-10-14 Javed Ali Khan , Muhammad Yaqoob , Mamoona Tasadduq , Hafsa Shareef Dar , Aitezaz Ahsan

Generative artificial intelligences, particularly large language models (LLMs), play an increasingly prominent role in human decision-making contexts, necessitating transparency about their capabilities. While prior studies have shown…

Computation and Language · Computer Science 2026-01-30 Lydia Uhler , Verena Jordan , Jürgen Buder , Markus Huff , Frank Papenmeier

Large language models (LLMs) built on existing reinforcement learning with human feedback (RLHF) frameworks typically optimize responses based on immediate turn-level human preferences. However, this approach falls short in multi-turn…

Computation and Language · Computer Science 2025-07-23 Hyunji Nam , Omer Gottesman , Amy Zhang , Dean Foster , Emma Brunskill , Lyle Ungar

This study investigates the application of large language models, specifically GPT-4, to enhance programming education. The research outlines the design of a web application that uses GPT-4 to provide feedback on programming tasks, without…

Computation and Language · Computer Science 2024-07-19 Sven Jacobs , Steffen Jaschke

While automatic dialogue tutors hold great potential in making education personalized and more accessible, research on such systems has been hampered by a lack of sufficiently large and high-quality datasets. Collecting such datasets…

Computation and Language · Computer Science 2023-10-24 Jakub Macina , Nico Daheim , Sankalan Pal Chowdhury , Tanmay Sinha , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

This paper provides an in-depth evaluation of three state-of-the-art Large Language Models (LLMs) for personalized career mentoring in the computing field, using three distinct student profiles that consider gender, race, and professional…

Computation and Language · Computer Science 2024-12-16 Xiao Luo , Sean O'Connell , Shamima Mithun

Large Language Models (LLMs) have found several use cases in education, ranging from automatic question generation to essay evaluation. In this paper, we explore the potential of using Large Language Models (LLMs) to author Intelligent…

Computation and Language · Computer Science 2024-04-26 Sankalan Pal Chowdhury , Vilém Zouhar , Mrinmaya Sachan

The effectiveness of feedback in enhancing learning outcomes is well documented within Educational Data Mining (EDM). Various prior research has explored methodologies to enhance the effectiveness of feedback. Recent developments in Large…

Computers and Society · Computer Science 2024-11-15 Sami Baral , Eamon Worden , Wen-Chiang Lim , Zhuang Luo , Christopher Santorelli , Ashish Gurung , Neil Heffernan

Effective collaboration requires groups to strategically regulate themselves to overcome challenges. Research has shown that groups may fail to regulate due to differences in members' perceptions of challenges which may benefit from…

Computation and Language · Computer Science 2024-01-04 Wannapon Suraworachet , Jennifer Seon , Mutlu Cukurova

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment formats utilizing LLMs…

Software Engineering · Computer Science 2023-08-21 Natalie Kiesler , Daniel Schiffner

Large Multimodal Models (LMMs) have demonstrated exceptional performance across a wide range of domains. This paper explores their potential in pronunciation assessment tasks, with a particular focus on evaluating the capabilities of the…

Sound · Computer Science 2025-03-17 Ke Wang , Lei He , Kun Liu , Yan Deng , Wenning Wei , Sheng Zhao

Large Language Model (LLM) simulations, where LLMs act as students with varying approaches to learning tasks, can support teachers' noticing of student thinking. However, simulations using zero- or few-shot prompting often yield inauthentic…

Human-Computer Interaction · Computer Science 2026-04-07 Jie Cao , Ha Nguyen , Selim Yavuz , Boran Yu , Shuguang Wang , Pavneet Kaur Bharaj , Dionne Cross Francis

Advances in large language models (LLMs) enable many new innovations in education. However, evaluating the effectiveness of new technology requires real students, which is time-consuming and hard to scale up. Therefore, many recent works on…

Computation and Language · Computer Science 2026-05-06 Alexander Scarlatos , Jaewook Lee , Simon Woodhead , Andrew Lan

In this paper, we investigate whether current state-of-the-art large language models (LLMs) are effective as AI tutors and whether they demonstrate pedagogical abilities necessary for good AI tutoring in educational dialogues. Previous…

Computation and Language · Computer Science 2025-02-11 Kaushal Kumar Maurya , KV Aditya Srivatsa , Kseniia Petukhova , Ekaterina Kochmar