中文
相关论文

相关论文: Using Large Language Models to Assess Tutors' Perf…

200 篇论文

Large language models (LLMs) have been proposed as scalable tools to address the gap between the importance of individualized written feedback and the practical challenges of providing it at scale. However, concerns persist regarding the…

其他统计学 · 统计学 2025-11-12 Niklas Ippisch , Markus Herklotz , Anna-Carolina Haensch , Carsten Schwemmer

The accurate classification of student help requests with respect to the type of help being sought can enable the tailoring of effective responses. Automatically classifying such requests is non-trivial, but large language models (LLMs)…

计算机与社会 · 计算机科学 2023-11-01 Jaromir Savelka , Paul Denny , Mark Liffiton , Brad Sheese

Scaling high-quality tutoring remains a major challenge in education. Due to growing demand, many platforms employ novice tutors who, unlike experienced educators, struggle to address student mistakes and thus fail to seize prime learning…

计算与语言 · 计算机科学 2024-04-09 Rose E. Wang , Qingyang Zhang , Carly Robinson , Susanna Loeb , Dorottya Demszky

One-to-one tutoring is one of the most efficient methods of teaching. With the growing popularity of Large Language Models (LLMs), there have been efforts to create LLM based conversational tutors which can expand the benefits of one to one…

人机交互 · 计算机科学 2025-03-20 Romain Puech , Jakub Macina , Julia Chatain , Mrinmaya Sachan , Manu Kapur

Ever since the emergence of large language models (LLMs) and related applications, such as ChatGPT, its performance and error analysis for programming tasks have been subject to research. In this work-in-progress paper, we explore the…

人工智能 · 计算机科学 2023-09-04 Natalie Kiesler , Dominic Lohr , Hieke Keuning

Timely formative feedback is considered as one of the most important drivers for effective learning. Delivering timely and individualized feedback is particularly challenging in large classes in higher education. Recently Large Language…

计算机与社会 · 计算机科学 2023-12-15 Imen Azaiz , Oliver Deckarm , Sven Strickroth

The evolving pedagogy paradigms are leading toward educational transformations. One fundamental aspect of effective learning is relevant, immediate, and constructive feedback to students. Providing constructive feedback to large cohorts in…

计算机与社会 · 计算机科学 2025-10-14 Javed Ali Khan , Muhammad Yaqoob , Mamoona Tasadduq , Hafsa Shareef Dar , Aitezaz Ahsan

Generative artificial intelligences, particularly large language models (LLMs), play an increasingly prominent role in human decision-making contexts, necessitating transparency about their capabilities. While prior studies have shown…

计算与语言 · 计算机科学 2026-01-30 Lydia Uhler , Verena Jordan , Jürgen Buder , Markus Huff , Frank Papenmeier

Large language models (LLMs) built on existing reinforcement learning with human feedback (RLHF) frameworks typically optimize responses based on immediate turn-level human preferences. However, this approach falls short in multi-turn…

计算与语言 · 计算机科学 2025-07-23 Hyunji Nam , Omer Gottesman , Amy Zhang , Dean Foster , Emma Brunskill , Lyle Ungar

This study investigates the application of large language models, specifically GPT-4, to enhance programming education. The research outlines the design of a web application that uses GPT-4 to provide feedback on programming tasks, without…

计算与语言 · 计算机科学 2024-07-19 Sven Jacobs , Steffen Jaschke

While automatic dialogue tutors hold great potential in making education personalized and more accessible, research on such systems has been hampered by a lack of sufficiently large and high-quality datasets. Collecting such datasets…

计算与语言 · 计算机科学 2023-10-24 Jakub Macina , Nico Daheim , Sankalan Pal Chowdhury , Tanmay Sinha , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

This paper provides an in-depth evaluation of three state-of-the-art Large Language Models (LLMs) for personalized career mentoring in the computing field, using three distinct student profiles that consider gender, race, and professional…

计算与语言 · 计算机科学 2024-12-16 Xiao Luo , Sean O'Connell , Shamima Mithun

Large Language Models (LLMs) have found several use cases in education, ranging from automatic question generation to essay evaluation. In this paper, we explore the potential of using Large Language Models (LLMs) to author Intelligent…

计算与语言 · 计算机科学 2024-04-26 Sankalan Pal Chowdhury , Vilém Zouhar , Mrinmaya Sachan

The effectiveness of feedback in enhancing learning outcomes is well documented within Educational Data Mining (EDM). Various prior research has explored methodologies to enhance the effectiveness of feedback. Recent developments in Large…

计算机与社会 · 计算机科学 2024-11-15 Sami Baral , Eamon Worden , Wen-Chiang Lim , Zhuang Luo , Christopher Santorelli , Ashish Gurung , Neil Heffernan

Effective collaboration requires groups to strategically regulate themselves to overcome challenges. Research has shown that groups may fail to regulate due to differences in members' perceptions of challenges which may benefit from…

计算与语言 · 计算机科学 2024-01-04 Wannapon Suraworachet , Jennifer Seon , Mutlu Cukurova

This paper investigates the performance of the Large Language Models (LLMs) ChatGPT-3.5 and GPT-4 in solving introductory programming tasks. Based on the performance, implications for didactic scenarios and assessment formats utilizing LLMs…

软件工程 · 计算机科学 2023-08-21 Natalie Kiesler , Daniel Schiffner

Large Multimodal Models (LMMs) have demonstrated exceptional performance across a wide range of domains. This paper explores their potential in pronunciation assessment tasks, with a particular focus on evaluating the capabilities of the…

声音 · 计算机科学 2025-03-17 Ke Wang , Lei He , Kun Liu , Yan Deng , Wenning Wei , Sheng Zhao

Large Language Model (LLM) simulations, where LLMs act as students with varying approaches to learning tasks, can support teachers' noticing of student thinking. However, simulations using zero- or few-shot prompting often yield inauthentic…

人机交互 · 计算机科学 2026-04-07 Jie Cao , Ha Nguyen , Selim Yavuz , Boran Yu , Shuguang Wang , Pavneet Kaur Bharaj , Dionne Cross Francis

Advances in large language models (LLMs) enable many new innovations in education. However, evaluating the effectiveness of new technology requires real students, which is time-consuming and hard to scale up. Therefore, many recent works on…

计算与语言 · 计算机科学 2026-05-06 Alexander Scarlatos , Jaewook Lee , Simon Woodhead , Andrew Lan

In this paper, we investigate whether current state-of-the-art large language models (LLMs) are effective as AI tutors and whether they demonstrate pedagogical abilities necessary for good AI tutoring in educational dialogues. Previous…

计算与语言 · 计算机科学 2025-02-11 Kaushal Kumar Maurya , KV Aditya Srivatsa , Kseniia Petukhova , Ekaterina Kochmar