English
Related papers

Related papers: Discerning minds or generic tutors? Evaluating ins…

200 papers

Large language models (LLMs), while promising, face criticisms for biases, hallucinations, and a lack of reasoning capability. This paper introduces SocraSynth, a multi-LLM agent reasoning platform developed to mitigate these issues.…

Artificial Intelligence · Computer Science 2024-02-13 Edward Y. Chang

The rapid evolution of large language models (LLMs) and their capacity to simulate human cognition and behavior has given rise to LLM-based frameworks and tools that are evaluated and applied based on their ability to perform tasks…

Computation and Language · Computer Science 2024-12-03 Jing Yi Wang , Nicholas Sukiennik , Tong Li , Weikang Su , Qianyue Hao , Jingbo Xu , Zihan Huang , Fengli Xu , Yong Li

Large Language Models (LLMs) challenge conventional automated programming assessment because students can now produce functionally correct code without demonstrating corresponding understanding. This paper makes two contributions. First, it…

Software Engineering · Computer Science 2026-04-09 Eduard Frankford , Erik Cikalleshi , Ruth Breu

Recently, several multi-turn dialogue benchmarks have been proposed to evaluate the conversational abilities of large language models (LLMs). As LLMs are increasingly recognized as a key technology for advancing intelligent education, owing…

Computation and Language · Computer Science 2025-10-16 Shouang Wei , Min Zhang , Xin Lin , Bo Jiang , Zhongxiang Dai , Kun Kuang

Reading assessments are essential for enhancing students' comprehension, yet many EdTech applications focus mainly on outcome-based metrics, providing limited insights into student behavior and cognition. This study investigates the use of…

Computers and Society · Computer Science 2025-03-05 Eduardo Davalos , Yike Zhang , Namrata Srivastava , Jorge Alberto Salas , Sara McFadden , Sun-Joo Cho , Gautam Biswas , Amanda Goodwin

One-to-one tutoring is widely considered the gold standard for personalized education, yet it remains prohibitively expensive to scale. To evaluate whether generative AI might help expand access to this resource, we conducted an exploratory…

Large language models (LLMs) offer emerging opportunities for psychological and behavioral research, but methodological guidance is lacking. This article provides a framework for using LLMs as psychological simulators across two primary…

Computers and Society · Computer Science 2026-04-07 Zhicheng Lin

Human guidance in reinforcement learning (RL) is often impractical for large-scale applications due to high costs and time constraints. Large Language Models (LLMs) offer a promising alternative to mitigate RL sample inefficiency and…

Machine Learning · Computer Science 2024-11-25 Maryam Shoaeinaeini , Brent Harrison

Large Language Models (LLMs) have shown extraordinary capabilities in understanding and generating text that closely mirrors human communication. However, a primary limitation lies in the significant computational demands during training,…

Large language models (LLMs) are transforming education by answering questions, explaining complex concepts, and generating content across a wide range of subjects. Despite strong performance on academic benchmarks, they often fail to…

Computation and Language · Computer Science 2025-10-21 Numaan Naeem , Abdellah El Mekki , Muhammad Abdul-Mageed

With the continuous evolution and refinement of LLMs, they are endowed with impressive logical reasoning or vertical thinking capabilities. But can they think out of the box? Do they possess proficient lateral thinking abilities? Following…

Computation and Language · Computer Science 2024-03-19 Shulin Huang , Shirong Ma , Yinghui Li , Mengzuo Huang , Wuhe Zou , Weidong Zhang , Hai-Tao Zheng

This scoping review examines the emerging field of Large Language Model (LLM)-based pedagogical agents in educational settings. While traditional pedagogical agents have been extensively studied, the integration of LLMs represents a…

Artificial Intelligence · Computer Science 2026-05-19 Shan Li , Juan Zheng

Despite significant research effort in the development of automatic dialogue evaluation metrics, little thought is given to evaluating dialogues other than in English. At the same time, ensuring metrics are invariant to semantically similar…

Computation and Language · Computer Science 2023-09-11 John Mendonça , Patrícia Pereira , Helena Moniz , João Paulo Carvalho , Alon Lavie , Isabel Trancoso

Monolithic Large Language Models (LLMs) used in educational dialogue often behave as "black boxes," where pedagogical decisions are implicit and difficult to audit, frequently violating instructional constraints by providing answers too…

Computers and Society · Computer Science 2026-03-26 Nizam Kadir

This study investigates the behaviors of Large Language Models (LLMs) when faced with conflicting prompts versus their internal memory. This will not only help to understand LLMs' decision mechanism but also benefit real-world applications,…

Computation and Language · Computer Science 2024-02-21 Jiahao Ying , Yixin Cao , Kai Xiong , Yidong He , Long Cui , Yongbin Liu

Advances in large language models (LLMs) enable many new innovations in education. However, evaluating the effectiveness of new technology requires real students, which is time-consuming and hard to scale up. Therefore, many recent works on…

Computation and Language · Computer Science 2026-05-06 Alexander Scarlatos , Jaewook Lee , Simon Woodhead , Andrew Lan

Large language models (LLMs) present new opportunities for creating pedagogical agents that engage in meaningful dialogue to support student learning. However, current LLM systems used in classrooms often lack the solid theoretical…

Self-reflection on learning experiences constitutes a fundamental cognitive process, essential for the consolidation of knowledge and the enhancement of learning efficacy. However, traditional methods to facilitate reflection often face…

The ability of Large Language Models (LLMs) to precisely follow complex and fine-grained lexical instructions is a cornerstone of their utility and controllability. However, evaluating this capability remains a significant challenge.…

Computation and Language · Computer Science 2026-03-24 Huimin Ren , Yan Liang , Baiqiao Su , Chaobo Sun , Hengtong Lu , Kaike Zhang , Chen Wei

Large language models (LLMs) have emerged as powerful tools in natural language processing (NLP), showing a promising future of artificial generated intelligence (AGI). Despite their notable performance in the general domain, LLMs have…

Computation and Language · Computer Science 2025-01-23 Jingyuan Chen , Tao Wu , Wei Ji , Fei Wu