English
Related papers

Related papers: Discerning minds or generic tutors? Evaluating ins…

200 papers

This paper looks at the ability of large language models to participate in educational guided reading. We specifically, evaluate their ability to generate meaningful questions from the input text, generate diverse questions both in terms of…

Computation and Language · Computer Science 2023-05-22 Peter Ochieng

Our research investigates the capability of modern multimodal reasoning models, powered by Large Language Models (LLMs), to facilitate vision-powered assistants for multi-step daily activities. Such assistants must be able to 1) encode…

Computer Vision and Pattern Recognition · Computer Science 2024-08-14 Mrinal Verghese , Brian Chen , Hamid Eghbalzadeh , Tushar Nagarajan , Ruta Desai

In this work, we propose a novel framework that integrates large language models (LLMs) with an RL-based dialogue manager for open-ended dialogue with a specific goal. By leveraging hierarchical reinforcement learning to model the…

Computation and Language · Computer Science 2025-07-09 Lucie Galland , Catherine Pelachaud , Florian Pecune

Large language models (LLMs) have been proposed as supervisory agents for spacecraft operations, but existing approaches rely on static prompting and do not improve across repeated executions. We introduce \textsc{GUIDE}, a non-parametric…

Multiagent Systems · Computer Science 2026-04-16 Alejandro Carrasco , Mariko Storey-Matsutani , Victor Rodriguez-Fernandez , Richard Linares

Analogical reasoning -- the capacity to identify and map structural relationships between different domains -- is fundamental to human cognition and learning. Recent studies have shown that large language models (LLMs) can sometimes match…

Computation and Language · Computer Science 2025-11-21 Sam Musker , Alex Duchnowski , Raphaël Millière , Ellie Pavlick

The adoption of generative AI and large language models (LLMs) in education is still emerging. In this study, we explore the development and evaluation of AI teaching assistants that provide curriculum-based guidance using a…

Computation and Language · Computer Science 2025-10-06 Konstantinos Katharakis , Sippo Rossi , Raghava Rao Mukkamala

As Large Language Models (LLMs) increasingly participate in human-AI interactions, evaluating their Theory of Mind (ToM) capabilities - particularly their ability to track dynamic mental states - becomes crucial. While existing benchmarks…

Computation and Language · Computer Science 2025-06-10 Yang Xiao , Jiashuo Wang , Qiancheng Xu , Changhe Song , Chunpu Xu , Yi Cheng , Wenjie Li , Pengfei Liu

Researchers have made notable progress in applying Large Language Models (LLMs) to solve math problems, as demonstrated through efforts like GSM8k, ProofNet, AlphaGeometry, and MathOdyssey. This progress has sparked interest in their…

Human-Computer Interaction · Computer Science 2025-03-24 Adit Gupta , Jennifer Reddig , Tommaso Calo , Daniel Weitekamp , Christopher J. MacLellan

Evaluating AI tutor responses requires more than factual correctness: tutors must identify mistakes, locate errors, provide guidance, and offer actionable next steps. We present GRADE, a systematic study of open-source models for…

Computation and Language · Computer Science 2026-05-28 Parth Bhalerao , Jeromy Chang , David Chou , Oana Ignat

Educational technology innovations leveraging large language models (LLMs) have shown the potential to automate the laborious process of generating and analysing textual content. While various innovations have been developed to automate a…

Computation and Language · Computer Science 2023-08-29 Lixiang Yan , Lele Sha , Linxuan Zhao , Yuheng Li , Roberto Martinez-Maldonado , Guanliang Chen , Xinyu Li , Yueqiao Jin , Dragan Gašević

The adoption of generative AI in education has accelerated dramatically in recent years, with Large Language Models (LLMs) increasingly integrated into learning environments in the hope of providing personalized support that enhances…

Computers and Society · Computer Science 2026-02-06 Johaun Hatchett , Debshila Basu Mallick , Brittany C. Bradford , Richard G. Baraniuk

Large language models (LLMs) have shown remarkable reasoning capabilities, yet aligning such abilities to small language models (SLMs) remains a challenge due to distributional mismatches and limited model capacity. Existing reasoning…

Computation and Language · Computer Science 2025-05-28 Yong Wu , Weihang Pan , Ke Li , Chen Binhui , Ping Li , Binbin Lin

Capturing human learning behavior based on deep learning methods has become a major research focus in both psychology and intelligent systems. Recent approaches rely on controlled experiments or rule-based models to explore cognitive…

Artificial Intelligence · Computer Science 2025-08-08 Yu Yuan , Lili Zhao , Wei Chen , Guangting Zheng , Kai Zhang , Mengdi Zhang , Qi Liu

Self-reflection for Large Language Models (LLMs) has gained significant attention. Existing approaches involve models iterating and improving their previous responses based on LLMs' internal reflection ability or external feedback. However,…

Computation and Language · Computer Science 2025-03-04 Liping Liu , Chunhong Zhang , Likang Wu , Chuang Zhao , Zheng Hu , Ming He , Jianping Fan

Recent progress in large language models (LLMs) has outpaced the development of effective evaluation methods. Traditional benchmarks rely on task-specific metrics and static datasets, which often suffer from fairness issues, limited…

Computation and Language · Computer Science 2025-05-20 Yuhang Zhou , Xutian Chen , Yixin Cao , Yuchen Ni , Yu He , Siyu Tian , Xiang Liu , Jian Zhang , Chuanjun Ji , Guangnan Ye , Xipeng Qiu

Multimodal large language models (MLLMs) demonstrate impressive performance on scientific reasoning tasks (e.g., ScienceQA). However, most existing benchmarks focus narrowly on the accuracy of the final answer while ignoring other metrics.…

Computation and Language · Computer Science 2025-05-13 Ming Liu , Liwen Wang , Wensheng Zhang

Large language models (LLMs) are increasingly used in social science simulations. While their performance on reasoning and optimization tasks has been extensively evaluated, less attention has been paid to their ability to simulate human…

Computational Engineering, Finance, and Science · Computer Science 2025-08-25 Yuanjun Feng , Vivek Choudhary , Yash Raj Shrestha

Large Language Models (LLMs) have shown great potential in intelligent visualization systems, especially for domain-specific applications. Integrating LLMs into visualization systems presents challenges, and we categorize these challenges…

Human-Computer Interaction · Computer Science 2024-07-31 Lin Gao , Jing Lu , Zekai Shao , Ziyue Lin , Shengbin Yue , Chiokit Ieong , Yi Sun , Rory James Zauner , Zhongyu Wei , Siming Chen

Large language models (LLMs) have showcased remarkable reasoning capabilities, yet they remain susceptible to errors, particularly in temporal reasoning tasks involving complex temporal logic. Existing research has explored LLM performance…

Computation and Language · Computer Science 2024-06-14 Bahare Fatemi , Mehran Kazemi , Anton Tsitsulin , Karishma Malkan , Jinyeong Yim , John Palowitch , Sungyong Seo , Jonathan Halcrow , Bryan Perozzi

Effective teaching requires adapting instructional strategies to accommodate the diverse cognitive and behavioral profiles of students, a persistent challenge in education and teacher training. While Large Language Models (LLMs) offer…

Artificial Intelligence · Computer Science 2025-05-27 Debdeep Sanyal , Agniva Maiti , Umakanta Maharana , Dhruv Kumar , Ankur Mali , C. Lee Giles , Murari Mandal