English
Related papers

Related papers: Can LLMs Identify Gaps and Misconceptions in Stude…

200 papers

Large language models (LLMs) have shown promising abilities as cost-effective and reference-free evaluators for assessing language generation quality. In particular, pairwise LLM evaluators, which compare two generated texts and determine…

Computation and Language · Computer Science 2024-10-15 Han Zhou , Xingchen Wan , Yinhong Liu , Nigel Collier , Ivan Vulić , Anna Korhonen

In recent years, pre-trained large language models (LLMs) have demonstrated remarkable efficiency in achieving an inference-time few-shot learning capability known as in-context learning. However, existing literature has highlighted the…

Computation and Language · Computer Science 2024-02-14 Xinyi Wang , Wanrong Zhu , Michael Saxon , Mark Steyvers , William Yang Wang

This paper assesses the potential for the large language models (LLMs) GPT-4 and GPT-3.5 to aid in deriving insight from education feedback surveys. Exploration of LLM use cases in education has focused on teaching and learning, with less…

Computation and Language · Computer Science 2024-06-28 Michael J. Parker , Caitlin Anderson , Claire Stone , YeaRim Oh

Large language models (LLMs) have the potential to revolutionize various fields, including code development, robotics, finance, and education, due to their extensive prior knowledge and rapid advancements. This paper investigates how LLMs…

Computers and Society · Computer Science 2025-06-10 Liangliang Chen , Zhihao Qin , Yiming Guo , Jacqueline Rohde , Ying Zhang

This study explores the application of Large Language Models (LLMs), specifically GPT-4, in the analysis of classroom dialogue, a crucial research task for both teaching diagnosis and quality improvement. Recognizing the knowledge-intensive…

Computation and Language · Computer Science 2024-10-08 Yun Long , Haifeng Luo , Yu Zhang

Metaphor is a pervasive feature of discourse and a powerful lens for examining cognition, emotion, and ideology. Large-scale analysis, however, has been constrained by the need for manual annotation due to the context-sensitive nature of…

Computation and Language · Computer Science 2025-10-02 Matteo Fuoli , Weihang Huang , Jeannette Littlemore , Sarah Turner , Ellen Wilding

Despite the strong performance of large language models (LLMs) in tasks like mathematical reasoning, their practical use is limited by high computational demands and proprietary restrictions. Chain-of-thought (CoT) and program-of-thought…

Computation and Language · Computer Science 2024-11-11 Mohammad Ghiasvand Mohammadkhani

Large language models (LLMs) have the potential to enhance K-12 STEM education by improving both teaching and learning processes. While previous studies have shown promising results, there is still a lack of comprehensive understanding…

Computation and Language · Computer Science 2024-10-16 Eason Chen , Danyang Wang , Luyi Xu , Chen Cao , Xiao Fang , Jionghao Lin

To complete an open-ended programming exercise, students need to both plan a high-level solution and implement it using the appropriate syntax. However, these problems are often autograded on the correctness of the final submission through…

Computation and Language · Computer Science 2025-04-15 Mehmet Arif Demirtaş , Claire Zheng , Max Fowler , Kathryn Cunningham

Large language models (LLMs) have shown impressive capabilities, but still struggle with complex reasoning tasks requiring multiple steps. While prompt-based methods like Chain-of-Thought (CoT) can improve LLM reasoning at inference time,…

Artificial Intelligence · Computer Science 2024-11-25 Haolin Chen , Yihao Feng , Zuxin Liu , Weiran Yao , Akshara Prabhakar , Shelby Heinecke , Ricky Ho , Phil Mui , Silvio Savarese , Caiming Xiong , Huan Wang

Large language models (LLMs) recently exhibited remarkable reasoning capabilities on solving math problems. To further improve their reasoning capabilities, this work explores whether LLMs can LEarn from MistAkes (LEMA), akin to the human…

Computation and Language · Computer Science 2024-04-01 Shengnan An , Zexiong Ma , Zeqi Lin , Nanning Zheng , Jian-Guang Lou , Weizhu Chen

The rapid advancement of Large Language Models (LLMs) has opened new avenues in education. This study examines the use of LLMs in supporting learning in machine learning education; in particular, it focuses on the ability of LLMs to…

Computers and Society · Computer Science 2025-05-27 Smitha Kumar , Michael A. Lones , Manuel Maarek , Hind Zantout

Large language models (LLMs) have recently achieved significant success across various application domains, garnering substantial attention from different communities. Unfortunately, even for the best LLM, many \textit{faults} still exist…

Software Engineering · Computer Science 2024-11-06 Qiang Hu , Jin Wen , Maxime Cordy , Yuheng Huang , Wei Ma , Xiaofei Xie , Lei Ma

We introduce a large language model (LLM) based approach to answer complex questions requiring multi-hop numerical reasoning over financial reports. While LLMs have exhibited remarkable performance on various natural language and reasoning…

Computation and Language · Computer Science 2023-11-28 Karmvir Singh Phogat , Chetan Harsha , Sridhar Dasaratha , Shashishekar Ramakrishna , Sai Akhil Puranam

Automating code documentation through explanatory text can prove highly beneficial in code understanding. Large Language Models (LLMs) have made remarkable strides in Natural Language Processing, especially within software engineering tasks…

Large language models (LLMs) have demonstrated remarkable capabilities in natural language understanding, reasoning, and problem-solving across various domains. However, their ability to perform complex, multi-step reasoning task-essential…

Integrating free-text explanations to in-context learning of large language models (LLM) is shown to elicit strong reasoning capabilities along with reasonable explanations. In this paper, we consider the problem of leveraging the…

Computation and Language · Computer Science 2022-10-14 Shiyang Li , Jianshu Chen , Yelong Shen , Zhiyu Chen , Xinlu Zhang , Zekun Li , Hong Wang , Jing Qian , Baolin Peng , Yi Mao , Wenhu Chen , Xifeng Yan

Small language models (SLMs) are more efficient, cost-effective, and customizable than large language models (LLMs), though they often underperform in specific areas like reasoning. Past methods for enhancing SLMs' reasoning, such as…

Computation and Language · Computer Science 2024-12-12 Kaiyuan Chen , Jin Wang , Xuejie Zhang

The automatic generation of hints by Large Language Models (LLMs) within Intelligent Tutoring Systems (ITSs) has shown potential to enhance student learning. However, generating pedagogically sound hints that address student misconceptions…

Computation and Language · Computer Science 2024-11-07 Junior Cedric Tonga , Benjamin Clement , Pierre-Yves Oudeyer

Analyzing students' written solutions to physics questions is a major area in PER. However, gauging student understanding in college courses is bottlenecked by large class sizes, which limits assessments to a multiple-choice (MC) format for…

Physics Education · Physics 2026-05-11 Sean Savage , N. Sanjay Rebello