English
Related papers

Related papers: EducationQ: Evaluating LLMs' Teaching Capabilities…

200 papers

The primary goal of this study is to analyze agentic workflows in education according to the proposed four major technological paradigms: reflection, planning, tool use, and multi-agent collaboration. We critically examine the role of AI…

Artificial Intelligence · Computer Science 2026-01-27 Firuz Kamalov , David Santandreu Calonge , Linda Smail , Dilshod Azizov , Dimple R. Thadani , Theresa Kwong , Amara Atif

Large Language Models (LLMs), such as GPT-4, have demonstrated impressive mathematical reasoning capabilities, achieving near-perfect performance on benchmarks like GSM8K. However, their application in personalized education remains limited…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Yi-Fan Zhang , Hang Li , Dingjie Song , Lichao Sun , Tianlong Xu , Qingsong Wen

Large Language Models (LLMs) have made progress in various real-world tasks, which stimulates requirements for the evaluation of LLMs. Existing LLM evaluation methods are mainly supervised signal-based which depends on static datasets and…

Computation and Language · Computer Science 2023-09-11 Jiatong Li , Rui Li , Qi Liu

Question answering (QA) plays a central role in financial education, yet existing large language model (LLM) approaches often fail to capture the nuanced and specialized reasoning required for financial problem-solving. The financial domain…

Computation and Language · Computer Science 2025-09-15 Andy Zhu , Yingjun Du

Evaluating the pedagogical capabilities of AI-based tutoring models is critical for making guided progress in the field. Yet, we lack a reliable, easy-to-use, and simple-to-run evaluation that reflects the pedagogical abilities of models.…

Computation and Language · Computer Science 2025-10-14 Jakub Macina , Nico Daheim , Ido Hakimi , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

Large-Language Models (LLMs) are changing the way learners acquire knowledge outside the classroom setting. Previous studies have shown that LLMs seem effective in generating to short and simple questions in introductory CS courses using…

Programming Languages · Computer Science 2026-03-09 Yihan Zhang , Brigitte Pientka , Xujie Si

Large Language Models (LLMs) are rapidly evolving and impacting various fields, necessitating the development of effective methods to evaluate and compare their performance. Most current approaches for performance evaluation are either…

Computation and Language · Computer Science 2025-02-11 Behrad Moniri , Hamed Hassani , Edgar Dobriban

Large language models (LLMs), due to their advanced natural language capabilities, have seen significant success in applications where the user interface is usually a conversational artificial intelligence (AI) agent and engages the user…

Computation and Language · Computer Science 2025-03-10 Fei Wei , Yaliang Li , Bolin Ding

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Designing dialog tutors has been challenging as it involves modeling the diverse and complex pedagogical strategies employed by human tutors. Although there have been significant recent advances in neural conversational systems using large…

Computation and Language · Computer Science 2023-03-29 Jakub Macina , Nico Daheim , Lingzhi Wang , Tanmay Sinha , Manu Kapur , Iryna Gurevych , Mrinmaya Sachan

Human cognitive development is shaped not only by individual effort but by structured social interaction, where role-based exchanges such as those between a tutor and a learner, enable solutions that neither could achieve alone. Inspired by…

Artificial Intelligence · Computer Science 2026-04-13 Nurullah Eymen Özdemir , Erhan Oztop

Workshop courses designed to foster creativity are gaining popularity. However, even experienced faculty teams find it challenging to realize a holistic evaluation that accommodates diverse perspectives. Adequate deliberation is essential…

Computers and Society · Computer Science 2025-07-04 Toru Ishida , Tongxi Liu , Hailong Wang , William K. Cheunga

The growing complexity of power systems has made accurate load forecasting more important than ever. An increasing number of advanced load forecasting methods have been developed. However, the static design of current methods offers no…

Machine Learning · Computer Science 2025-05-23 Yu Zuo , Dalin Qin , Yi Wang

This paper presents a comprehensive exploration of leveraging Large Language Models (LLMs), specifically GPT-4, in the field of instructional design. With a focus on scaling evidence-based instructional design expertise, our research aims…

Computation and Language · Computer Science 2023-06-27 Gautam Yadav

Large Language Models (LLMs) have emerged as powerful tools in various research domains. This article examines their potential through a literature review and firsthand experimentation. While LLMs offer benefits like cost-effectiveness and…

Human-Computer Interaction · Computer Science 2024-04-10 M. Namvarpour , A. Razi

The influence of Artificial Intelligence (AI), and specifically Large Language Models (LLM), on education is continuously increasing. These models are frequently used by students, giving rise to the question whether current forms of…

Human-Computer Interaction · Computer Science 2025-07-02 Patrick Stokkink

The rise of large language models (LLMs) has revolutionized the way that we interact with artificial intelligence systems through natural language. However, LLMs often misinterpret user queries because of their uncertain intention, leading…

Computation and Language · Computer Science 2024-02-07 Jing-Cheng Pang , Heng-Bo Fan , Pengyuan Wang , Jia-Hao Xiao , Nan Tang , Si-Hang Yang , Chengxing Jia , Sheng-Jun Huang , Yang Yu

This paper surveys the development of large language model (LLM)-based agents for question answering (QA). Traditional agents face significant limitations, including substantial data requirements and difficulty in generalizing to new…

Computation and Language · Computer Science 2025-03-26 Murong Yue

The widespread availability of large language models (LLMs), such as ChatGPT, has significantly impacted education, raising both opportunities and challenges. Students can frequently interact with LLM-powered, interactive learning tools,…

Artificial Intelligence · Computer Science 2026-03-06 Hunter McNichols , Fareya Ikram , Andrew Lan

In an era where single large language models have dominated the landscape of artificial intelligence for years, multi-agent systems arise as new protagonists in conversational task-solving. While previous studies have showcased their…

Computation and Language · Computer Science 2024-11-04 Jonas Becker