English
Related papers

Related papers: Which Type of Students can LLMs Act? Investigating…

200 papers

Large language models (LLMs) are increasingly used as simulated participants in social science experiments, but their behavior is often unstable and highly sensitive to design choices. Prior evaluations frequently conflate base-model…

Artificial Intelligence · Computer Science 2026-02-03 Xuan Liu , Haoyang Shang , Zizhang Liu , Xinyan Liu , Yunze Xiao , Yiwen Tu , Haojian Jin

Large language models (LLMs) have demonstrated strong potential in performing automatic scoring for constructed response assessments. While constructed responses graded by humans are usually based on given grading rubrics, the methods by…

Computation and Language · Computer Science 2025-02-24 Xuansheng Wu , Padmaja Pravin Saraf , Gyeonggeon Lee , Ehsan Latif , Ninghao Liu , Xiaoming Zhai

Providing students with individualized feedback through assignments is a cornerstone of education that supports their learning and development. Studies have shown that timely, high-quality feedback plays a critical role in improving…

Machine Learning · Computer Science 2025-01-27 Pavlin G. Poličar , Martin Špendl , Tomaž Curk , Blaž Zupan

Intelligent Tutoring Systems (ITSs) can provide personalized and self-paced learning experience. The emergence of large language models (LLMs) further enables better human-machine interaction, and facilitates the development of…

Computation and Language · Computer Science 2025-05-29 Zhengyuan Liu , Stella Xin Yin , Geyu Lin , Nancy F. Chen

The evolving pedagogy paradigms are leading toward educational transformations. One fundamental aspect of effective learning is relevant, immediate, and constructive feedback to students. Providing constructive feedback to large cohorts in…

Computers and Society · Computer Science 2025-10-14 Javed Ali Khan , Muhammad Yaqoob , Mamoona Tasadduq , Hafsa Shareef Dar , Aitezaz Ahsan

Worked examples are step-by-step solutions to problems in a specific domain, offered to students to acquire domain-specific problem-solving skills. The effectiveness of worked examples could be enhanced by combining them with…

Human-Computer Interaction · Computer Science 2026-05-22 Arun-Balajiee Lekshmi-Narayanan , Mohammad Hassany , Peter Brusilovsky

Accurate and verifiable large language model (LLM) simulations of human research subjects promise an accessible data source for understanding human behavior and training new AI systems. However, results to date have been limited, and few…

Human-Computer Interaction · Computer Science 2025-06-06 Jacy Reese Anthis , Ryan Liu , Sean M. Richardson , Austin C. Kozlowski , Bernard Koch , James Evans , Erik Brynjolfsson , Michael Bernstein

Advances in large language models (LLMs) enable many new innovations in education. However, evaluating the effectiveness of new technology requires real students, which is time-consuming and hard to scale up. Therefore, many recent works on…

Computation and Language · Computer Science 2026-05-06 Alexander Scarlatos , Jaewook Lee , Simon Woodhead , Andrew Lan

Evaluating teaching effectiveness at scale remains a persistent challenge for large universities, particularly within engineering programs that enroll tens of thousands of students. Traditional methods, such as manual review of student…

Computers and Society · Computer Science 2025-08-06 Jean-Francois Chamberland , Martin C. Carlisle , Arul Jayaraman , Krishna R. Narayanan , Sunay Palsole , Karan Watson

One of the emergent challenges of student work submitted for assessment is the widespread use of large language models (LLMs) to support and even produce written work. This particularly affects subjects where long-form written work is a key…

Computers and Society · Computer Science 2025-11-11 Ian M. Church , Lyndon Drake , Mark Harris

The ability of Large Language Models (LLMs) to mimic human behavior triggered a plethora of computational social science research, assuming that empirical studies of humans can be conducted with AI agents instead. Since there have been…

Computation and Language · Computer Science 2025-10-21 Simon Münker , Nils Schwager , Achim Rettinger

As NLP evaluation shifts from static benchmarks to multi-turn interactive settings, LLM-based simulators have become widely used as user proxies, serving two roles: generating user turns and providing evaluation signals. Yet, these…

Artificial Intelligence · Computer Science 2026-03-13 Xuhui Zhou , Weiwei Sun , Qianou Ma , Yiqing Xie , Jiarui Liu , Weihua Du , Sean Welleck , Yiming Yang , Graham Neubig , Sherry Tongshuang Wu , Maarten Sap

While LLMs have demonstrated remarkable capabilities in text generation and reasoning, their ability to simulate human decision-making -- particularly in political contexts -- remains an open question. However, modeling voter behavior…

Computation and Language · Computer Science 2025-04-11 Chenxiao Yu , Jinyi Ye , Yuangang Li , Zheng Li , Emilio Ferrara , Xiyang Hu , Yue Zhao

Manufacturing planners face complex operational challenges that require seamless collaboration between human expertise and intelligent systems to achieve optimal performance in modern production environments. Traditional approaches to…

Artificial Intelligence · Computer Science 2025-12-23 Himabindu Thogaru , Saisubramaniam Gopalakrishnan , Zishan Ahmad , Anirudh Deodhar

The advancement of Artificial Intelligence (AI) has created opportunities for e-learning, particularly in automated assessment systems that reduce educators' workload and provide timely feedback to students. However, developing effective…

Computers and Society · Computer Science 2025-02-11 Long Zhang , Meng Zhang , Wei Lin Wang , Yu Luo

The rapid integration of Large Language Models (LLMs) into software engineering practice is reshaping how software testing activities are performed. LLMs are increasingly used to support software testing. Consequently, software testing…

Software Engineering · Computer Science 2026-03-30 Peng Yang , Yunfeng Zhu , Chao Chang , Shengcheng Yu , Zhenyu Chen , Yong Tang

With the rise of online learning, the demand for efficient and consistent assessment in mathematics has significantly increased over the past decade. Machine Learning (ML), particularly Natural Language Processing (NLP), has been widely…

Machine Learning · Computer Science 2025-07-08 Behnam Parsaeifard , Martin Hlosta , Per Bergamin

As Large Language Models (LLMs) and other forms of Generative AI permeate various aspects of our lives, their application for learning and education has provided opportunities and challenges. This paper presents an investigation into the…

Computers and Society · Computer Science 2023-06-06 Daniel Leiker , Sara Finnigan , Ashley Ricker Gyllen , Mutlu Cukurova

Simulations, although powerful in accurately replicating real-world systems, often remain inaccessible to non-technical users due to their complexity. Conversely, large language models (LLMs) provide intuitive, language-based interactions…

Computation and Language · Computer Science 2025-05-22 Jacob Kleiman , Kevin Frank , Joseph Voyles , Sindy Campagna

The promise of generative AI to revolutionize education is constrained by the pedagogical limits of large language models (LLMs). A major issue is the lack of access to high-quality training data that reflect the learning of actual…

Computation and Language · Computer Science 2025-10-07 Janos Perczel , Jin Chow , Dorottya Demszky