中文
相关论文

相关论文: Evaluating LLM-Generated Lessons from the Language…

200 篇论文

User Simulators play a pivotal role in training and evaluating task-oriented dialogue systems. Traditional user simulators typically rely on human-engineered agendas, resulting in generated responses that often lack diversity and…

计算与语言 · 计算机科学 2024-05-24 Xiang Luo , Zhiwen Tang , Jin Wang , Xuejie Zhang

Large Language Models (LLMs) have come closest among all models to date to mastering human language, yet opinions about their linguistic and cognitive capabilities remain split. Here, we evaluate LLMs using a distinction between formal…

计算与语言 · 计算机科学 2024-04-14 Kyle Mahowald , Anna A. Ivanova , Idan A. Blank , Nancy Kanwisher , Joshua B. Tenenbaum , Evelina Fedorenko

The development of highly fluent large language models (LLMs) has prompted increased interest in assessing their reasoning and problem-solving capabilities. We investigate whether several LLMs can solve a classic type of deductive reasoning…

计算与语言 · 计算机科学 2024-04-16 Spencer M. Seals , Valerie L. Shalin

Based on the foundation of Large Language Models (LLMs), Multilingual LLMs (MLLMs) have been developed to address the challenges faced in multilingual natural language processing, hoping to achieve knowledge transfer from high-resource…

计算与语言 · 计算机科学 2024-12-10 Yuemei Xu , Ling Hu , Jiayi Zhao , Zihan Qiu , Kexin XU , Yuqi Ye , Hanwen Gu

Use case modeling employs user-centered scenarios to outline system requirements. These help to achieve consensus among relevant stakeholders. Because the manual creation of use case models is demanding and time-consuming, it is often…

软件工程 · 计算机科学 2025-11-14 Tobias Eisenreich , Nicholas Friedlaender , Stefan Wagner

The effect of large language models (LLMs) in education is debated: Previous research shows that LLMs can help as well as hurt learning. In two pre-registered and incentivized laboratory experiments, we find no effect of LLMs on overall…

计算机与社会 · 计算机科学 2025-03-11 Matthias Lehmann , Philipp B. Cornelius , Fabian J. Sting

Recent work has explored the use of large language models (LLMs) to generate tutoring responses in mathematics, yet it remains unclear how closely their instructional behavior aligns with expert human practice. We analyze a dataset of math…

计算与语言 · 计算机科学 2026-05-28 Ramatu Oiza Abdulsalam , Segun Aroyehun

Large language models have demonstrated exceptional capabilities in understanding and generation. However, in real-world scenarios, users' natural language expressions are often inherently fuzzy, ambiguous, and uncertain, leading to…

Modeling plausible student misconceptions is critical for AI in education. In this work, we examine how large language models (LLMs) reason about misconceptions when generating multiple-choice distractors, a task that requires modeling…

计算与语言 · 计算机科学 2026-03-17 Yanick Zengaffinen , Andreas Opedal , Donya Rooein , Kv Aditya Srivatsa , Shashank Sonkar , Mrinmaya Sachan

Ensuring robust safety measures across a wide range of scenarios is crucial for user-facing systems. While Large Language Models (LLMs) can generate valuable data for safety measures, they often exhibit distributional biases, focusing on…

计算与语言 · 计算机科学 2024-10-16 Sabit Hassan , Anthony Sicilia , Malihe Alikhani

Most large language models (LLMs) are sensitive to prompts, and another synonymous expression or a typo may lead to unexpected results for the model. Composing an optimal prompt for a specific demand lacks theoretical support and relies…

计算与语言 · 计算机科学 2024-06-18 Zhenyu Zhang , Bingguang Hao , Jinpeng Li , Zekai Zhang , Dongyan Zhao

Discourse understanding is essential for many NLP tasks, yet most existing work remains constrained by framework-dependent discourse representations. This work investigates whether large language models (LLMs) capture discourse knowledge…

计算与语言 · 计算机科学 2025-06-05 Florian Eichin , Yang Janet Liu , Barbara Plank , Michael A. Hedderich

Cross-lingual in-context learning (XICL) has emerged as a transformative paradigm for leveraging large language models (LLMs) to tackle multilingual tasks, especially for low-resource languages. However, existing approaches often rely on…

计算与语言 · 计算机科学 2024-12-13 Mateo Alejandro Rojas , Rafael Carranza

Large language models (LLMs) are rapidly changing learning processes, as they are readily available to students and quickly complete or augment several learning-related activities with non-trivial performance. Such major shifts in learning…

人机交互 · 计算机科学 2024-09-23 Rahul R. Divekar , Sophia Guerra , Lisette Gonzalez , Natasha Boos

Large language models (LLMs) have emerged as powerful tools in natural language processing (NLP), showing a promising future of artificial generated intelligence (AGI). Despite their notable performance in the general domain, LLMs have…

计算与语言 · 计算机科学 2025-01-23 Jingyuan Chen , Tao Wu , Wei Ji , Fei Wu

Large Language Models (LLMs) play a critical role in how humans access information. While their core use relies on comprehending written requests, our understanding of this ability is currently limited, because most benchmarks evaluate LLMs…

Large Language Models (LLMs), often show strong performance on English tasks, while exhibiting limitations on other languages. What is an LLM's multilingual capability when it is trained only on certain languages? The underlying mechanism…

计算与语言 · 计算机科学 2024-06-04 Fei Yuan , Shuai Yuan , Zhiyong Wu , Lei Li

Reasoning about code and explaining its purpose are fundamental skills for computer scientists. There has been extensive research in the field of computing education on the relationship between a student's ability to explain code and other…

计算机与社会 · 计算机科学 2024-04-03 Juho Leinonen , Paul Denny , Stephen MacNeil , Sami Sarsa , Seth Bernstein , Joanne Kim , Andrew Tran , Arto Hellas

Slang is a commonly used type of informal language that poses a daunting challenge to NLP systems. Recent advances in large language models (LLMs), however, have made the problem more approachable. While LLM agents are becoming more widely…

计算与语言 · 计算机科学 2025-09-22 Siyang Wu , Zhewei Sun

Large Language Models (LLMs) represent a class of deep learning models adept at understanding natural language and generating coherent responses to various prompts or queries. These models far exceed the complexity of conventional neural…

机器学习 · 计算机科学 2024-12-05 Minghao Shao , Abdul Basit , Ramesh Karri , Muhammad Shafique