中文
相关论文

相关论文: Evaluating Large Language Models for automatic ana…

200 篇论文

Student simulation presents a transformative approach to enhance learning outcomes, advance educational research, and ultimately shape the future of effective pedagogy. We explore the feasibility of using large language models (LLMs), a…

人工智能 · 计算机科学 2023-10-31 Songlin Xu , Xinyu Zhang

Retrained large language models (LLMs) have become extensively used across various sub-disciplines of natural language processing (NLP). In NLP, text classification problems have garnered considerable focus, but still faced with some…

计算与语言 · 计算机科学 2023-12-05 Zhiqiang Wang , Yiran Pang , Yanbin Lin

Although several methods were proposed to address the problem of automated essay scoring (AES) in the last 50 years, there is still much to desire in terms of effectiveness. Large Language Models (LLMs) are transformer-based models that…

计算与语言 · 计算机科学 2024-04-17 Watheq Mansour , Salam Albatarni , Sohaila Eltanbouly , Tamer Elsayed

Detecting life-threatening language is essential for safeguarding individuals in distress, promoting mental health and well-being, and preventing potential harm and loss of life. This paper presents an effective approach to identifying…

计算与语言 · 计算机科学 2025-06-13 Thanh Thi Nguyen , Campbell Wilson , Janis Dalins

Large language models (LLMs) have demonstrated remarkable success in NLP tasks. However, there is a paucity of studies that attempt to evaluate their performances on social media-based health-related natural language processing tasks, which…

计算与语言 · 计算机科学 2024-03-29 Yuting Guo , Anthony Ovadje , Mohammed Ali Al-Garadi , Abeed Sarker

Multimodal large language models (MLLMs) have recently become a focal point of research due to their formidable multimodal understanding capabilities. For example, in the audio and speech domains, an LLM can be equipped with (automatic)…

计算机视觉与模式识别 · 计算机科学 2025-03-10 Umberto Cappellazzo , Minsu Kim , Honglie Chen , Pingchuan Ma , Stavros Petridis , Daniele Falavigna , Alessio Brutti , Maja Pantic

Using large language models (LLMs) for automatic evaluation has become an important evaluation method in NLP research. However, it is unclear whether these LLM-based evaluators can be applied in real-world classrooms to assess student…

计算与语言 · 计算机科学 2024-09-24 Cheng-Han Chiang , Wei-Chih Chen , Chun-Yi Kuan , Chienchou Yang , Hung-yi Lee

Large Language Models (LLMs) pre-trained on multilingual data have revolutionized natural language processing research, by transitioning from languages and task specific model pipelines to a single model adapted on a variety of tasks.…

计算与语言 · 计算机科学 2025-01-31 Munief Hassan Tahir , Sana Shams , Layba Fiaz , Farah Adeeba , Sarmad Hussain

Despite the recent ubiquity of large language models and their high zero-shot prompted performance across a wide range of tasks, it is still not known how well they perform on tasks which require processing of potentially idiomatic…

计算与语言 · 计算机科学 2024-05-16 Dylan Phelps , Thomas Pickard , Maggie Mi , Edward Gow-Smith , Aline Villavicencio

Large Language Models (LLMs) are becoming widely used to support various workflows across different disciplines, yet their potential in discrete choice modelling remains relatively unexplored. This work examines the potential of LLMs as…

计量经济学 · 经济学 2026-03-18 Georges Sfeir , Gabriel Nova , Stephane Hess , Sander van Cranenburgh

Multimodal large language models (MLLMs) have shown success in vision-language tasks, but their ability to reason over complex educational materials remains largely untested. This work presents the first evaluation of state-of-the-art…

计算与语言 · 计算机科学 2025-07-16 Hessa A. Alawwad , Anas Zafar , Areej Alhothali , Usman Naseem , Ali Alkhathlan , Amani Jamal

Tutoring dialogues have gained significant attention in recent years, given the prominence of online learning and the emerging tutoring abilities of artificial intelligence (AI) agents powered by large language models (LLMs). Recent studies…

计算与语言 · 计算机科学 2025-07-10 Fareya Ikram , Alexander Scarlatos , Andrew Lan

Intelligent Tutoring Systems (ITSs) can provide personalized and self-paced learning experience. The emergence of large language models (LLMs) further enables better human-machine interaction, and facilitates the development of…

计算与语言 · 计算机科学 2025-05-29 Zhengyuan Liu , Stella Xin Yin , Geyu Lin , Nancy F. Chen

Recent studies have uncovered the potential of Large Language Models (LLMs) in addressing complex sequential decision-making tasks through the provision of high-level instructions. However, LLM-based agents lack specialization in tackling…

人工智能 · 计算机科学 2024-05-28 Zihao Zhou , Bin Hu , Chenyang Zhao , Pu Zhang , Bin Liu

Large language models (LLMs) are increasingly applied in computer science education for tasks such as tutoring, content generation, and code assessment. However, systematic evaluations aligned with formal curricula and certification…

Student simulation with Large language models (LLMs) offers a scalable alternative for educational research and teacher training. Yet, its validity depends on whether models maintain stable personas across extended interactions. We test…

人机交互 · 计算机科学 2026-05-25 Jana Gonnermann-Müller , Jennifer Haase , Nicolas Leins , Thomas Kosch , Sebastian Pokutta

Virtual Teaching Assistants (VTAs) powered by Large Language Models (LLMs) have the potential to enhance student learning by providing instant feedback and facilitating multi-turn interactions. However, empirical studies on their…

计算机与社会 · 计算机科学 2025-06-24 Sunjun Kweon , Sooyohn Nam , Hyunseung Lim , Hwajung Hong , Edward Choi

Large Language Models (LLMs) have shown remarkable capabilities across various fields. However, their performance in technical domains such as telecommunications remains underexplored. This paper evaluates two open-source LLMs, Gemma 3 27B…

网络与互联网体系结构 · 计算机科学 2025-09-29 Arina Caraus , Alessio Buscemi , Sumit Kumar , Ion Turcanu

The growing complexity and diversity of news coverage have made framing analysis a crucial yet challenging task in computational social science. Traditional approaches, including manual annotation and fine-tuned models, remain limited by…

计算与语言 · 计算机科学 2026-05-22 Valeria Pastorino , Jasivan A. Sivakumar , Nafise Sadat Moosavi

The landscape of education is changing rapidly, shaped by emerging pedagogical approaches, technological innovations such as artificial intelligence (AI), and evolving societal expectations, all of which demand thorough evaluation of new…