中文
相关论文

相关论文: Assessing the Quality of Multiple-Choice Questions…

200 篇论文

Providing effective feedback is important for student learning in programming problem-solving. In this sense, Large Language Models (LLMs) have emerged as potential tools to automate feedback generation. However, their reliability and…

软件工程 · 计算机科学 2025-03-20 Priscylla Silva , Evandro Costa

Automated explanatory feedback systems play a crucial role in facilitating learning for a large cohort of learners by offering feedback that incorporates explanations, significantly enhancing the learning process. However, delivering such…

Online programming courses are becoming more and more popular, but they still have significant drawbacks when compared to the traditional education system, e.g., the lack of feedback. In this study, we apply machine learning methods to…

计算机与社会 · 计算机科学 2021-07-22 Artyom Lobanov , Timofey Bryksin , Alexey Shpilman

Evaluating the performance of Grammatical Error Correction (GEC) systems is a challenging task due to its subjectivity. Designing an evaluation metric that is as objective as possible is crucial to the development of GEC task. However,…

计算与语言 · 计算机科学 2023-10-18 Jingheng Ye , Yinghui Li , Qingyu Zhou , Yangning Li , Shirong Ma , Hai-Tao Zheng , Ying Shen

Text-based open-ended questions in academic formative and summative assessments help students become deep learners and prepare them to understand concepts for a subsequent conceptual assessment. However, grading text-based questions,…

计算机与社会 · 计算机科学 2024-01-17 Rujun Gao , Hillary E. Merzdorf , Saira Anwar , M. Cynthia Hipwell , Arun Srinivasa

The impressive multimodal capabilities demonstrated by OpenAI's GPT-4 have generated significant interest in the development of Multimodal Large Language Models (MLLMs). Visual instruction tuning of MLLMs with machine-generated…

机器学习 · 计算机科学 2025-06-03 Biao Wu , Ling Chen

State-of-the-art results in typical classification tasks are mostly achieved by unexplainable machine learning methods, like deep neural networks, for instance. Contrarily, in this paper, we investigate the application of rule learning…

机器学习 · 计算机科学 2024-03-11 Albert Nössig , Tobias Hell , Georg Moser

Question answering (QA) tasks have been extensively studied in the field of natural language processing (NLP). Answers to open-ended questions are highly diverse and difficult to quantify, and cannot be simply evaluated as correct or…

计算与语言 · 计算机科学 2024-10-03 Xiaotian Lu , Jiyi Li , Koh Takeuchi , Hisashi Kashima

The rapid integration of generative artificial intelligence (GenAI) technology into education necessitates precise measurement of GenAI literacy to ensure that learners and educators possess the skills to engage with and critically evaluate…

人机交互 · 计算机科学 2024-11-20 Yueqiao Jin , Roberto Martinez-Maldonado , Dragan Gašević , Lixiang Yan

This study investigates the application of large language models, specifically GPT-4, to enhance programming education. The research outlines the design of a web application that uses GPT-4 to provide feedback on programming tasks, without…

计算与语言 · 计算机科学 2024-07-19 Sven Jacobs , Steffen Jaschke

In the last several years, the field of computer assisted language learning has increasingly focused on computer aided question generation. However, this approach often provides test takers with an exhaustive amount of questions that are…

计算与语言 · 计算机科学 2018-08-30 Yi-Ting Huang , Meng Chang Chen , Yeali S. Sun

Large Language Models (LLMs) excel in various Natural Language Processing (NLP) tasks, yet their evaluation, particularly in languages beyond the top $20$, remains inadequate due to existing benchmarks and metrics limitations. Employing…

One of the most widely used tasks for evaluating Large Language Models (LLMs) is Multiple-Choice Question Answering (MCQA). While open-ended question answering tasks are more challenging to evaluate, MCQA tasks are, in principle, easier to…

计算与语言 · 计算机科学 2025-06-10 Francesco Maria Molfese , Luca Moroni , Luca Gioffré , Alessandro Scirè , Simone Conia , Roberto Navigli

Effective prioritization of issue reports in software engineering helps to optimize resource allocation and information recovery. However, manual issue classification is laborious and lacks scalability. As an alternative, many open source…

软件工程 · 计算机科学 2025-06-03 Gabriel Aracena , Kyle Luster , Fabio Santos , Igor Steinmacher , Marco A. Gerosa

Grammatical error detection and automated essay scoring are two tasks in the area of automated assessment. Traditionally these tasks have been treated independently with different machine learning models and features used for each task. In…

计算与语言 · 计算机科学 2018-01-23 Ronan Cummins , Marek Rei

Integrating Artificial Intelligence (AI) in educational settings has brought new learning approaches, transforming the practices of both students and educators. Among the various technologies driving this transformation, Large Language…

计算与语言 · 计算机科学 2025-06-06 Giorgio Biancini , Alessio Ferrato , Carla Limongelli

As personalized learning gains increasing attention in mathematics education, there is a growing demand for intelligent systems that can assess complex student responses and provide individualized feedback in real time. In this study, we…

计算机与社会 · 计算机科学 2025-10-01 Yong Oh Lee , Byeonghun Bang , Joohyun Lee , Sejun Oh

This paper describes a rapid feasibility study of using GPT-4, a large language model (LLM), to (semi)automate data extraction in systematic reviews. Despite the recent surge of interest in LLMs there is still a lack of understanding of how…

User reviews on e-commerce and review sites are crucial for making purchase decisions, although creating detailed reviews is time-consuming and labor-intensive. In this study, we propose a novel use of dialogue systems to facilitate user…

人机交互 · 计算机科学 2026-03-10 Yoshiki Tanaka , Michimasa Inaba

This study investigates the application effectiveness of the Large Language Model (LLMs) ChatGLM in the automated generation of high school information technology exam questions. Through meticulously designed prompt engineering strategies,…

计算机与社会 · 计算机科学 2024-08-22 Yanxin Chen , Ling He