English
Related papers

Related papers: From Model to Classroom: Evaluating Generated MCQs…

200 papers

The computing education community has a rich history of pedagogical innovation designed to support students in introductory courses, and to support teachers in facilitating student learning. Very recent advances in artificial intelligence…

With recent advances in large language models (LLMs), the concept of automatically generating children's educational materials has become increasingly realistic. Working toward the goal of age-appropriate simplicity in generated educational…

Computation and Language · Computer Science 2023-10-31 Maria Valentini , Jennifer Weber , Jesus Salcido , Téa Wright , Eliana Colunga , Katharina Kann

We present $\textbf{$\texttt{SkillQG}$}$: a question generation framework with controllable comprehension types for assessing and improving machine reading comprehension models. Existing question generation systems widely differentiate…

Computation and Language · Computer Science 2023-05-09 Xiaoqiang Wang , Bang Liu , Siliang Tang , Lingfei Wu

Despite their sophisticated capabilities, large language models (LLMs) encounter a major hurdle in effective assessment. This paper first revisits the prevalent evaluation method-multiple choice question answering (MCQA), which allows for…

Computation and Language · Computer Science 2024-03-13 Fangyun Wei , Xi Chen , Lin Luo

Question Generation (QG) receives increasing research attention in NLP community. One motivation for QG is that QG significantly facilitates the preparation of educational reading practice and assessments. While the significant advancement…

Computation and Language · Computer Science 2021-12-03 Ying-Hong Chan , Ho-Lam Chung , Yao-Chung Fan

Automatic question generation (AQG) for mathematics education remains an elusive goal for Intelligent Tutoring Systems and educators. While pre-trained transformer-based language models have significantly advanced natural language…

Multiagent Systems · Computer Science 2025-11-07 Kia Karbasi , Kevin Hong , Mohammad Amin Samadi , Gregory Pottie

Question Generation (QG), the task of automatically generating questions from a source input, has seen significant progress in recent years. Difficulty-controllable QG (DCQG) enables control over the difficulty level of generated questions…

Computation and Language · Computer Science 2025-06-10 Bernardo Leite , Henrique Lopes Cardoso

Generating questions along with associated answers from a text has applications in several domains, such as creating reading comprehension tests for students, or improving document search by providing auxiliary questions and answers based…

Computation and Language · Computer Science 2023-05-30 Asahi Ushio , Fernando Alva-Manchego , Jose Camacho-Collados

Background: Over the past few decades, the process and methodology of automated question generation (AQG) have undergone significant transformations. Recent progress in generative natural language models has opened up new potential in the…

Artificial Intelligence · Computer Science 2024-12-06 Dominic Lohr , Marc Berges , Abhishek Chugh , Michael Kohlhase , Dennis Müller

NLP-powered automatic question generation (QG) techniques carry great pedagogical potential of saving educators' time and benefiting student learning. Yet, QG systems have not been widely adopted in classrooms to date. In this work, we aim…

Human-Computer Interaction · Computer Science 2022-05-03 Xu Wang , Simin Fan , Jessica Houghton , Lu Wang

Multiple-choice questions (MCQs) are commonly used in educational testing, as they offer an efficient means of evaluating learners' knowledge. However, generating high-quality MCQs, particularly in low-resource languages such as Persian,…

Computation and Language · Computer Science 2025-10-20 Mohammad Heydari Rad , Rezvan Afari , Saeedeh Momtazi

Evaluating the quality of automatically generated question items has been a long standing challenge. In this paper, we leverage LLMs to simulate student profiles and generate responses to multiple-choice questions (MCQs). The generative…

Human-Computer Interaction · Computer Science 2024-05-30 Xinyi Lu , Xu Wang

Students often do not fully understand the code they have written. This sometimes does not become evident until later in their education, which can mean it is harder to fix their incorrect knowledge or misunderstandings. In addition, being…

Software Engineering · Computer Science 2025-05-23 Martin Goodfellow , Robbie Booth , Andrew Fagan , Alasdair Lambert

With the rapid development of large language models (LLMs), the applications of LLMs have grown substantially. In the education domain, LLMs demonstrate significant potential, particularly in automatic text generation, which enables the…

Computation and Language · Computer Science 2025-11-25 Xingyu Huang , Fei Jiang , Jianli Xiao

Question generation (QGen) models are often evaluated with standardized NLG metrics that are based on n-gram overlap. In this paper, we measure whether these metric improvements translate to gains in a practical setting, focusing on the use…

Computation and Language · Computer Science 2022-05-05 Philippe Laban , Chien-Sheng Wu , Lidiya Murakhovs'ka , Wenhao Liu , Caiming Xiong

Question generation (QG) is a natural language processing task with an abundance of potential benefits and use cases in the educational domain. In order for this potential to be realized, QG systems must be designed and validated with…

Computation and Language · Computer Science 2025-11-05 Sabina Elkins , Ekaterina Kochmar , Jackie C. K. Cheung , Iulian Serban

Question Answering has come a long way from answer sentence selection, relational QA to reading and comprehension. We shift our attention to generative question answering (gQA) by which we facilitate machine to read passages and answer…

Computation and Language · Computer Science 2018-07-10 Rajarshee Mitra

Advances in large language models (LLMs) are rapidly transforming scientific work, yet empirical evidence on how these systems reshape research activities remains limited. We report a mixed-methods pilot evaluation of an AI-orchestrated…

Computers and Society · Computer Science 2026-02-24 Yuan An

Powerful generative models have led to recent progress in question generation (QG). However, it is difficult to measure advances in QG research since there are no standardized resources that allow a uniform comparison among approaches. In…

Computation and Language · Computer Science 2023-01-03 Asahi Ushio , Fernando Alva-Manchego , Jose Camacho-Collados

Artificial intelligence (AI) technology enables a range of enhancements in computer-aided instruction, from accelerating the creation of teaching materials to customizing learning paths based on learner outcomes. However, ensuring the…

Computers and Society · Computer Science 2025-11-19 Christina Perdikoulias , Chad Vance , Stephen M. Watt