English
Related papers

Related papers: Generating Adequate Distractors for Multiple-Choic…

200 papers

Multiple-choice cloze questions are commonly used to assess linguistic proficiency and comprehension. However, generating high-quality distractors remains challenging, as existing methods often lack adaptability and control over difficulty…

Computation and Language · Computer Science 2026-05-20 Seokhoon Kang , Yejin Jeon , Seonjeong Hwang , Gary Geunbae Lee

In this paper, we investigate the following two limitations for the existing distractor generation (DG) methods. First, the quality of the existing DG methods are still far from practical use. There is still room for DG quality improvement.…

Computation and Language · Computer Science 2020-10-13 Ho-Lam Chung , Ying-Hong Chan , Yao-Chung Fan

Multiple choice questions (MCQs) are an efficient and common way to assess reading comprehension (RC). Every MCQ needs a set of distractor answers that are incorrect, but plausible enough to test student knowledge. Distractor generation…

Computation and Language · Computer Science 2023-04-12 Bilal Ghanem , Alona Fyshe

In this paper, we tackle the task of distractor generation (DG) for multiple-choice questions. Our study introduces two key designs. First, we propose \textit{retrieval augmented pretraining}, which involves refining the language model…

Computation and Language · Computer Science 2024-06-21 Han-Cheng Yu , Yu-An Shih , Kin-Man Law , Kai-Yu Hsieh , Yu-Chen Cheng , Hsin-Chih Ho , Zih-An Lin , Wen-Chuan Hsu , Yao-Chung Fan

This research is aimed to propose an artificial intelligence algorithm comprising an ontology-based design, text mining, and natural language processing for automatically generating gap-fill multiple choice questions (MCQs). The simulation…

Artificial Intelligence · Computer Science 2021-09-24 Pornpat Sirithumgul , Pimpaka Prasertsilp , Lorne Olfman

Generating high-quality MCQs, especially those targeting diverse cognitive levels and incorporating common misconceptions into distractor design, is time-consuming and expertise-intensive, making manual creation impractical at scale.…

Computation and Language · Computer Science 2025-11-07 Nicy Scaria , Silvester John Joseph Kennedy , Diksha Seth , Ananya Thakur , Deepak Subramani

Automatic multiple-choice question generation (MCQG) is a useful yet challenging task in Natural Language Processing (NLP). It is the task of automatic generation of correct and relevant questions from textual data. Despite its usefulness,…

Computation and Language · Computer Science 2021-05-04 Chidinma A. Nwafor , Ikechukwu E. Onyenwe

In reading comprehension, generating sentence-level distractors is a significant task, which requires a deep understanding of the article and question. The traditional entity-centered methods can only generate word-level or phrase-level…

Computation and Language · Computer Science 2019-11-21 Xiaorui Zhou , Senlin Luo , Yunfang Wu

Large language models (LLMs) are increasingly used to generate distractors for multiple-choice questions (MCQs), especially in domains like math education. However, existing approaches are limited in ensuring that the generated distractors…

Machine Learning · Computer Science 2025-06-10 Nisarg Parikh , Nigel Fernandez , Alexander Scarlatos , Simon Woodhead , Andrew Lan

Multiple choice questions (MCQs) are a popular method for evaluating students' knowledge due to their efficiency in administration and grading. Crafting high-quality math MCQs is a labor-intensive process that requires educators to…

Computation and Language · Computer Science 2024-05-03 Jaewook Lee , Digory Smith , Simon Woodhead , Andrew Lan

We introduce a multi-stage prompting approach (MSP) for the generation of multiple choice questions (MCQs), harnessing the capabilities of GPT models such as text-davinci-003 and GPT-4, renowned for their excellence across various NLP…

Computation and Language · Computer Science 2024-01-17 Subhankar Maity , Aniket Deroy , Sudeshna Sarkar

The use of question-based activities (QBAs) is wide-spread in education, traditionally forming an integral part of the learning and assessment process. In this paper, we design and evaluate an automated question generation tool for…

Computation and Language · Computer Science 2023-09-27 Ayan Kumar Bhowmick , Ashish Jagmohan , Aditya Vempaty , Prasenjit Dey , Leigh Hall , Jeremy Hartman , Ravi Kokku , Hema Maheshwari

We introduce a high-quality dataset that contains 3,397 samples comprising (i) multiple choice questions, (ii) answers (including distractors), and (iii) their source documents, from the educational domain. Each question is phrased in two…

Computation and Language · Computer Science 2022-10-13 Amir Hadifar , Semere Kiros Bitew , Johannes Deleu , Chris Develder , Thomas Demeester

The difficulty of multiple-choice questions (MCQs) is a crucial factor for educational assessments. Predicting MCQ difficulty is challenging since it requires understanding both the complexity of reaching the correct option and the…

Artificial Intelligence · Computer Science 2025-03-12 Wanyong Feng , Peter Tran , Stephen Sireci , Andrew Lan

Manually designing cloze test consumes enormous time and efforts. The major challenge lies in wrong option (distractor) selection. Having carefully-design distractors improves the effectiveness of learner ability assessment. As a result,…

Computation and Language · Computer Science 2024-03-18 Shang-Hsuan Chiang , Ssu-Cheng Wang , Yao-Chung Fan

Distractor generation (DG) remains a labor-intensive task that still significantly depends on domain experts. The task focuses on generating plausible yet incorrect options, known as distractors, for multiple-choice questions. A reliable…

Computation and Language · Computer Science 2026-04-21 Elaf Alhazmi , Quan Z. Sheng , Wei Emma Zhang

Automated question generation is an important approach to enable personalisation of English comprehension assessment. Recently, transformer-based pretrained language models have demonstrated the ability to produce appropriate questions from…

Computation and Language · Computer Science 2022-09-27 Vatsal Raina , Mark Gales

When evaluating a learner's knowledge proficiency, the multiple-choice question is an efficient and widely used format in standardized tests. Nevertheless, generating these questions, particularly plausible distractors (incorrect options),…

Computation and Language · Computer Science 2024-05-30 Runfeng Lin , Dacheng Xu , Huijiang Wang , Zebiao Chen , Yating Wang , Shouqiang Liu

Multiple-choice questions (MCQs) are widely used across diverse educational fields and levels. Well-designed MCQs should evaluate knowledge application in real-world situations. However, writing such test items in sufficient numbers is…

Human-Computer Interaction · Computer Science 2026-02-10 Tetiana Krushynska , Jani Ursin , Ville Heilala

Large Language Models (LLMs) have demonstrated remarkable capabilities in various educational tasks, yet their alignment with human learning patterns, particularly in predicting which incorrect options students are most likely to select in…

Computation and Language · Computer Science 2025-02-24 Naiming Liu , Shashank Sonkar , Richard G. Baraniuk