English
Related papers

Related papers: AI-Assisted Model for Generating Multiple-Choice Q…

200 papers

Multiple choice question answering (MCQA) is popular for LLM evaluation due to its simplicity and human-like testing, but we argue for its reform. We first reveal flaws in MCQA's format, as it struggles to: 1) test generation/subjectivity;…

Computation and Language · Computer Science 2025-06-03 Nishant Balepur , Rachel Rudinger , Jordan Lee Boyd-Graber

The use of question-based activities (QBAs) is wide-spread in education, traditionally forming an integral part of the learning and assessment process. In this paper, we design and evaluate an automated question generation tool for…

Computation and Language · Computer Science 2023-09-27 Ayan Kumar Bhowmick , Ashish Jagmohan , Aditya Vempaty , Prasenjit Dey , Leigh Hall , Jeremy Hartman , Ravi Kokku , Hema Maheshwari

Recent advances in large language models (LLMs) have made automated multiple-choice question (MCQ) generation increasingly feasible; however, reliably producing items that satisfy controlled cognitive demands remains a challenge. To address…

Computation and Language · Computer Science 2026-02-04 Yu Tian , Linh Huynh , Katerina Christhilf , Shubham Chakraborty , Micah Watanabe , Tracy Arner , Danielle McNamara

Automatic question generation is an important technique that can improve the training of question answering, help chatbots to start or continue a conversation with humans, and provide assessment materials for educational purposes. Existing…

Computation and Language · Computer Science 2019-02-28 Bang Liu , Mingjun Zhao , Di Niu , Kunfeng Lai , Yancheng He , Haojie Wei , Yu Xu

Multiple-choice questions (MCQs) are commonly used in educational testing, as they offer an efficient means of evaluating learners' knowledge. However, generating high-quality MCQs, particularly in low-resource languages such as Persian,…

Computation and Language · Computer Science 2025-10-20 Mohammad Heydari Rad , Rezvan Afari , Saeedeh Momtazi

Question generation (QG) is the task of generating a valid and fluent question based on a given context and the target answer. According to various purposes, even given the same context, instructors can ask questions about different…

Computation and Language · Computer Science 2023-05-29 Shinhyeok Oh , Hyojun Go , Hyeongdon Moon , Yunsung Lee , Myeongho Jeong , Hyun Seung Lee , Seungtaek Choi

Obtaining training data for multi-hop question answering (QA) is time-consuming and resource-intensive. We explore the possibility to train a well-performed multi-hop QA model without referencing any human-labeled multi-hop question-answer…

Computation and Language · Computer Science 2021-04-13 Liangming Pan , Wenhu Chen , Wenhan Xiong , Min-Yen Kan , William Yang Wang

Students often do not fully understand the code they have written. This sometimes does not become evident until later in their education, which can mean it is harder to fix their incorrect knowledge or misunderstandings. In addition, being…

Software Engineering · Computer Science 2025-05-23 Martin Goodfellow , Robbie Booth , Andrew Fagan , Alasdair Lambert

In education, open-ended quiz questions have become an important tool for assessing the knowledge of students. Yet, manually preparing such questions is a tedious task, and thus automatic question generation has been proposed as a possible…

Computation and Language · Computer Science 2021-08-31 Kristiyan Vachev , Momchil Hardalov , Georgi Karadzhov , Georgi Georgiev , Ivan Koychev , Preslav Nakov

Automatic question generation (QG) is essential for AI and NLP, particularly in intelligent tutoring, dialogue systems, and fact verification. Generating multiple-choice questions (MCQG) for professional exams, like the United States…

Computation and Language · Computer Science 2025-02-11 Zonghai Yao , Aditya Parashar , Huixue Zhou , Won Seok Jang , Feiyun Ouyang , Zhichao Yang , Hong Yu

This research suggests an add-on to empower Google Forms to be an automatic machine for generating multiple-choice questions (MCQs) used in online assessments. In this paper, we elaborate an add-on design mainly comprising…

Computation and Language · Computer Science 2021-10-29 Pornpat Sirithumgul , Pimpaka Prasertsilp , Lorne Olfman

While large language models (LLMs) challenge conventional methods of teaching and learning, they present an exciting opportunity to improve efficiency and scale high-quality instruction. One promising application is the generation of…

Artificial intelligence (AI) technology enables a range of enhancements in computer-aided instruction, from accelerating the creation of teaching materials to customizing learning paths based on learner outcomes. However, ensuring the…

Computers and Society · Computer Science 2025-11-19 Christina Perdikoulias , Chad Vance , Stephen M. Watt

The difficulty of multiple-choice questions (MCQs) is a crucial factor for educational assessments. Predicting MCQ difficulty is challenging since it requires understanding both the complexity of reaching the correct option and the…

Artificial Intelligence · Computer Science 2025-03-12 Wanyong Feng , Peter Tran , Stephen Sireci , Andrew Lan

Multi-hop Question Generation is the task of generating questions which require the reader to reason over and combine information spread across multiple passages using several reasoning steps. Chain-of-thought rationale generation has been…

Computation and Language · Computer Science 2022-11-17 Saurabh Kulshreshtha , Anna Rumshisky

Suggested questions (SQs) provide an effective initial interface for users to engage with their documents in AI-powered reading applications. In practical reading sessions, users have diverse backgrounds and reading goals, yet current SQ…

Computation and Language · Computer Science 2024-12-19 Zihao Lin , Zichao Wang , Yuanting Pan , Varun Manjunatha , Ryan Rossi , Angela Lau , Lifu Huang , Tong Sun

Generative AI is transforming the educational landscape, raising significant concerns about cheating. Despite the widespread use of multiple-choice questions in assessments, the detection of AI cheating in MCQ-based tests has been almost…

Artificial Intelligence · Computer Science 2024-12-13 Alona Strugatski , Giora Alexandron

Question generation (QG) attempts to solve the inverse of question answering (QA) problem by generating a natural language question given a document and an answer. While sequence to sequence neural models surpass rule-based systems for QG,…

Computation and Language · Computer Science 2020-11-03 Deepak Gupta , Hardik Chauhan , Akella Ravi Tej , Asif Ekbal , Pushpak Bhattacharyya

In an educational setting, an estimate of the difficulty of multiple-choice questions (MCQs), a commonly used strategy to assess learning progress, constitutes very useful information for both teachers and students. Since human assessment…

Computation and Language · Computer Science 2025-04-21 Leonidas Zotos , Hedderik van Rijn , Malvina Nissim

Automated testing tools typically create test cases that are different from what human testers create. This often makes the tools less effective, the created tests harder to understand, and thus results in tools providing less support to…

Software Engineering · Computer Science 2021-03-09 Eduard Enoiu , Robert Feldt