English
Related papers

Related papers: Interactive MCQs as a tool for Knowledge Acquisiti…

200 papers

The difficulty of multiple-choice questions (MCQs) is a crucial factor for educational assessments. Predicting MCQ difficulty is challenging since it requires understanding both the complexity of reaching the correct option and the…

Artificial Intelligence · Computer Science 2025-03-12 Wanyong Feng , Peter Tran , Stephen Sireci , Andrew Lan

Recently, there have been increasing calls for computer science curricula to complement existing technical training with topics related to Fairness, Accountability, Transparency, and Ethics. In this paper, we present Value Card, an…

Computers and Society · Computer Science 2023-01-11 Hong Shen , Wesley Hanwen Deng , Aditi Chattopadhyay , Zhiwei Steven Wu , Xu Wang , Haiyi Zhu

In this paper, we study the possibility of almost unsupervised Multiple Choices Question Answering (MCQA). Starting from very basic knowledge, MCQA model knows that some choices have higher probabilities of being correct than the others.…

Computation and Language · Computer Science 2021-11-02 Chi-Liang Liu , Hung-yi Lee

Multiple-choice questions (MCQs) are commonly used in educational testing, as they offer an efficient means of evaluating learners' knowledge. However, generating high-quality MCQs, particularly in low-resource languages such as Persian,…

Computation and Language · Computer Science 2025-10-20 Mohammad Heydari Rad , Rezvan Afari , Saeedeh Momtazi

Multiple choice question answering (MCQA) is popular for LLM evaluation due to its simplicity and human-like testing, but we argue for its reform. We first reveal flaws in MCQA's format, as it struggles to: 1) test generation/subjectivity;…

Computation and Language · Computer Science 2025-06-03 Nishant Balepur , Rachel Rudinger , Jordan Lee Boyd-Graber

This article discusses the advantages of using wireless keypads in the Lecture/classroom. This new technology requires multiple-choice (MC) questions to mate with the keypad entry features of these devices. The format of the traditional MC…

Physics Education · Physics 2008-12-25 R. A. Burnstein , L. M. Lederman

Multiple-choice questions (MCQ) are frequently used to assess large language models (LLMs). Typically, an LLM is given a question and selects the answer deemed most probable after adjustments for factors like length. Unfortunately, LLMs may…

Computation and Language · Computer Science 2024-06-12 Aidar Myrzakhan , Sondos Mahmoud Bsharat , Zhiqiang Shen

Educational media mining is the process of converting raw media data from educational systems to useful information that can be used to design learning systems, answer research questions and allow personalized learning experiences.…

Multimedia · Computer Science 2010-01-05 Rajkumar Kannan , Christian Guetl

Automatic multiple-choice question generation (MCQG) is a useful yet challenging task in Natural Language Processing (NLP). It is the task of automatic generation of correct and relevant questions from textual data. Despite its usefulness,…

Computation and Language · Computer Science 2021-05-04 Chidinma A. Nwafor , Ikechukwu E. Onyenwe

Multiple choice questions (MCQs) are widely used in digital learning systems, as they allow for automating the assessment process. However, due to the increased digital literacy of students and the advent of social media platforms, MCQ…

Computation and Language · Computer Science 2022-12-14 Semere Kiros Bitew , Amir Hadifar , Lucas Sterckx , Johannes Deleu , Chris Develder , Thomas Demeester

Multiple-choice reading and listening comprehension tests are an important part of language assessment. Content creators for standard educational tests need to carefully curate questions that assess the comprehension abilities of candidates…

Computation and Language · Computer Science 2023-07-04 Vatsal Raina , Adian Liusie , Mark Gales

Yes, repurposing multiple-choice question-answering (MCQA) models for document reranking is both feasible and valuable. This preliminary work is founded on mathematical parallels between MCQA decision-making and cross-encoder semantic…

Information Retrieval · Computer Science 2025-04-10 Jasper Kyle Catapang

In this paper, we present the step by step knowledge acquisition process by choosing a structured method through using a questionnaire as a knowledge acquisition tool. Here we want to depict the problem domain as, how to evaluate teachers…

Machine Learning · Computer Science 2009-06-26 Hafeez Ullah Amin , Abdur Rashid Khan

Automated question quality rating (AQQR) aims to evaluate question quality through computational means, thereby addressing emerging challenges in online learnersourced question repositories. Existing methods for AQQR rely solely on…

Computation and Language · Computer Science 2021-11-22 Lin Ni , Qiming Bao , Xiaoxuan Li , Qianqian Qi , Paul Denny , Jim Warren , Michael Witbrock , Jiamou Liu

Community question answering (CQA) represents the type of Web applications where people can exchange knowledge via asking and answering questions. One significant challenge of most real-world CQA systems is the lack of effective matching…

Social and Information Networks · Computer Science 2018-07-18 Xianzhi Wang , Chaoran Huang , Lina Yao , Boualem Benatallah , Manqing Dong

Multiple-Choice Questions (MCQs) are often used to assess knowledge, reasoning abilities, and even values encoded in large language models (LLMs). While the effect of multilingualism has been studied on LLM factual recall, this paper seeks…

Computation and Language · Computer Science 2026-02-06 Léo Labat , Etienne Ollion , François Yvon

We focus on multiple-choice question answering (QA) tasks in subject areas such as science, where we require both broad background knowledge and the facts from the given subject-area reference corpus. In this work, we explore simple yet…

Computation and Language · Computer Science 2019-10-03 Xiaoman Pan , Kai Sun , Dian Yu , Jianshu Chen , Heng Ji , Claire Cardie , Dong Yu

In computer simulation of the learning process is usually assumed that all elements of the training material are assimilated equally durable. But in practice, the knowledge, which a student uses in its operations, are remembered much…

Computers and Society · Computer Science 2013-12-20 Robert V Mayer

Effective teaching relies on knowing what students know-or think they know. Revealing student thinking is challenging. Often used because of their ease of grading, even the best multiple choice (MC) tests, those using research based…

Computers and Society · Computer Science 2024-06-12 Michael Klymkowsky , Melanie M. Cooper

Multiple-choice question answering (MCQA) becomes particularly challenging when all choices are relevant to the question and are semantically similar. Yet this setting of MCQA can potentially provide valuable clues for choosing the right…

Computation and Language · Computer Science 2024-08-22 Wenqing Deng , Zhe Wang , Kewen Wang , Shirui Pan , Xiaowang Zhang , Zhiyong Feng