English
Related papers

Related papers: Can multiple-choice questions simulate free-respon…

200 papers

Multiple choice exams are widely used to assess candidates across a diverse range of domains and tasks. To moderate question quality, newly proposed questions often pass through pre-test evaluation stages before being deployed into…

Computation and Language · Computer Science 2023-10-17 Adian Liusie , Vatsal Raina , Andrew Mullooly , Kate Knill , Mark J. F. Gales

In image quality assessment, a collective visual quality score for an image or video is obtained from the individual ratings of many subjects. One commonly used format for these experiments is the two-alternative forced choice method. Two…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Mohsen Jenadeleh , Johannes Zagermann , Harald Reiterer , Ulf-Dietrich Reips , Raouf Hamzaoui , Dietmar Saupe

We discuss the effect of administering conceptual and quantitative isomorphic problem pairs (CQIPP) back to back vs. asking students to solve only one of the problems in the CQIPP in introductory physics courses. Students who answered both…

Physics Education · Physics 2016-03-10 Chandralekha Singh

Multiple-choice questions (MCQs) are widely used in the evaluation of large language models (LLMs) due to their simplicity and efficiency. However, there are concerns about whether MCQs can truly measure LLM's capabilities, particularly in…

Computation and Language · Computer Science 2024-05-24 Wangyue Li , Liangzhi Li , Tong Xiang , Xiao Liu , Wei Deng , Noa Garcia

Multiple-choice reading and listening comprehension tests are an important part of language assessment. Content creators for standard educational tests need to carefully curate questions that assess the comprehension abilities of candidates…

Computation and Language · Computer Science 2023-07-04 Vatsal Raina , Adian Liusie , Mark Gales

An earlier investigation found that the performance of advanced students in a quantum mechanics course did not automatically improve from midterm to final exam on identical problems even when they were provided the correct solutions and…

Physics Education · Physics 2016-04-20 Benjamin R. Brown , Andrew Mason , Chandralekha Singh

Many instructors choose to assess their students using open-ended written exam items that require students to show their understanding of physics by solving a problem and/or explaining a concept. Grading these items is fairly time…

Physics Education · Physics 2015-06-15 Cassandra Paul , Wendell H. Potter , Brenda Weiss

A problem faced by many instructors is that of designing exams that accurately assess the abilities of the students. Typically these exams are prepared several days in advance, and generic question scores are used based on rough…

Computers and Society · Computer Science 2018-11-07 Sam Ganzfried , Farzana Yusuf

We investigate student understanding of energy and momentum concepts at the level of introductory physics by designing and administering a 25-item multiple choice test and conducting individual interviews. We find that most students have…

Physics Education · Physics 2019-02-18 Chandralekha Singh , David Rosengran

In this paper, we study the possibility of almost unsupervised Multiple Choices Question Answering (MCQA). Starting from very basic knowledge, MCQA model knows that some choices have higher probabilities of being correct than the others.…

Computation and Language · Computer Science 2021-11-02 Chi-Liang Liu , Hung-yi Lee

A simple model to help students see the connections between a physics course and their engineering major is described. "Bridging" had positive effects on performance, attitude, and motivation, as measured by grade analyses, surveys, and…

Physics Education · Physics 2007-05-23 S. W. Pierson , S. T. Gurland , V. Crawford

Physics education researchers have developed many evidence-based instructional strategies to enhance physics students' conceptual learning. These strategies have historically been tested using assessments such as the Force Concept Inventory…

In education, open-ended quiz questions have become an important tool for assessing the knowledge of students. Yet, manually preparing such questions is a tedious task, and thus automatic question generation has been proposed as a possible…

Computation and Language · Computer Science 2021-08-31 Kristiyan Vachev , Momchil Hardalov , Georgi Karadzhov , Georgi Georgiev , Ivan Koychev , Preslav Nakov

Multiple Choice Questions or MCQs are very important for e-learning. Generally, MCQs are used as a tool for the assessment of student performance at the end of their learning sessions. Can MCQs become an important tool in the process of…

Computers and Society · Computer Science 2015-03-18 Kisor Ray , Saumen Sarkar

Automated methods are becoming increasingly integrated into studies of formative feedback on students' science explanation writing. Most of this work, however, addresses students' responses to short answer questions. We investigate…

Computation and Language · Computer Science 2024-04-19 Mahsa Sheikhi Karizaki , Dana Gnesdilow , Sadhana Puntambekar , Rebecca J. Passonneau

This research suggests an add-on to empower Google Forms to be an automatic machine for generating multiple-choice questions (MCQs) used in online assessments. In this paper, we elaborate an add-on design mainly comprising…

Computation and Language · Computer Science 2021-10-29 Pornpat Sirithumgul , Pimpaka Prasertsilp , Lorne Olfman

Laboratory courses represent a unique and potentially important component of the undergraduate physics curriculum, which can be designed to allow students to authentically engage with the process of experimental physics. Among other…

Physics Education · Physics 2020-02-20 Bethany R. Wilcox , H. J. Lewandowski

This study examines the effects of question type and feedback on learning outcomes in a hybrid graduate-level course. By analyzing data from 32 students over 30,198 interactions, we assess the efficacy of unique versus repeated questions…

Human-Computer Interaction · Computer Science 2024-05-17 Gautam Yadav , Paulo F. Carvalho , Elizabeth A. McLaughlin , Kenneth R. Koedinger

Computer-based tests with randomly generated questions allow a large number of different tests to be generated. Given a fixed number of alternatives for each question, the number of tests that need to be generated before all possible…

Probability · Mathematics 2010-03-04 Charles M. Goldie , Rosie Cornish , Carol L. Robinson

Formally investigating the sources of students' difficulties around specific subjects is crucial for developing appropriate strategies to help students. We have been studying difficulties in understanding magnetism encountered by students…

Physics Education · Physics 2017-01-09 Chandralekha Singh