Related papers: Can multiple-choice questions simulate free-respon…
Multiple-choice questions (MCQ) are frequently used to assess large language models (LLMs). Typically, an LLM is given a question and selects the answer deemed most probable after adjustments for factors like length. Unfortunately, LLMs may…
The Colorado Upper-division Electrostatics (CUE) diagnostic was designed as an open-ended assessment in order to capture elements of student reasoning in upper-division electrostatics. The diagnostic has been given for many semesters at…
Quantum mechanics is a challenging subject, even for advanced undergraduate and graduate students. Here, we discuss the development and evaluation of research-based concept tests for peer instruction as a formative assessment tool in…
Multiple-Choice Questions (MCQs) are often used to assess knowledge, reasoning abilities, and even values encoded in large language models (LLMs). While the effect of multilingualism has been studied on LLM factual recall, this paper seeks…
The QuVis Quantum Mechanics Visualization project aims to address challenges of quantum mechanics instruction through the development of interactive simulations for the learning and teaching of quantum mechanics. In this article, we…
Automated answer validation can help improve learning outcomes by providing appropriate feedback to learners, and by making question answering systems and online learning solutions more widely available. There have been some works in…
Large Language Models (LLMs) have been evaluated using diverse question types, e.g., multiple-choice, true/false, and short/long answers. This study answers an unexplored question about the impact of different question types on LLM accuracy…
In a companion paper, we discuss students' ability to take advantage of what they learn from a solved problem and transfer their learning to solve a quiz problem that has different surface features but the same underlying physics…
This short contribution reports the development of a test for assessing middle school students' physics proficiency via multiple-choice single-select items in German language. The test assesses students' content and procedural knowledge…
Students' curiosity often seems nearly nonexistent in a lecture setting; we discuss a variety of possible reasons for this, but it is the instructor who typically poses questions while only a few students, usually the better ones, respond.…
Students in introductory physics courses often rely on ineffective strategies, focusing on final answers rather than understanding underlying principles. Integrating scientific argumentation into problem-solving fosters critical thinking…
Questions involving commonsense reasoning about everyday situations often admit many $\textit{possible}$ or $\textit{plausible}$ answers. In contrast, multiple-choice question (MCQ) benchmarks for commonsense reasoning require a hard…
One of the most widely used tasks for evaluating Large Language Models (LLMs) is Multiple-Choice Question Answering (MCQA). While open-ended question answering tasks are more challenging to evaluate, MCQA tasks are, in principle, easier to…
A goal of Introductory Physics for Life Sciences (IPLS) curricula is to prepare students to effectively use physical models and quantitative reasoning in biological and medical settings. To assess whether this goal is being met, we…
Project-based assessment, in the form of take-home exams, was trialed in an honours/masters level electromagnetic theory course. This assessment formed an integral part of the learning experience of the students, and students felt that this…
Helping students learn to think like a physicist is an important goal of many introductory physics courses. One characteristic distinguishing more experienced physicists from novice students is that they make better use of problem solving…
Technical interviews are a critical yet stressful step in the hiring process for computer science graduates, often hindered by limited access to practice opportunities. This formative qualitative study (n=20) explores whether a multimodal…
The use of new technologies in higher education has surprisingly emphasized students' tendency to adopt a passive behavior in class. Participation and interaction of students are essential to improve academic results. This paper describes…
We propose an approach to quantum computing in which quantum gate strengths are parametrized by quantum degrees of freedom, and the capability of the quantum computer to perform desired tasks is monitored and gradually improved by…
This paper investigates personalization in the field of intelligent tutoring systems (ITS). We hypothesize that personalization in the way questions are asked improves student learning outcomes. Previous work on dialogue-based ITS…