Related papers: Can multiple-choice questions simulate free-respon…
End-of-course assessments play important roles in the ongoing attempt to improve instruction in physics courses. Comparison of students' performance on assessments before and after instruction gives a measure of student learning. In…
We discuss the development and validation of a conceptual multiple-choice survey instrument called the Survey of Thermodynamic Processes and First and Second Laws (STPFaSL) suitable for introductory physics courses. The survey instrument…
Yes, repurposing multiple-choice question-answering (MCQA) models for document reranking is both feasible and valuable. This preliminary work is founded on mathematical parallels between MCQA decision-making and cross-encoder semantic…
Difficulty adjustment in practice exercises has been shown to be beneficial for learning. However, previous research has mostly investigated close-ended tasks, which do not offer the students multiple ways to reach a valid solution.…
In the last several years, the field of computer assisted language learning has increasingly focused on computer aided question generation. However, this approach often provides test takers with an exhaustive amount of questions that are…
We discuss a case study of the influence of epistemology on learning for a student in an introductory college physics course. An analysis of videotaped class work, written work, and interviews indicates that many of the student's…
Computational physics is a key part of what it means to do physics in the twenty-first century. However, upper division computational physics remains a largely understudied area. We set out to understand the experiences of students in an…
Multiple choice benchmarks have long been the workhorse of language model evaluation because grading multiple choice is objective and easy to automate. However, we show multiple choice questions from popular benchmarks can often be answered…
This proposal presents a methodology called enriched three-tier test, based on a similar test previously discussed in the literature. Ours consists of the use of justification and degrees of confidence combined with a multiple-choice test.…
The multi-answer phenomenon, where a question may have multiple answers scattered in the document, can be well handled by humans but is challenging enough for machine reading comprehension (MRC) systems. Despite recent progress in…
We investigated physics students' learning experience and behaviour in a second-year laboratory by analyzing transcribed audio recordings of laboratory sessions. One student group was given both a problem and procedure and asked to analyze…
With an investigation into how students in a physics Master of science program make sense of their whole first year study experience in one of the years following a programme reform, we try to offer insights and advice to consider when…
Prior research has demonstrated how the realist perspectives of classical physics students can translate into specific beliefs about quantum phenomena when taking an introductory modern physics course. Student beliefs regarding the…
Automated question generation is an important approach to enable personalisation of English comprehension assessment. Recently, transformer-based pretrained language models have demonstrated the ability to produce appropriate questions from…
With the increased adoption of E-learning platforms, keeping online learners engaged throughout a lesson is challenging. One approach to tackle this challenge is to probe learn-ers periodically by asking questions. The paper presents an…
The aim of this study is to investigate the decisions and reasoning of undergraduate students when choosing simple measurement instruments in an introductory physics laboratory course. For this study, we have developed a questionnaire and…
Laboratory courses are key components of most undergraduate physics programs. Lab courses often aim to achieve the following learning outcomes: developing students' experimental skills, engaging students in authentic scientific practices,…
Standardized conceptual assessment represents a widely-used tool for educational researchers interested in student learning within the standard undergraduate physics curriculum. For example, these assessments are often used to measure…
Improvements in performance and approval obtained by first year engineering students from University of Concepcion, Chile, were studied, once a virtual didactic model of multiple-choice exam, was implemented. This virtual learning resource…
We discuss the development of a research-based conceptual multiple-choice survey related to magnetism. We also discuss the use of the survey to investigate gender differences in students' difficulties with concepts related to magnetism. We…