Related papers: PHYSICS: Benchmarking Foundation Models on Univers…
Developing expertise in physics requires appropriate integration and assimilation of physics and mathematics. Instructors and students often describe physics courses in terms of their emphasis on conceptual and quantitative problem-solving.…
The ability to categorize problems based upon underlying principles, rather than surface features or contexts, is considered one of several proxy predictors of expertise in problem solving. With inspiration from the classic study by Chi,…
New status in quantum mechanics is connected with recent achievements in the inverse problem. With its help instead of about ten exactly solvable models which serve as a basis of the contemporary education there are infinite (!) number,…
Recent physics foundation models claim general spatiotemporal forecasting ability, yet their evaluations often collapse performance into a single average score under a fixed training distribution. This makes it difficult to determine…
Compared with introductory physics, relatively little is known about the development of expertise in advanced physics courses, especially in the case of quantum mechanics. Here, we describe a framework for understanding the patterns of…
If students are to successfully grapple with authentic, complex biological problems as scientists and citizens, they need practice solving such problems during their undergraduate years. Physics education researchers have investigated…
Physics Engines (PEs) are fundamental software frameworks that simulate physical interactions in applications ranging from entertainment to safety-critical systems. Despite their importance, PEs suffer from physics failures, deviations from…
Helping students become proficient problem solvers is a major goal of many physics courses from introductory to advanced levels. In fact, physics has often been used by cognitive scientists to investigate the differences between the…
Students' difficulties in quantum mechanics may be the result of unproductive framing rather than a fundamental inability to solve the problems or misconceptions about physics content. Using the theoretical lens of epistemological framing,…
We argue that most advances in science and technology during the past and the present centuries rely on modern physics concepts developed in the early $20$th century. The reliance is so profound that any improvement of literacy of science…
We introduce, a large-scale synthetic benchmark of 15,045 university-level physics problems (90/10% train/test split). Each problem is fully parameterized, supporting an effectively infinite range of input configurations, and is accompanied…
This book includes my lectures, together with their problem sets and solutions, on 1) classical mechanics (one semester), 2) thermodynamics and statistical mechanics (one semester), and 3) quantum mechanics (one semester), which I have been…
Solving partial differential equations (PDEs) with machine learning has recently attracted great attention, as PDEs are fundamental tools for modeling real-world systems that range from fundamental physical science to advanced engineering…
We introduce AEGIS, A holistic benchmark for Evaluating forensic analysis of AI-Generated academic ImageS. Compared to existing benchmarks, AEGIS features three key advances: (1) Domain-Specific Complexity: covering seven academic…
The rapid advancement of large reasoning models has saturated existing math benchmarks, underscoring the urgent need for more challenging evaluation frameworks. To address this, we introduce OlymMATH, a rigorously curated, Olympiad-level…
We discuss the categorization of 20 quantum mechanics problems by 6 physics professors and 22 undergraduate students from two honors-level quantum mechanics courses. Professors and students were asked to categorize the problems based upon…
We propose a fluid-rigid body interaction benchmark problem, consisting of a solid spherical obstacle in a Newtonian fluid, whose centre of mass is fixed but is free to rotate. A number of different problems are defined for both two and…
Comparative evaluation lies at the heart of science, and determining the accuracy of a computational method is crucial for evaluating its potential as well as for guiding future efforts. However, metrics that are typically used have…
Education is a goal-oriented field. But if we want to treat education scientifically so we can accumulate, evaluate, and refine what we learn, then we must develop a theoretical framework that is strongly rooted in objective observations…
With inspiration from the classic study by Chi, Feltovich, and Glaser [1], we asked introductory physics students in three introductory physics classes to categorize mechanics problems based upon similarity of solutions. To evaluate the…