Related papers: PHYSICS: Benchmarking Foundation Models on Univers…
Large language models (LLMs) have shown promising potential in scientific research, enabling tasks ranging from knowledge retrieval to property prediction. Existing science benchmarks mainly focus on perceptual or knowledge-based tasks,…
Large language models are now integrated into many scientific workflows, accelerating data analysis, hypothesis generation, and design space exploration. In parallel with this growth, there is a growing need to carefully evaluate whether…
During the past several years the authors have developed a new approach to the teaching of Physical Science, a general education course typically found in the curricula of nearly every college and university. This approach, called `Physics…
The rapid development of artificial intelligence technology is driving the transformation of physics education from traditional models to intelligent and data-driven approaches. To explore the evolution and cutting-edge hotspots in this…
Changing basis is a common task when solving quantum mechanical problems. As part of a research project investigating student understanding of basis and change of basis in quantum mechanics, we developed a tutorial to support students in…
Underlying any theory of physics is a layer of conceptual frames. They connect the mathematical structures used in theoretical models with physical phenomena, but they also constitute our fundamental assumptions about reality. Many of the…
Artificial Intelligence methods to solve continuous- control tasks have made significant progress in recent years. However, these algorithms have important limitations and still need significant improvement to be used in industry and real-…
An assumed attribute of expert physicists is that they learn readily from their own mistakes. Experts are unlikely to make the same mistakes when asked to solve a problem a second time, especially if they have had access to a correct…
We present a list of open questions in mathematical physics. After a historical introduction, a number of problems in a variety of different fields are discussed, with the intention of giving an overall impression of the current status of…
Formal theorem-proving benchmarks enable mechanically verifiable evaluation of mathematical reasoning in large language models. However, existing benchmarks mainly focus on Olympiad-style problems and algebraic domains, leaving…
We introduce a new challenge to test the STEM skills of neural models. The problems in the real world often require solutions, combining knowledge from STEM (science, technology, engineering, and math). Unlike existing datasets, our dataset…
Evaluation is a crucial aspect of human existence and plays a vital role in various fields. However, it is often approached in an empirical and ad-hoc manner, lacking consensus on universal concepts, terminologies, theories, and…
This book intends to give the main definitions and theorems in mathematics which could be useful for workers in theoretical physics. It gives an extensive and precise coverage of the subjects which are addressed, in a consistent and…
Recent studies on large language models (LLMs) and large multimodal models (LMMs) have demonstrated promising skills in various domains including science and mathematics. However, their capability in more challenging and real-world related…
The reader surely knows what particles physics is about: finding building blocks of nature that appear elementary at a given time and study their interactions - so why in the world this essay? The problem is how to arrive at a fundamental…
Mathematics is an essential element of physics problem solving, but experts often fail to appreciate exactly how they use it. Math may be the language of science, but math-in-physics is a distinct dialect of that language. Physicists tend…
Physics graduate teaching assistants (TAs) are often responsible for grading. Physics education research suggests that grading practices that place the burden of proof for explicating the problem solving process on students can help them…
Camera pose estimation is crucial for many computer vision applications, yet existing benchmarks offer limited insight into method limitations across different geometric challenges. We introduce RUBIK, a novel benchmark that systematically…
Particle physics has evolved a coherent model that characterizes forces and particles at the most elementary level. This Standard Model, built from many theoretical and experimental studies, is in excellent accord with almost all current…
We introduce MMMU: a new benchmark designed to evaluate multimodal models on massive multi-discipline tasks demanding college-level subject knowledge and deliberate reasoning. MMMU includes 11.5K meticulously collected multimodal questions…