Related papers: The Evaluation Gap in Astronomy -- Explained throu…
Research evaluations and comparison of the assessments of academic institutions (scientific areas, departments, universities etc.) are among the major issues in recent years in higher education systems. One method, followed by some national…
In the field of evaluation research, computer scientists live constantly upon dilemmas and conflicting theories. As evaluation is differently perceived and modeled among educational areas, it is not difficult to become trapped in dilemmas,…
Large language models (LLMs) are increasingly tasked with strategic decision-making under incomplete information, such as in negotiation and policymaking. While LLMs can excel at many such tasks, they also fail in ways that are poorly…
A principal continually decides whether to approve resource allocations to an agent, who exerts private effort to remain eligible. The principal must perform costly inspections to determine the agent's eligibility. We characterize Markov…
This essay delves into the ethical dilemmas encountered within the academic peer review process and investigates the prevailing deficiencies in this system. It highlights how established scholars often adhere to mainstream theories not out…
AI researchers employ not only the scientific method, but also methodology from mathematics and engineering. However, the use of the scientific method - specifically hypothesis testing - in AI is typically conducted in service of…
The rapid uptake of generative artificial intelligence (AI) in higher education is reshaping assessment practices and intensifying concerns around academic integrity, fairness, and learning quality. While institutional responses…
Measuring scientific development is a difficult task. Different metrics have been put forward to evaluate scientific development; in this paper we explore a metric that uses the number of peer-reviewed, and when available non-peer-reviewed…
It is not easy to rationalize how peer review, as the current grassroots of science, can work based on voluntary contributions of reviewers. There is no rationale to write impartial and thorough evaluations. Consequently, there is no risk…
The use of bibliometric indicators in research evaluation has a series of complex impacts on academic inquiry. These systems have gradually spread into a wide range of locations and disciplines, including the humanities. The aim of the…
This Resource Letter provides a guide to research-based assessment instruments (RBAIs) for physics and astronomy classes, but goes beyond physics and astronomy topics to include: attitudes and beliefs about physics, epistemologies and…
The measurement postulate of quantum theory stands in conflict with the laws of thermodynamics and has evoked debate regarding what actually constitutes a measurement. With the help of modern quantum statistical mechanics, we take the first…
The volume of scientific manuscripts is growing faster than the capacity to evaluate them, yet the institutions that govern peer review have remained largely unchanged. The result is a widening mismatch: reviewer scarcity, noisier…
University rankings are increasingly adopted for academic comparison and success quantification, even to establish performance-based criteria for funding assignment. However, rankings are not neutral tools, and their use frequently…
Astrophysical measurements away from the 1 AU orbit of Earth can enable several astrophysical science cases that are challenging or impossible to perform from Earthbound platforms, including: building a detailed understanding of the…
A traditional approach to assessing emerging intelligence in the theory of intelligent systems is based on the similarity, "imitation" of human-like actions and behaviors, benchmarking the performance of intelligent systems on the scale of…
Estimation of time delays from a noisy and gapped data is one of the simplest data analysis problems in astronomy by its formulation. But as history of real experiments show, the work with observed data sets can be quite complex and…
Recent work on the Loeb Scale has provided astronomy a structured framework for assessing anomalous interstellar objects, including a quantitative mapping of a classification ranking, its evolution with the addition of data, and a broader…
Our observed Universe has a very strong arrow of time rooted in its low entropy starting point. This low entropy start can be related to various "tuning puzzles" about the early state of the Universe. Here we explore the relationship…
The recognition of academic excellence is fundamental to the scientific and academic endeavor. However, the term "academic excellence" is often interpreted in different ways, typically, using popular scientometrics such as the H-index,…