Related papers: Closing the loop: surveying PIs who have not publi…
References, the mechanism scientists rely on to signal previous knowledge, lately have turned into widely used and misused measures of scientific impact. Yet, when a discovery becomes common knowledge, citations suffer from obliteration by…
The SOAP (Study of Open Access Publishing) project has run a large-scale survey of the attitudes of researchers on, and the experiences with, open access publishing. Around forty thousands answers were collected across disciplines and…
A widely used measure of scientific impact is citations. However, due to their heavy-tailed distribution, citations are fundamentally difficult to predict. Instead, to characterize scientific impact, we address two analogous questions asked…
Challenges to reproducibility and replicability have gained widespread attention, driven by large replication projects with lukewarm success rates. A nascent work has emerged developing algorithms to estimate the replicability of published…
The most commonly used publication metrics for individual researchers are the the total number of publications, the total number of citations, and Hirsch's $h$-index. Each of these is cumulative, and hence increases throughout a…
Today, it is not clear how the impact of research on other areas of society than science should be measured. While peer review and bibliometrics have become standard methods for measuring the impact of research in science, there is not yet…
A functional analysis of the task of observing multiple macroscopic quantum systems over an extended period of time and then reporting the accumulated results is used to investigate the information that must be encoded in the "ready" state…
Higher Education Institutions in the UK and elsewhere are under increasing pressure to measure the impact of their research, which can include how the research has increased scientific engagement amongst the general public. For various…
It is not easy to rationalize how peer review, as the current grassroots of science, can work based on voluntary contributions of reviewers. There is no rationale to write impartial and thorough evaluations. Consequently, there is no risk…
ALMA (Atacama Large Millimeter/submillimeter Array) is the world's largest ground-based facility for observations in the millimeter/submillimeter regime. One of ALMA's outstanding characteristics is the large effort dedicated to the quality…
After several years of intensive technological development Virtual Observatory resources have reached a level of maturity sufficient for their routine scientific exploitation. The Virtual Observatory is starting to be used by astronomers in…
Are existing ways of measuring scientific quality reflecting disadvantages of not being part of giant collaborations? How could possible discrimination be avoided? We propose indices defined for each discipline (subfield) and which count…
Over the past decade, a crisis of confidence in scientific literature has gained attention, particularly in the West. In response, we have seen changes in policy and practice amongst individual researchers and institutions. Greater…
Modern large language model (LLM) services increasingly rely on complex, often abstract operations, such as multi-step reasoning and multi-agent collaboration, to generate high-quality outputs. While users are billed based on token…
The a priori analysis (APA) is discussed as a tool to assess the reliability of grades in standard curricular courses. This unusual, but striking application is presented when teaching the section on data treatment of a Laboratory Course to…
Scientists and inventors set the direction of their work amidst an evolving landscape of questions, opportunities, and challenges. This paper introduces a measurement framework to quantify how far researchers move from their existing…
Science journalism reports current scientific discoveries to non-specialists, aiming to enable public comprehension of the state of the art. However, this task can be challenging as the audience often lacks specific knowledge about the…
In research policy, effective measures that lead to improvements in the generation of knowledge must be based on reliable methods of research assessment, but for many countries and institutions this is not the case. Publication and citation…
Online bibliographic databases have enabled new research through which bibliographic records are analyzed as data about science. Within these records, the acknowledgements sections of papers are often used to draw conclusions about funding…
The research assessments of countries or institutions should reveal their contribution to the advancement of science. Taking into consideration the correlation that exists between scientific impact and number of citations, research…