Related papers: Measuring a moving target -- Innovation studies in…
Despite the growing interest in jailbreak methods as an effective red-teaming tool for building safe and responsible large language models (LLMs), flawed evaluation system designs have led to significant discrepancies in their effectiveness…
The application of mathematics and statistical methods to scholarly communication: scientometrics, has facilitated the systematic analysis of the modern digital tide of literature. This chapter reviews three of such applications:…
Despite the extraordinary successes the two great bastions of $20^{th}$ century science (Quantum Theory and General Relativity) are troubled with serious conceptual and mathematical difficulties. As a result, further growth of fundamental…
Context: Dynamic production environments make it challenging to maintain reliable machine learning (ML) systems. Runtime issues, such as changes in data patterns or operating contexts, that degrade model performance are a common occurrence…
We are witnessing a rapid trend towards the adoption of exercises for evaluation of national research systems, generally based on the peer review approach. They respond to two main needs: stimulating higher efficiency in research activities…
Understanding the world and explaining it with scientific theories is a central aspiration of artificial intelligence research. Proposing theories, designing experiments to test them, and then revising them based on data are fundamental to…
Measurement bridges theory and empirics. Without measures that appropriately capture theoretical concepts, description will fail to represent reality and true causal inference will be impossible. Yet, the social sciences traffic in complex…
The purpose of this paper is to survey some topics on mathematical foundations of quantum information developed mainly by the present author and co-workers for the last three decades. The topics include an axiomatic construction of quantum…
Measurement-induced entanglement (MIE) captures how local measurements generate long-range quantum correlations and drive dynamical phase transitions in many-body systems. Yet estimating MIE experimentally remains challenging: direct…
Measurement uncertainty is an important topic in the undergraduate laboratory curriculum. Previous research on student thinking about experimental measurement uncertainty has focused primarily on introductory-level students' procedural…
The academic publishing world is changing significantly, with ever-growing numbers of publications each year and shifting publishing patterns. However, the metrics used to measure academic success, such as the number of publications,…
Citation metrics are becoming pervasive in the quantitative evaluation of scholars, journals and institutions. More then ever before, hiring, promotion, and funding decisions rely on a variety of impact metrics that cannot disentangle…
This study attempts to establish a basis for understanding how methods used in research in solar physics have evolved since World War II (WWII). The goal is to begin to explore if and how the changing research environment affects the…
This study explores how scientometric data and indicators are used to transform science systems in a selection of countries in the Middle East and North Africa. I propose that scientometric-based rules inform such transformation. First, the…
In recent years, Data Science has become increasingly relevant as a support tool for industry, significantly enhancing decision-making in a way never seen before. In this context, the MLOps discipline emerges as a solution to automate the…
We start by summarising very briefly the various prior attempts (during the last one and half a decade), some of which were made as independent research centres and others as visiting centres with extensive visiting programs for luminaries…
Research activities are generally observed and evaluated through the prism of their production and financial elements or team composition. In addition to standardized management indicators and bibliometrics, the French National Research…
This paper studies posterior concentration behavior of the base probability measure of a Dirichlet measure, given observations associated with the sampled Dirichlet processes, as the number of observations tends to infinity. The base…
Bibliometrics has the ambitious goal of measuring science. To this end, it exploits the way science is disseminated trough scientific publications and the resulting citation network of scientific papers. We survey the main historical…
Metrics based on reference lists of research articles or on keywords have been used to predict citation impact. The concept behind such metrics is that original ideas stem from the reconfiguration of the structure of past knowledge, and…