Related papers: Two-step benchmarking: Setting more realistically …
Natural language models are often summarized through a high-dimensional set of descriptive metrics including training corpus size, training time, the number of trainable parameters, inference times, and evaluation statistics that assess…
Data Envelopment Analysis (DEA) as mathematical models evaluates the technical efficiency of Decision Making Units (DMU) having multiple inputs and multiple outputs. Researchers are interested in applying DEA models in Multi Attribute…
Data Envelopment Analysis (DEA) appears more than just an instrument of measurement. DEA models can be seen as a mathematical structure for democratic voicing within decisional contexts. Such an important aspect of DEA is enhanced through…
This paper introduces a new specification for the nonparametric production-frontier based on Data Envelopment Analysis (DEA) when dealing with decision-making units whose economic performances are correlated with those of the neighbors…
Multi-criteria decision-making (MCDM) problems involve the evaluation of alternatives based on various minimization and maximization criteria. Similarly, efficiency evaluation (EA) methods assess decision-making units (DMUs) by analyzing…
We introduce DABstep, a novel benchmark for evaluating AI agents on realistic multi-step data analysis tasks. DABstep comprises over 450 real-world challenges derived from a financial analytics platform, requiring models to combine…
Evaluating the efficiency of organizations and branches within an organization is a challenging issue for managers. Evaluation criteria allow organizations to rank their internal units, identify their position concerning their competitors,…
In data envelopment analysis (DEA), the concept of efficiency is examined in either Farrell (DEA) or Pareto senses. In either of these senses, the efficiency status of a decision making unit (DMU) is classified as either weak or strong. It…
This paper proposes a new method to evaluate Decision Making Units (DMUs) under uncertainty using fuzzy Data Envelopment Analysis (DEA). In the proposed multi-objective nonlinear programming methodology both the objective functions and the…
This article presents a Benchmarking methodology to support decision-making for international market selection (IMS). In order to do so, we will be using an output-oriented Data Envelopment Analysis (DEA) model. This methodology considers…
In data envelopment analysis (DEA) literature, the returns to scale (RTS) of an inefficient decision making unit (DMU) is determined at its projected point on the efficient frontier. Under the occurrences of multiple projection points,…
Dynamic multi-objective optimization (DMOO) has recently attracted increasing interest from both academic researchers and engineering practitioners, as numerous real-world applications that evolve over time can be naturally formulated as…
We propose a novel DEA ranking based on a robust optimization viewpoint: the higher ranking for those DMU's that remain efficient even for larger variations of data and vice versa. This ranking can be computed by solving generalized linear…
Assessing the technical efficiency of a set of observations requires that the associated data composed of inputs and outputs are perfectly known. If this is not the case, then biased estimates will likely be obtained. Data Envelopment…
Applications of data envelopment analysis (DEA) show that many inefficient units are projected onto the weakly efficient parts of the frontier when efficiency scores are computed. However this fact disagrees with the main concept of the DEA…
Recent advances in probabilistic modelling have led to a large number of simulation-based inference algorithms which do not require numerical evaluation of likelihoods. However, a public benchmark with appropriate performance metrics for…
Empirical and LLM-based research in model-driven engineering increasingly relies on datasets of software models, for instance, to train or evaluate machine learning techniques for modeling support. These datasets have a significant impact…
We systematically study cornerstones that must be solved to define an air traffic control benchmarking system based on a Data Envelopment Analysis. Primarily, we examine the appropriate decision-making units, what to consider and what to…
In this article, the concepts of technical efficiency, efficiency, effectiveness and productivity are illustrated. It is discussed that when firms are not homogenous, the situation is the same as when each factor has a different unit of…
Measuring Mutual Information (MI) between high-dimensional, continuous, random variables from observed samples has wide theoretical and practical applications. Recent work, MINE (Belghazi et al. 2018), focused on estimating tight…