English
Related papers

Related papers: Sensitivity Measures Based on Scoring Functions

200 papers

Observational studies provide invaluable opportunities to draw causal inference, but they may suffer from biases due to pretreatment difference between treated and control units. Matching is a popular approach to reduce observed covariate…

Methodology · Statistics 2025-09-17 Xinran Li

Items in a test are often used as a basis for making decisions and such tests are therefore required to have good psychometric properties, like unidimensionality. In many cases the sum score is used in combination with a threshold to decide…

Methodology · Statistics 2020-07-14 Lourens Waldorp , Maarten Marsman , Denny Borsboom

In this paper, we investigate score function-based tests to check the significance of an ultrahigh-dimensional sub-vector of the model coefficients when the nuisance parameter vector is also ultrahigh-dimensional in linear models. We first…

Methodology · Statistics 2024-11-12 Weichao Yang , Xu Guo , Lixing Zhu

Variance-based sensitivity indices have established themselves as a reference among practitioners of sensitivity analysis of model output. It is not unusual to consider a variance-based sensitivity analysis as informative if it produces at…

Causal inference necessarily relies upon untestable assumptions; hence, it is crucial to assess the robustness of obtained results to violations of identification assumptions. However, such sensitivity analysis is only occasionally…

Methodology · Statistics 2025-05-19 Tobias Freidling , Qingyuan Zhao

Typically, point forecasting methods are compared and assessed by means of an error measure or scoring function, such as the absolute error or the squared error. The individual scores are then averaged over forecast cases, to result in a…

Statistics Theory · Mathematics 2010-03-09 Tilmann Gneiting

The hierarchically orthogonal functional decomposition of any measurable function f of a random vector X=(X_1,...,X_p) consists in decomposing f(X) into a sum of increasing dimension functions depending only on a subvector of X. Even when…

Applications · Statistics 2014-05-22 Gaelle Chastaing , Clémentine Prieur , Fabrice Gamboa

We present an exact approach to analyze and quantify the sensitivity of higher moments of probabilistic loops with symbolic parameters, polynomial arithmetic and potentially uncountable state spaces. Our approach integrates methods from…

Programming Languages · Computer Science 2023-09-06 Marcel Moosbrugger , Julian Müllner , Laura Kovács

The use of tiered warnings and multicategorical forecasts are ubiquitous in meteorological operations. Here, a flexible family of scoring functions is presented for evaluating the performance of ordered multicategorical forecasts. Each…

Applications · Statistics 2022-05-02 Robert Taggart , Nicholas Loveday , Deryn Griffiths

Learning systems match predicted scores to observations over some domain. Often, it is critical to produce accurate predictions in some subset (or region) of the domain, yet less important to accurately predict in other regions. We…

Machine Learning · Computer Science 2025-06-11 Gil I. Shamir , Manfred K. Warmuth

Complex models are often used to understand interactions and drivers of human-induced and/or natural phenomena. It is worth identifying the input variables that drive the model output(s) in a given domain and/or govern specific model…

Methodology · Statistics 2023-11-07 Matieyendou Lamboni

One of the fundamental challenges in drawing causal inferences from observational studies is that the assumption of no unmeasured confounding is not testable from observed data. Therefore, assessing sensitivity to this assumption's…

Methodology · Statistics 2024-06-25 Md Abdul Basit , Mahbub A. H. M. Latif , Abdus S Wahed

Nowadays, the numerical models of real-world structures are more precise, more complex and, of course, more time-consuming. Despite the growth of a computational effort, the exploration of model behaviour remains a complex task. The…

Computational Engineering, Finance, and Science · Computer Science 2014-10-17 Eliska Janouchova , Anna Kucerova

Instrumental variables regression is a tool that is commonly used in the analysis of observational data. The instrumental variables are used to make causal inference about the effect of a certain exposure in the presence of unmeasured…

Methodology · Statistics 2023-09-07 Valentin Vancak , Arvid Sjölander

This paper assumes a robust stochastic model where a set $\mathcal{P}$ of probability measures replaces the single probability measure of dominated models. We introduce and study $\mathcal{P}$-sensitive functions defined on robust function…

Probability · Mathematics 2026-01-28 Johannes Langner , Gregor Svindland

A functional risk curve gives the probability of an undesirable event as a function of the value of a critical parameter of a considered physical system. In several applicative situations, this curve is built using phenomenological…

Statistics Theory · Mathematics 2017-07-26 Bertrand Iooss , Loïc Le Gratiet

Sensitivity indices are commonly used to quantify the relative influence of any specific group of input variables on the output of a computer code. One crucial question is then to decide whether a given set of variables has a significant…

Statistics Theory · Mathematics 2022-04-05 Thierry Klein , Nicolas Peteilh , Paul Rochet

Causal graphs may inform covariate adjustment for estimating causal effects and improve estimation efficiency by exploiting the graphical structure. In many applications, however, the target causal parameter may not be point-identified due…

Several real-life applications require crafting concise, quantitative scoring functions (also called rating systems) from measured observations. For example, an effectiveness score needs to be created for advertising campaigns using a…

Machine Learning · Computer Science 2025-04-01 Ragja Palakkadavath , Sarath Sivaprasad , Shirish Karande , Niranjan Pedanekar

In this paper we propose an extension of the classical Sobol' estimator for the estimation of variance based sensitivity indices. The approach assumes a linear correlation model between the input variables which is used to decompose the…

Methodology · Statistics 2024-08-12 Thomas Most