English
Related papers

Related papers: The $f$-Sensitivity Index

200 papers

Phenomenon of stochastic separability was revealed and used in machine learning to correct errors of Artificial Intelligence (AI) systems and analyze AI instabilities. In high-dimensional datasets under broad assumptions each point can be…

Artificial Intelligence · Computer Science 2021-03-04 Bogdan Grechuk , Alexander N. Gorban , Ivan Y. Tyukin

We present an HSIC-based approach for global sensitivity analysis of broad classes of models with correlated and possibly function-valued inputs and outputs. To this end, we define the total HSIC sensitivity index: a bounded, interpretable,…

Statistics Theory · Mathematics 2026-03-03 Troy Larsen , Alen Alexanderian

This paper introduces the $f$-divergence variational inference ($f$-VI) that generalizes variational inference to all $f$-divergences. Initiated from minimizing a crafty surrogate $f$-divergence that shares the statistical consistency with…

Machine Learning · Computer Science 2021-04-06 Neng Wan , Dapeng Li , Naira Hovakimyan

We consider the estimation of measures of model performance in a target population when covariate and outcome data are available on a sample from some source population and covariate data, but not outcome data, are available on a simple…

Methodology · Statistics 2023-06-16 Jon A. Steingrimsson , Sarah E. Robertson , Issa J. Dahabreh

Multiple imputation is a popular method for handling missing data, with fully conditional specification (FCS) being one of the predominant imputation approaches for multivariable missingness. Unbiased estimation with standard…

Predictions from science and engineering models depend on several input parameters. Global sensitivity analysis quantifies the importance of each input parameter, which can lead to insight into the model and reduced computational cost;…

Numerical Analysis · Mathematics 2016-07-28 Paul G. Constantine , Paul Diaz

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2008-06-26 Marco Zaffalon , Marcus Hutter

Mutual information is widely used in artificial intelligence, in a descriptive way, to measure the stochastic dependence of discrete random variables. In order to address questions such as the reliability of the empirical value, one must…

Artificial Intelligence · Computer Science 2014-08-08 Marco Zaffalon , Marcus Hutter

Multivariate meta-analysis of test accuracy studies when tests are evaluated in terms of sensitivity and specificity at more than one threshold represents an effective way to synthesize results by fully exploiting the data, if compared to…

Methodology · Statistics 2019-01-29 Annamaria Guolo , Duc Khanh To

In this paper, we derive copula-based and empirical dependency models (DMs) for simulating non-independent variables, and then propose a new way for determining the distribution of the model outputs conditional on every subset of inputs.…

Statistics Theory · Mathematics 2022-09-12 Matieyendou Lamboni

Sensitivity analysis for the unconfoundedness assumption is crucial in observational studies. For this purpose, the marginal sensitivity model (MSM) gained popularity recently due to its good interpretability and mathematical properties.…

Methodology · Statistics 2024-02-27 Yao Zhang , Qingyuan Zhao

Observational studies provide invaluable opportunities to draw causal inference, but they may suffer from biases due to pretreatment difference between treated and control units. Matching is a popular approach to reduce observed covariate…

Methodology · Statistics 2025-09-17 Xinran Li

We use the $f-divergence$ also called relative entropy as a measure of diversity between probability densities and review its basic properties. In the sequence we define a few objects which capture relevant information from the sample of a…

Statistics Theory · Mathematics 2012-06-20 A. R. Baigorri , C. R. Goncalves , P. A. A. Resende

Causal inference from observational data is crucial for many disciplines such as medicine and economics. However, sharp bounds for causal effects under relaxations of the unconfoundedness assumption (causal sensitivity analysis) are subject…

Machine Learning · Computer Science 2023-10-17 Dennis Frauen , Valentyn Melnychuk , Stefan Feuerriegel

Global Sensitivity Analysis (GSA) is the study of the influence of any given inputs on the outputs of a model. In the context of engineering design, GSA has been widely used to understand both individual and collective contributions of…

Machine Learning · Statistics 2024-03-06 Yigitcan Comlek , Liwei Wang , Wei Chen

Causal inference methods (instrumental variables, difference-in-differences, regression discontinuity, etc.) are primary tools used across many social science milieus. One area where their application has lagged however, is in the study of…

Econometrics · Economics 2026-04-22 Samuele Centorrino , Christopher F. Parmeter

Variational inference approximates the posterior distribution of a probabilistic model with a parameterized density by maximizing a lower bound for the model evidence. Modern solutions fit a flexible approximation with stochastic gradient…

Machine Learning · Statistics 2017-07-13 Joseph Sakaya , Arto Klami

Epidemic forecasting tools embrace the stochasticity and heterogeneity of disease spread to predict the growth and size of outbreaks. Conceptually, stochasticity and heterogeneity are often modeled as branching processes or as percolation…

Populations and Evolution · Quantitative Biology 2025-07-08 Mariah C. Boudreau , William H. W. Thompson , Christopher M. Danforth , Jean-Gabriel Young , Laurent Hébert-Dufresne

Consider sensitivity analysis to assess the worst-case possible values of counterfactual outcome means and average treatment effects under sequential unmeasured confounding in a longitudinal study with time-varying treatments and…

Statistics Theory · Mathematics 2023-08-31 Zhiqiang Tan

We propose the Sobolev Independence Criterion (SIC), an interpretable dependency measure between a high dimensional random variable X and a response variable Y . SIC decomposes to the sum of feature importance scores and hence can be used…

Machine Learning · Computer Science 2019-11-01 Youssef Mroueh , Tom Sercu , Mattia Rigotti , Inkit Padhi , Cicero Dos Santos