English
Related papers

Related papers: Discrepancy measures for sensitivity analysis

200 papers

We consider the inference problem for parameters in stochastic differential equation models from discrete time observations (e.g. experimental or simulation data). Specifically, we study the case where one does not have access to…

Numerical Analysis · Mathematics 2018-04-10 Sebastian Krumscheid

Training a diffusion model approximates a map from a data distribution $\rho$ to the optimal score function $s_t$ for that distribution. Can we differentiate this map? If we could, then we could predict how the score, and ultimately the…

Machine Learning · Computer Science 2025-09-30 Christopher Scarvelis , Justin Solomon

A key objective of decomposition analysis is to identify a factor (the 'mediator') contributing to disparities in an outcome between social groups. In decomposition analysis, a scholarly interest often centers on estimating how much the…

Methodology · Statistics 2022-05-27 Soojin Park , Suyeon Kang , Chioun Lee , Shujie Ma

Quantifying how distinguishable two stochastic processes are lies at the heart of many fields, such as machine learning and quantitative finance. While several measures have been proposed for this task, none have universal applicability and…

Statistical Mechanics · Physics 2020-07-01 Chengran Yang , Felix C. Binder , Mile Gu , Thomas J. Elliott

When data contains measurement errors, it is necessary to make assumptions relating the observed, erroneous data to the unobserved true phenomena of interest. These assumptions should be justifiable on substantive grounds, but are often…

Machine Learning · Statistics 2020-12-24 Noam Finkelstein , Roy Adams , Suchi Saria , Ilya Shpitser

This paper tackles the challenge of detecting unreliable behavior in regression algorithms, which may arise from intrinsic variability (e.g., aleatoric uncertainty) or modeling errors (e.g., model uncertainty). First, we formally introduce…

Machine Learning · Computer Science 2024-06-12 Andres Altieri , Marco Romanelli , Georg Pichler , Florence Alberge , Pablo Piantanida

We introduce estimation and test procedures through divergence minimization for models satisfying linear constraints with unknown parameter. Several statistical examples and motivations are given. These procedures extend the empirical…

Statistics Theory · Mathematics 2008-11-24 Michel Broniatowski , Amor Keziou

We present a new procedure for conducting a sensitivity analysis in matched observational studies. For any candidate test statistic, the approach defines tilted modifications dependent upon the proposed strength of unmeasured confounding.…

Methodology · Statistics 2025-03-14 Colin B. Fogarty

Measuring inter-dataset similarity is an important task in machine learning and data mining with various use cases and applications. Existing methods for measuring inter-dataset similarity are computationally expensive, limited, or…

Machine Learning · Computer Science 2025-05-06 Muhammad Rajabinasab , Anton D. Lautrup , Arthur Zimek

We provide an analytical argument for understanding the likely nature of parameter shifts between those coming from an analysis of a dataset and from a subset of that dataset, assuming differences are down to noise and any intrinsic…

Instrumentation and Methods for Astrophysics · Physics 2020-10-28 Steven Gratton , Anthony Challinor

Causal inference with observational studies often suffers from unmeasured confounding, yielding biased estimators based on the unconfoundedness assumption. Sensitivity analysis assesses how the causal conclusions change with respect to…

Methodology · Statistics 2024-04-01 Sizhu Lu , Peng Ding

We present a flexible framework for learning predictive models that approximately satisfy the equalized odds notion of fairness. This is achieved by introducing a general discrepancy functional that rigorously quantifies violations of this…

Machine Learning · Statistics 2020-06-09 Yaniv Romano , Stephen Bates , Emmanuel J. Candès

The aim of this article is to make a contribution to the Bayesian procedure of testing precise hypotheses for parametric models. For this purpose, we define the Bayesian Discrepancy Measure that allows one to evaluate the suitability of a…

Methodology · Statistics 2022-11-21 Francesco Bertolino , Mara Manca , Monica Musio , Walter Racugno , Laura Ventura

Global sensitivity metrics are essential tools for assessing parameter importance in complex models, particularly when precise information about parameter values is unavailable. In many cases, such metrics are used to provide parameter…

Statistics Theory · Mathematics 2025-11-19 Huiyan Zou , Allison L. Lewis

Measurement system analysis aims to quantify the variability in data attributable to the measurement system and evaluate its contribution to overall data variability. This paper conducts a rigorous theoretical investigation of the…

Applications · Statistics 2025-01-31 Banafsheh Lashkari , Shojaeddin Chenouri

We present a method to analyze sensitivity of frequentist inferences to potential nonignorability of the missingness mechanism. Rather than starting from the selection model, as is typical in such analyses, we assume that the missingness…

Methodology · Statistics 2023-02-09 Heng Chen , Daniel F. Heitjan

In causal inference, sensitivity models assess how unmeasured confounders could alter causal analyses, but the sensitivity parameter -- which quantifies the degree of unmeasured confounding -- is often difficult to interpret. For this…

Methodology · Statistics 2025-09-04 Alec McClean , Zach Branson , Edward H. Kennedy

Assessing sensitivity to unmeasured confounding is an important step in observational studies, which typically estimate effects under the assumption that all confounders are measured. In this paper, we develop a sensitivity analysis…

Methodology · Statistics 2023-09-04 Dan Soriano , Eli Ben-Michael , Peter J. Bickel , Avi Feller , Samuel D. Pimentel

Sensitivity analysis informs causal inference by assessing the sensitivity of conclusions to departures from assumptions. The consistency assumption states that there are no hidden versions of treatment and that the outcome arising…

Methodology · Statistics 2025-12-29 Brian Knaeble , Qinyun Lin , Erich Kummerfeld , Kenneth A. Frank

The sensitivity of parameters in computational science problems is difficult to assess, especially for algorithms with multiple input parameters and diverse outputs. This work seeks to explore sensitivity analysis in the visualization…