English
Related papers

Related papers: Calibrated sensitivity models

200 papers

Explaining and interpreting the decisions of recommender systems are becoming extremely relevant both, for improving predictive performance, and providing valid explanations to users. While most of the recent interest has focused on…

Information Retrieval · Computer Science 2019-06-19 Rishabh Jain , Pranava Madhyastha

Unobserved confounders are a long-standing issue in causal inference using propensity score methods. This study proposed nonparametric indices to quantify the impact of unobserved confounders through pseudo-experiments with an application…

Methodology · Statistics 2020-08-27 Beilin Jia , Donglin Zeng , Qing Yang , Wei Pan

Many definitions of fairness or inequity involve unobservable causal quantities that cannot be directly estimated without strong assumptions. For instance, it is particularly difficult to estimate notions of fairness that rely on…

Machine Learning · Computer Science 2024-12-10 Yewon Byun , Dylan Sam , Michael Oberst , Zachary C. Lipton , Bryan Wilder

Calibration refers to the estimation of unknown parameters which are present in computer experiments but not available in physical experiments. An accurate estimation of these parameters is important because it provides a scientific…

Methodology · Statistics 2019-03-21 Chih-Li Sung , Ying Hung , William Rittase , Cheng Zhu , C. F. Jeff Wu

How should researchers analyze randomized experiments in which the main outcome is latent and measured in multiple ways but each measure contains some degree of error? We first identify a critical study-specific noncomparability problem in…

Econometrics · Economics 2026-01-13 Jiawei Fu , Donald P. Green

Machine learning practice is often impacted by confounders. Confounding can be particularly severe in remote digital health studies where the participants self-select to enter the study. While many different confounding adjustment…

Applications · Statistics 2019-11-14 Elias Chaibub Neto , Meghasyam Tummalacherla , Lara Mangravite , Larsson Omberg

Mediation analysis assesses the extent to which the exposure affects the outcome indirectly through a mediator and the extent to which it operates directly through other pathways. The popular Baron-Kenny approach estimates the indirect and…

Methodology · Statistics 2025-04-08 Mingrui Zhang , Peng Ding

We study the estimation of causal parameters when not all confounders are observed and instead negative controls are available. Recent work has shown how these can enable identification and efficient estimation via two so-called bridge…

Machine Learning · Statistics 2022-10-11 Nathan Kallus , Xiaojie Mao , Masatoshi Uehara

Recommender systems are seen as an effective tool to address information overload, but it is widely known that the presence of various biases makes direct training on large-scale observational data result in sub-optimal prediction…

Information Retrieval · Computer Science 2023-04-19 Haoxuan Li , Yanghao Xiao , Chunyuan Zheng , Peng Wu

Estimation of model parameters of computer simulators, also known as calibration, is an important topic in many engineering applications. In this paper, we consider the calibration of computer model parameters with the help of engineering…

Applications · Statistics 2020-01-01 Yan Wang , Xiaowei Yue , Rui Tuo , Jeffrey H. Hunt , Jianjun Shi

Inverse Uncertainty Quantification (UQ), or Bayesian calibration, is the process to quantify the uncertainties of random input parameters based on experimental data. The introduction of model discrepancy term is significant because…

Applications · Statistics 2019-07-24 Xu Wu , Koroush Shirvan , Tomasz Kozlowski

Unobserved confounding is a central barrier to drawing causal inferences from observational data. Several authors have recently proposed that this barrier can be overcome in the case where one attempts to infer the effects of several…

Machine Learning · Statistics 2019-03-20 Alexander D'Amour

Unbiased confidence estimates of neural networks are crucial especially for safety-critical applications. Many methods have been developed to calibrate biased confidence estimates. Though there is a variety of methods for classification,…

Computer Vision and Pattern Recognition · Computer Science 2020-12-15 Fabian Küppers , Jan Kronenberger , Amirhossein Shantia , Anselm Haselhoff

In observational studies, the identification of causal estimands depends on the no unmeasured confounding (NUC) assumption. As this assumption is not testable from observed data, sensitivity analysis plays an important role in observational…

Methodology · Statistics 2023-09-28 Md Abdul Basit , Mahbub A. H. M. Latif , Abdus S Wahed

Background: The E-value has become widely used for assessing robustness to unmeasured confounding in observational studies, but the original framework was developed for single time-point exposure-outcome settings. This study extends the…

Applications · Statistics 2026-03-02 Md. Niamul Islam Sium

Reasoning language models have set state-of-the-art (SOTA) records on many challenging benchmarks, enabled by multi-step reasoning induced using reinforcement learning. However, like previous language models, reasoning models are prone to…

Artificial Intelligence · Computer Science 2025-07-21 Zhiting Mei , Christina Zhang , Tenny Yin , Justin Lidard , Ola Shorinwa , Anirudha Majumdar

Applications such as weather forecasting and personalized medicine demand models that output calibrated probability estimates---those representative of the true likelihood of a prediction. Most models are not calibrated out of the box but…

Machine Learning · Computer Science 2020-02-03 Ananya Kumar , Percy Liang , Tengyu Ma

In estimating the average treatment effect in observational studies, the influence of confounders should be appropriately addressed. To this end, the propensity score is widely used. If the propensity scores are known for all the subjects,…

Methodology · Statistics 2023-12-08 Chengyao Tang , Yi Zhou , Ao Huang , Satoshi Hattori

Inference of physical parameters from reference data is a well studied problem with many intricacies (inconsistent sets of data due to experimental systematic errors, approximate physical models...). The complexity is further increased when…

Data Analysis, Statistics and Probability · Physics 2017-09-06 Pascal Pernot , Fabien Cailliez

Suppose (standardized) measurements or statistics are monitored to raise an alarm when a threshold is exceeded. Often, the underlying population is heterogenous with respect to important discrete variables and thus samples may consist of…

Statistics Theory · Mathematics 2025-10-10 Ansgar Steland