English
Related papers

Related papers: Proxy-Guided Measurement Calibration

200 papers

The performance of deep neural networks is strongly influenced by the training dataset setup. In particular, when attributes having a strong correlation with the target attribute are present, the trained model can provide unintended…

Machine Learning · Computer Science 2023-02-14 Sumyeong Ahn , Seongyoon Kim , Se-young Yun

Recommendation systems (RS) aim to provide personalized content, but they face a challenge in unbiased learning due to selection bias, where users only interact with items they prefer. This bias leads to a distorted representation of user…

Machine Learning · Computer Science 2025-06-10 Shuqiang Zhang , Yuchao Zhang , Jinkun Chen , Haochen Sui

Parameter estimation and inference from complex survey samples typically focuses on global model parameters whose estimators have asymptotic properties, such as from fixed effects regression models. The central challenge is to both mitigate…

Methodology · Statistics 2026-05-13 Matthew R. Williams , F. Hunter McGuire , Terrance D. Savitsky

This paper discusses the problem of causal query in observational data with hidden variables, with the aim of seeking the change of an outcome when "manipulating" a variable while given a set of plausible confounding variables which affect…

Artificial Intelligence · Computer Science 2020-11-25 Debo Cheng , Jiuyong Li , Lin Liu , Jixue Liu , Kui Yu , Thuc Duy Le

Propensity score methods are widely used for estimating treatment effects from observational studies. A popular approach is to estimate propensity scores by maximum likelihood based on logistic regression, and then apply inverse probability…

Methodology · Statistics 2017-10-24 Zhiqiang Tan

Car-following behavior modeling is critical for understanding traffic flow dynamics and developing high-fidelity microscopic simulation models. Most existing impulse-response car-following models prioritize computational efficiency and…

Applications · Statistics 2025-04-09 Chengyuan Zhang , Wenshuo Wang , Lijun Sun

Inferring causal effects of a treatment, intervention or policy from observational data is central to many applications. However, state-of-the-art methods for causal inference seldom consider the possibility that covariates have missing…

Methodology · Statistics 2020-02-26 Imke Mayer , Julie Josse , Félix Raimundo , Jean-Philippe Vert

Despite the remarkable progress in generative modelling, current diffusion models lack a quantitative approach to assess image quality. To address this limitation, we propose to estimate the pixel-wise aleatoric uncertainty during the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Michele De Vita , Vasileios Belagiannis

In causal inference, interference occurs when the treatment of one unit may affect the outcomes of other units. The goal of this work is to serve as a guide to the use of linear outcome modeling for estimating causal effects in settings…

Methodology · Statistics 2026-04-01 Eric Tong , Salvador V. Balkus

The difference between a model forecast and actual observations is called forecast bias. This bias is due to either incomplete model assumptions and/or poorly known parameter values and initial/boundary conditions. In this paper we discuss…

Computational Engineering, Finance, and Science · Computer Science 2010-11-09 Sean Crowell , S. Lakshmivarahan

In designing risk assessment algorithms, many scholars promote a "kitchen sink" approach, reasoning that more information yields more accurate predictions. We show, however, that this rationale often fails when algorithms are trained to…

Computers and Society · Computer Science 2023-05-23 Michael Zanger-Tishler , Julian Nyarko , Sharad Goel

In safety-critical applications data-driven models must not only be accurate but also provide reliable uncertainty estimates. This property, commonly referred to as calibration, is essential for risk-aware decision-making. In regression a…

Machine Learning · Computer Science 2026-04-23 Jelke Wibbeke , Nico Schönfisch , Sebastian Rohjans , Andreas Rauh

Model calibration is essential for ensuring that the predictions of deep neural networks accurately reflect true probabilities in real-world classification tasks. However, deep networks often produce over-confident or under-confident…

Machine Learning · Computer Science 2025-04-01 Jinxu Lin , Linwei Tao , Minjing Dong , Chang Xu

We study a linear statistical model where outcomes depend on regressors with fixed population coefficients and observation-specific latent coefficients, along with measurement errors. A decision-maker estimates population coefficients and…

Theoretical Economics · Economics 2026-04-15 Junnan He , Lin Hu , Matthew Kovach , Anqi Li

In many domains, it is difficult to obtain the race data that is required to estimate racial disparity. To address this problem, practitioners have adopted the use of proxy methods which predict race using non-protected covariates. However,…

Computers and Society · Computer Science 2024-09-04 Kweku Kwegyir-Aggrey , Naveen Durvasula , Jennifer Wang , Suresh Venkatasubramanian

Hierarchical probabilistic models, such as Gaussian mixture models, are widely used for unsupervised learning tasks. These models consist of observable and latent variables, which represent the observable data and the underlying…

Machine Learning · Statistics 2015-03-26 Keisuke Yamazaki

Often in surveys, key items are subject to measurement errors. Given just the data, it can be difficult to determine the distribution of this error process, and hence to obtain accurate inferences that involve the error-prone variables. In…

Methodology · Statistics 2016-10-04 Tracy Schifeling , Jerome P. Reiter , Maria DeYoreo

Logistic regression is an important statistical tool for assessing the probability of an outcome based upon some predictive variables. Standard methods can only deal with precisely known data, however many datasets have uncertainties which…

Methodology · Statistics 2022-06-09 Nicholas Gray , Scott Ferson

We study online aggregation of the predictions of experts, and first show new second-order regret bounds in the standard setting, which are obtained via a version of the Prod algorithm (and also a version of the polynomially weighted…

Machine Learning · Statistics 2014-02-11 Pierre Gaillard , Gilles Stoltz , Tim Van Erven

Data assimilation performance can be significantly impacted by biased noise in observations, altering the signal magnitude and introducing fast oscillations or discontinuities when the system lacks smoothness. To mitigate these issues, this…

Numerical Analysis · Mathematics 2024-11-05 Felipe Galarce , Joaquin Mura , Alfonso Caiazzo