English
Related papers

Related papers: Data integration of non-probability and probabilit…

200 papers

Non-probability sampling is prevailing in survey sampling, but ignoring its selection bias leads to erroneous inferences. We offer a unified nonparametric calibration method to estimate the sampling weights for a non-probability sample by…

Methodology · Statistics 2022-04-21 Zhonglei Wang , Xiaojun Mao , Jae Kwang Kim

Several statistical models are given in the form of unnormalized densities, and calculation of the normalization constant is intractable. We propose estimation methods for such unnormalized models with missing data. The key concept is to…

Machine Learning · Statistics 2020-06-11 Masatoshi Uehara , Takeru Matsuda , Jae Kwang Kim

A set of probabilistic predictions is well calibrated if the events that are predicted to occur with probability p do in fact occur about p fraction of the time. Well calibrated predictions are particularly important when machine learning…

Machine Learning · Statistics 2014-01-14 Mahdi Pakdaman Naeini , Gregory F. Cooper , Milos Hauskrecht

Non-probability samples become increasingly popular in survey statistics but may suffer from selection biases that limit the generalizability of results to the target population. We consider integrating a non-probability sample with a…

Methodology · Statistics 2019-08-26 Shu Yang , Jae Kwang Kim , Rui Song

Inference problems with incomplete observations often aim at estimating population properties of unobserved quantities. One simple way to accomplish this estimation is to impute the unobserved quantities of interest at the individual level…

Methodology · Statistics 2012-10-16 Vladimir N. Minin , John D. O'Brien , Arseni Seregin

In this article the issues are discussed with the Bayesian approach, least-square fits, and most-likely fits. Trying to counter these issues, a method, based on weighted confidence, is proposed for estimating probabilities and other…

Statistics Theory · Mathematics 2017-01-26 Fetze Pijlman

Predictions and forecasts of machine learning models should take the form of probability distributions, aiming to increase the quantity of information communicated to end users. Although applications of probabilistic prediction and…

Machine Learning · Statistics 2024-03-19 Hristos Tyralis , Georgia Papacharalampous

Propensity score matching (PSM) is a pseudo-experimental method that uses statistical techniques to construct an artificial control group by matching each treated unit with one or more untreated units of similar characteristics. To date,…

Statistics Theory · Mathematics 2022-05-27 Yukun Liu , Jing Qin

This article deals with the analysis of high dimensional data that come from multiple sources (experiments) and thus have different possibly correlated responses, but share the same set of predictors. The measurements of the predictors may…

Methodology · Statistics 2020-07-01 Guorong Dai , Ursula U. Müller , Raymond J. Carroll

In recent years the belief network has been used increasingly to model systems in Al that must perform uncertain inference. The development of efficient algorithms for probabilistic inference in belief networks has been a focus of much…

Artificial Intelligence · Computer Science 2013-03-08 Peter Che , Richard E. Neapolitan , James Kenevan , Martha Evens

Sampled network data are widely used in empirical research because collecting complete network information is costly. However, empirical analyses based on sampled networks may lead to biased estimators. We propose a nonparametric imputation…

Econometrics · Economics 2026-05-12 Ge Sun , Weisheng Zhang

Computer experiments are becoming increasingly important in scientific investigations. In the presence of uncertainty, analysts employ probabilistic sensitivity methods to identify the key-drivers of change in the quantities of interest.…

Methodology · Statistics 2024-07-02 Isadora Antoniano-Villalobos , Emanuele Borgonovo , Xuefei Lu

Discrete data are abundant and often arise as counts or rounded data. These data commonly exhibit complex distributional features such as zero-inflation, over-/under-dispersion, boundedness, and heaping, which render many parametric models…

Methodology · Statistics 2023-02-27 Daniel R. Kowal , Bohan Wu

In many learning problems, the training and testing data follow different distributions and a particularly common situation is the \textit{covariate shift}. To correct for sampling biases, most approaches, including the popular kernel mean…

Machine Learning · Computer Science 2020-03-13 Henry Lam , Fengpei Li , Siddharth Prusty

Existing identification and estimation methods for semiparametric sample selection models rely heavily on exclusion restrictions. However, it is difficult in practice to find a credible excluded variable that has a correlation with…

Econometrics · Economics 2024-12-03 Zhewen Pan , Yifan Zhang

A common method for assessing validity of Bayesian sampling or approximate inference methods makes use of simulated data replicates for parameters drawn from the prior. Under continuity assumptions, quantiles of functions of the simulated…

Computation · Statistics 2019-11-21 Xuejun Yu , David J. Nott , Minh-Ngoc Tran , Nadja Klein

We investigate a data-driven approach to constructing uncertainty sets for robust optimization problems, where the uncertain problem parameters are modeled as random variables whose joint probability distribution is not known. Relying only…

Optimization and Control · Mathematics 2020-09-22 Polina Alexeenko , Eilyan Bitar

Predicting with missing inputs challenges even parametric models, as parameter estimation alone is insufficient for prediction on incomplete data. While several works study prediction in linear models, we focus on logistic models, where…

Machine Learning · Statistics 2026-02-03 Christophe Muller , Erwan Scornet , Julie Josse

Marginal imputation, which consists of imputing each item requiring imputation separately, is often used in surveys. This type of imputation procedures leads to asymptotically unbiased estimators of simple parameters such as population…

Methodology · Statistics 2015-11-04 Hélène Chaput , Guillaume Chauvet , David Haziza , Laurianne Salembier , Julie Solard

Consider a Gaussian nonparametric regression problem having both an unknown mean function and unknown variance function. This article presents a class of difference-based kernel estimators for the variance function. Optimal convergence…

Statistics Theory · Mathematics 2009-09-29 Lawrence D. Brown , M. Levine