English
Related papers

Related papers: Estimating Cross-validatory Predictive P-values wi…

200 papers

Off-policy policy estimators that use importance sampling (IS) can suffer from high variance in long-horizon domains, and there has been particular excitement over new IS methods that leverage the structure of Markov decision processes. We…

Machine Learning · Computer Science 2020-06-09 Yao Liu , Pierre-Luc Bacon , Emma Brunskill

Estimating the probability of failure is a critical step in developing safety-critical autonomous systems. Direct estimation methods such as Monte Carlo sampling are often impractical due to the rarity of failures in these systems. Existing…

Robotics · Computer Science 2024-12-04 Harrison Delecki , Sydney M. Katz , Mykel J. Kochenderfer

Cross-validation (CV) is a common method to tune machine learning methods and can be used for model selection in regression as well. Because of the structured nature of small, traditional experimental designs, the literature has warned…

Applications · Statistics 2025-06-18 Maria L. Weese , Byran J. Smucker , David J. Edwards

Linear regression with measurement error in the covariates is a heavily studied topic, however, the statistics/econometrics literature is almost silent to estimating a multi-equation model with measurement error. This paper considers a…

Methodology · Statistics 2020-06-15 Georges Bresson , Anoop Chaturvedi , Mohammad Arshad Rahman , Shalabh

Bayesian inference for doubly-intractable pairwise exponential graphical models typically involves variations of the exchange algorithm or approximate Markov chain Monte Carlo (MCMC) samplers. However, existing methods for both classes of…

Computation · Statistics 2026-03-30 Yujie Chen , Antik Chakraborty , Anindya Bhadra

We show that a probabilistic version of the classical forward-stepwise variable inclusion procedure can serve as a general data-augmentation scheme for model space distributions in (generalized) linear models. This latent variable…

Methodology · Statistics 2014-10-23 Li Ma

Estimating the effective sample size (ESS) of a prior distribution is an age-old yet pivotal challenge, with great implications for clinical trials and various biomedical applications. Although numerous endeavors have been dedicated to this…

Methodology · Statistics 2025-07-23 Han Wang , Yan Dora Zhang , Guosheng Yin

Collection of massive well-annotated samples is effective in improving object detection performance but is extremely laborious and costly. Instead of data collection and annotation, the recently proposed Cut-Paste methods [12, 15] show the…

Computer Vision and Pattern Recognition · Computer Science 2019-07-12 Hao Wang , Qilong Wang , Fan Yang , Weiqi Zhang , Wangmeng Zuo

Accurate uncertainty estimation associated with the pose transformation between two 3D point clouds is critical for autonomous navigation, grasping, and data fusion. Iterative closest point (ICP) is widely used to estimate the…

Robotics · Computer Science 2020-04-20 Fahira Afzal Maken , Fabio Ramos , Lionel Ott

For predictive evaluation based on quasi-posterior distributions, we develop a new information criterion, the posterior covariance information criterion (PCIC. PCIC generalises the widely applicable information criterion WAIC so as to…

Methodology · Statistics 2023-01-26 Yukito Iba , Keisuke Yano

Variable selection in high-dimensional space characterizes many contemporary problems in scientific discovery and decision making. Many frequently-used techniques are based on independence screening; examples include correlation ranking…

Methodology · Statistics 2008-12-18 Jianqing Fan , Richard Samworth , Yichao Wu

Informative cluster size (ICS) and informative subgroup size (ISS) can distort marginal association estimates when the number of observed units, or their distribution across outcome-defined categories, is related to the outcomes under…

Methodology · Statistics 2026-05-22 Owen Visser , Somnath Datta

Many Bayesian inference problems involve high-dimensional models where the performance of standard importance sampling (IS) methods often degrades rapidly as the dimensionality increases. Classical analyses of IS typically rely on the…

Statistics Theory · Mathematics 2026-05-29 Fabián González , Víctor Elvira , Joaquín Míguez

We propose two extensions to existing importance sampling based methods for lossy compression. First, we introduce an importance sampling based compression scheme that is a variant of ordered random coding (Theis and Ahmed, 2022) and is…

Information Theory · Computer Science 2024-03-11 Buu Phan , Ashish Khisti , Christos Louizos

Rare event probability estimation is an important topic in reliability analysis. Stochastic methods, such as importance sampling, have been developed to estimate such probabilities but they often fail in high dimension. In this paper, we…

Computation · Statistics 2021-08-24 Maxime El-Masri , Jérôme Morio , Florian Simatos

Importance sampling is a powerful tool for correcting the distributional mismatch in many statistical and machine learning problems, but in practice its performance is limited by the usage of simple proposals whose importance weights can be…

Methodology · Statistics 2024-01-02 Chaofan Huang , V. Roshan Joseph

Adaptive importance sampling (AIS) methods provide a useful alternative to Markov Chain Monte Carlo (MCMC) algorithms for performing inference of intractable distributions. Population Monte Carlo (PMC) algorithms constitute a family of AIS…

Methodology · Statistics 2023-12-13 Soumyasundar Pal , Antonios Valkanas , Mark Coates

We propose a simple method for evaluating the model that has been chosen by an adaptive regression procedure, our main focus being the lasso. This procedure deletes each chosen predictor and refits the lasso to get a set of models that are…

Methodology · Statistics 2018-06-06 Leying Guan , Robert Tibshirani

Cross-validation is a common method for estimating the predictive performance of machine learning models. In a data-scarce regime, where one typically wishes to maximize the number of instances used for training the model, an approach…

Methodology · Statistics 2025-03-25 George I. Austin , Itsik Pe'er , Tal Korem

Recent work used importance sampling ideas for better variational bounds on likelihoods. We clarify the applicability of these ideas to pure probabilistic inference, by showing the resulting Importance Weighted Variational Inference (IWVI)…

Machine Learning · Computer Science 2018-10-30 Justin Domke , Daniel Sheldon