English
Related papers

Related papers: Generalized Prediction-Powered Inference, with App…

200 papers

A conventional Bayesian approach to prediction uses the posterior distribution to integrate out parameters in a density for unobserved data conditional on the observed data and parameters. When the true posterior is intractable, it is…

Methodology · Statistics 2026-02-27 Lucas Kock , Scott A. Sisson , G. S. Rodrigues , David J. Nott

Protein-protein interaction (PPI) prediction is an important problem in machine learning and computational biology. However, there is no data set for training or evaluation purposes, where all the instances are accurately labeled. Instead,…

Artificial Intelligence · Computer Science 2015-09-21 Haohan Wang , Madhavi K. Ganapathiraju

Conformal prediction is a framework for predictive inference with a distribution-free, finite-sample guarantee. However, it tends to provide uninformative prediction sets when calibration data are scarce. This paper introduces…

Machine Learning · Computer Science 2025-06-17 Meshi Bashari , Roy Maor Lotan , Yonghoon Lee , Edgar Dobriban , Yaniv Romano

Missing data is an universal problem in statistics. We develop a unified framework for estimating parameters defined by general estimating equations under a missing-at-random (MAR) mechanism, based on generalized entropy calibration…

Methodology · Statistics 2026-03-31 Mst Moushumi Pervin , Hengfang Wang , Jae Kwang Kim

While statistics focusses on hypothesis testing and on estimating (properties of) the true sampling distribution, in machine learning the performance of learning algorithms on future data is the primary issue. In this paper we bridge the…

Machine Learning · Computer Science 2009-12-30 Marcus Hutter

We study semi-supervised stochastic optimization when labeled data is scarce but predictions from pre-trained models are available. PPI and SVRG both reduce variance through control variates -- PPI uses predictions, SVRG uses reference…

Machine Learning · Computer Science 2026-01-30 Ruicheng Ao , Hongyu Chen , Haoyang Liu , David Simchi-Levi , Will Wei Sun

Single-parameter summaries of variable effects in regression settings are desirable for ease of interpretation. However (partially) linear models for example, which would deliver these, may fit poorly to the data. On the other hand, an…

Statistics Theory · Mathematics 2025-07-28 Harvey Klyne , Rajen D. Shah

We propose the conditional predictive impact (CPI), a consistent and unbiased estimator of the association between one or several features and a given outcome, conditional on a reduced feature set. Building on the knockoff framework of…

Methodology · Statistics 2021-05-14 David S. Watson , Marvin N. Wright

One fundamental statistical question for research areas such as precision medicine and health disparity is about discovering effect modification of treatment or exposure by observed covariates. We propose a semiparametric framework for…

Methodology · Statistics 2020-08-04 Muxuan Liang , Menggang Yu

We study the problem of monitoring model performance in dynamic environments where labeled data are limited. To this end, we propose prediction-powered risk monitoring (PPRM), a semi-supervised risk-monitoring approach based on…

Machine Learning · Computer Science 2026-02-03 Guangyi Zhang , Yunlong Cai , Guanding Yu , Osvaldo Simeone

Item nonresponse is frequently encountered in practice. Ignoring missing data can lose efficiency and lead to misleading inference. Fractional imputation is a frequentist approach of imputation for handling missing data. However, the…

Methodology · Statistics 2018-09-18 Hejian Sang , Jae Kwang Kim

We propose Partially Interpretable Estimators (PIE) which attribute a prediction to individual features via an interpretable model, while a (possibly) small part of the PIE prediction is attributed to the interaction of features via a…

Machine Learning · Computer Science 2021-05-07 Tong Wang , Jingyi Yang , Yunyi Li , Boxiang Wang

Due to concerns about parametric model misspecification, there is interest in using machine learning to adjust for confounding when evaluating the causal effect of an exposure on an outcome. Unfortunately, exposure effect estimators that…

Methodology · Statistics 2025-01-08 Oliver Dukes , Stijn Vansteelandt , David Whitney

The proliferation of computing devices has brought about an opportunity to deploy machine learning models on new problem domains using previously inaccessible data. Traditional algorithms for training such models often require data to be…

We generalize the derivation of model predictive path integral control (MPPI) to allow for a single joint distribution across controls in the control sequence. This reformation allows for the implementation of adaptive importance sampling…

Systems and Control · Electrical Eng. & Systems 2023-03-02 Dylan M. Asmar , Ransalu Senanayake , Shawn Manuel , Mykel J. Kochenderfer

In prediction problems with more predictors than observations, it can sometimes be helpful to use a joint probability model, $\pi(Y,X)$, rather than a purely conditional model, $\pi(Y \mid X)$, where $Y$ is a scalar response variable and…

Methodology · Statistics 2010-11-17 P. Richard Hahn , Sayan Mukherjee , Carlos Carvalho

This study investigates treatment effect estimation in the semi-supervised setting, also can be interpreted as prediction-powered inference. In our setting, we can use not only the standard triple of covariates, treatment indicator, and…

Machine Learning · Statistics 2026-05-05 Masahiro Kato

We introduce a broad class of models called semiparametric spatial point process for making inference between spatial point patterns and spatial covariates. These models feature an intensity function with both parametric and nonparametric…

Methodology · Statistics 2025-09-24 Xindi Lin , Bumjun Park , Christopher Zahasky , Hyunseung Kang

Variational inference (VI) has become the method of choice for fitting many modern probabilistic models. However, practitioners are faced with a fragmented literature that offers a bewildering array of algorithmic options. First, the…

Machine Learning · Statistics 2018-11-29 Thang D. Bui , Cuong V. Nguyen , Siddharth Swaroop , Richard E. Turner

Quantifying the uncertainty of predictions is a core problem in modern statistics. Methods for predictive inference have been developed under a variety of assumptions, often -- for instance, in standard conformal prediction -- relying on…

Methodology · Statistics 2024-09-13 Edgar Dobriban , Mengxin Yu