English
Related papers

Related papers: Local Prediction-Powered Inference

200 papers

Recent work used importance sampling ideas for better variational bounds on likelihoods. We clarify the applicability of these ideas to pure probabilistic inference, by showing the resulting Importance Weighted Variational Inference (IWVI)…

Machine Learning · Computer Science 2018-10-30 Justin Domke , Daniel Sheldon

Prediction-Powered Inference (PPI) is a popular strategy for combining gold-standard and possibly noisy pseudo-labels to perform statistical estimation. Prior work has shown an asymptotic "free lunch" for PPI++, an adaptive form of PPI,…

Machine Learning · Statistics 2025-05-27 Pranav Mani , Peng Xu , Zachary C. Lipton , Michael Oberst

Computational protein-protein interaction (PPI) prediction techniques can contribute greatly in reducing time, cost and false-positive interactions compared to experimental approaches. Sequence is one of the key and primary information of…

Machine Learning · Computer Science 2022-03-29 Soumyadeep Debnath , Ayatullah Faruk Mollah

Quality statistical inference requires a sufficient amount of data, which can be missing or hard to obtain. To this end, prediction-powered inference has risen as a promising methodology, but existing approaches are largely limited to…

Machine Learning · Statistics 2025-05-27 Daniel Csillag , Claudio José Struchiner , Guilherme Tegoni Goedert

Local Polynomial Regression (LPR) is a widely used nonparametric method for modeling complex relationships due to its flexibility and simplicity. It estimates a regression function by fitting low-degree polynomials to localized subsets of…

Methodology · Statistics 2025-07-22 Yaniv Shulman

Vanilla variational inference finds an optimal approximation to the Bayesian posterior distribution, but even the exact Bayesian posterior is often not meaningful under model misspecification. We propose predictive variational inference…

Machine Learning · Statistics 2026-03-31 Jinlin Lai , Antonio Linero , Yuling Yao

The authors derive likelihood-based exact inference methods for the multivariate regression model, for singly imputed synthetic data generated via Posterior Predictive Sampling (PPS) and for multiply imputed synthetic data generated via a…

Statistics Theory · Mathematics 2017-07-26 Ricardo Moura , Martin Klein , Carlos A. Coelho , Bimal Sinha

Applied macroeconomists often compute confidence intervals for impulse responses using local projections, i.e., direct linear regressions of future outcomes on current covariates. This paper proves that local projection inference robustly…

Econometrics · Economics 2026-01-15 José Luis Montiel Olea , Mikkel Plagborg-Møller

In an attempt to provide an answer to the increasing criticism against p-values and to bridge the gap between statistical inference and prediction modelling, we introduce the probability of improved prediction (PIP). In general, the PIP is…

Methodology · Statistics 2024-05-28 Olivier Thas , Stijn Jaspers

Machine learning models trained on Earth observation data, such as satellite imagery, have demonstrated significant promise in predicting household-level wealth indices, enabling the creation of high-resolution wealth maps that can be…

Machine Learning · Statistics 2025-12-16 Markus B. Pettersson , Connor T. Jerzak , Adel Daoud

We propose the conditional predictive impact (CPI), a consistent and unbiased estimator of the association between one or several features and a given outcome, conditional on a reduced feature set. Building on the knockoff framework of…

Methodology · Statistics 2021-05-14 David S. Watson , Marvin N. Wright

Learning using privileged information (LUPI) is a powerful heterogenous feature space machine learning framework that allows a machine learning model to learn from highly informative or privileged features which are available during…

Machine Learning · Computer Science 2019-03-26 Amina Asif , Muhammad Dawood , Fayyaz ul Amir Afsar Minhas

It is common in machine learning to estimate a response $y$ given covariate information $x$. However, these predictions alone do not quantify any uncertainty associated with said predictions. One way to overcome this deficiency is with…

Machine Learning · Statistics 2024-06-25 Chancellor Johnstone , Eugene Ndiaye

Conformal prediction is a distribution-free technique for establishing valid prediction intervals. Although conventionally people conduct conformal prediction in the output space, this is not the only possibility. In this paper, we propose…

Machine Learning · Computer Science 2023-04-11 Jiaye Teng , Chuan Wen , Dinghuai Zhang , Yoshua Bengio , Yang Gao , Yang Yuan

Selective inference (SI) has been actively studied as a promising framework for statistical hypothesis testing for data-driven hypotheses. The basic idea of SI is to make inferences conditional on an event that a hypothesis is selected. In…

Machine Learning · Statistics 2023-12-29 Tomohiro Shiraishi , Daiki Miwa , Vo Nguyen Le Duy , Ichiro Takeuchi

This article describes a multivariate polynomial regression method where the uncertainty of the input parameters are approximated with Gaussian distributions, derived from the central limit theorem for large weighted sums, directly from the…

Machine Learning · Statistics 2013-10-04 Peter Kovesarki , Ian C. Brock

A pseudo independent (PI) model is a probabilistic domain model (PDM) where proper subsets of a set of collectively dependent variables display marginal independence. PI models cannot be learned correctly by many algorithms that rely on a…

Artificial Intelligence · Computer Science 2013-02-08 Jun Hu , Yang Xiang

We study the problem of monitoring model performance in dynamic environments where labeled data are limited. To this end, we propose prediction-powered risk monitoring (PPRM), a semi-supervised risk-monitoring approach based on…

Machine Learning · Computer Science 2026-02-03 Guangyi Zhang , Yunlong Cai , Guanding Yu , Osvaldo Simeone

This paper proposes probabilistic conformal prediction (PCP), a predictive inference algorithm that estimates a target variable by a discontinuous predictive set. Given inputs, PCP construct the predictive set based on random samples from…

Machine Learning · Statistics 2022-06-22 Zhendong Wang , Ruijiang Gao , Mingzhang Yin , Mingyuan Zhou , David M. Blei

The huge amount of available data nowadays is a challenge for kernel-based machine learning algorithms like SVMs with respect to runtime and storage capacities. Local approaches might help to relieve these issues and to improve statistical…

Machine Learning · Statistics 2019-03-05 Florian Dumpert