English
Related papers

Related papers: Bayes-optimal prediction with frequentist coverage…

200 papers

Bayes' theorem incorporates distinct types of information through the likelihood and prior. Direct observations of state variables enter the likelihood and modify posterior probabilities through consistent updating. Information in terms of…

Methodology · Statistics 2024-07-19 Duncan K. Foley , Ellis Scharfenaker

It can be important in Bayesian analyses of complex models to construct informative prior distributions which reflect knowledge external to the data at hand. Nevertheless, how much prior information an analyst can elicit from an expert will…

Applications · Statistics 2017-11-10 Xueou Wang , David J. Nott , C. C. Drovandi , Kerrie Mengersen , Michael Evans

Probabilistic models often use neural networks to control their predictive uncertainty. However, when making out-of-distribution (OOD)} predictions, the often-uncontrollable extrapolation properties of neural networks yield poor uncertainty…

Machine Learning · Computer Science 2022-01-19 Pierre Segonne , Yevgen Zainchkovskyy , Søren Hauberg

We develop a collection of methods for adjusting the predictions of quantile regression to ensure coverage. Our methods are model agnostic and can be used to correct for high-dimensional overfitting bias with only minimal assumptions.…

Methodology · Statistics 2025-11-10 Isaac Gibbs , John J. Cherian , Emmanuel J. Candès

Raking is widely used in categorical data modeling and survey practice but faced with methodological and computational challenges. We develop a Bayesian paradigm for raking by incorporating the marginal constraints as a prior distribution…

Methodology · Statistics 2020-06-24 Yajuan Si , Peigen Zhou

Predicting outcomes in external domains is challenging due to hidden confounders that potentially influence both predictors and outcomes. Well-established methods frequently rely on stringent assumptions, explicit knowledge about the…

Methodology · Statistics 2025-10-14 Carlos García Meixide , David Ríos Insua

High dimensional statistics deals with the challenge of extracting structured information from complex model settings. Compared with the growing number of frequentist methodologies, there are rather few theoretically optimal Bayes methods…

Statistics Theory · Mathematics 2018-08-21 Chao Gao , Aad W. van der Vaart , Harrison H. Zhou

Conformal prediction is a simple and powerful tool that can quantify uncertainty without any distributional assumptions. Many existing methods only address the average coverage guarantee, which is not ideal compared to the stronger…

Machine Learning · Statistics 2023-02-21 Xing Han , Ziyang Tang , Joydeep Ghosh , Qiang Liu

We discuss Bayesian inference for parameters selected using the data. First, we provide a critical analysis of the existing positions in the literature regarding the correct Bayesian approach under selection. Second, we propose two types of…

Statistics Theory · Mathematics 2021-05-12 Daniel G. Rasines , G. Alastair Young

It is crucial to design Phase II cancer clinical trials that balance the efficiency of treatment selection with clinical practicality. Sargent and Goldberg proposed a frequentist design that allow decision-making even when the primary…

Methodology · Statistics 2025-05-15 Moka Komaki , Satoru Shinoda , Haiyan Zheng , Kouji Yamamoto

Often the goal of model selection is to choose a model for future prediction, and it is natural to measure the accuracy of a future prediction by squared error loss. Under the Bayesian approach, it is commonly perceived that the optimal…

Statistics Theory · Mathematics 2007-06-13 Maria Maddalena Barbieri , James O. Berger

An important factor to guarantee a fair use of data-driven recommendation systems is that we should be able to communicate their uncertainty to decision makers. This can be accomplished by constructing prediction intervals, which provide an…

Methodology · Statistics 2019-08-16 Yaniv Romano , Rina Foygel Barber , Chiara Sabatti , Emmanuel J. Candès

Information projections are the key building block of variational inference algorithms and are used to approximate a target probabilistic model by projecting it onto a family of tractable distributions. In general, there is no guarantee on…

Machine Learning · Computer Science 2015-10-06 Lun-Kai Hsu , Tudor Achim , Stefano Ermon

Familiar statistical tests and estimates are obtained by the direct observation of cases of interest: a clinical trial of a new drug, for instance, will compare the drug's effects on a relevant set of patients and controls. Sometimes,…

Methodology · Statistics 2010-12-09 Bradley Efron

Bayesian estimation is increasingly popular for performing model based inference to support policymaking. These data are often collected from surveys under informative sampling designs where subject inclusion probabilities are designed to…

Methodology · Statistics 2018-07-13 Luis G. Leon-Novelo , Terrance D. Savitsky

Conformal prediction, and split conformal prediction as a specific implementation, offer a distribution-free approach to estimating prediction intervals with statistical guarantees. Recent work has shown that split conformal prediction can…

Machine Learning · Statistics 2024-05-01 Nicolas Dewolf , Bernard De Baets , Willem Waegeman

Construction methods for prior densities are investigated from a predictive viewpoint. Predictive densities for future observables are constructed by using observed data. The simultaneous distribution of future observables and observed data…

Statistics Theory · Mathematics 2021-05-27 Fumiyasu Komaki

Possible parameter values in a random sampling model are shown by definition to have uniform base-rate prior probabilities. This allows a frequentist posterior probability distribution to be calculated for such possible parameter values…

Other Statistics · Statistics 2020-02-14 Huw Llewelyn

We consider the problem of statistical inference on parameters of a target population when auxiliary observations are available from related populations. We propose a flexible empirical Bayes approach that can be applied on top of any…

Statistics Theory · Mathematics 2023-12-15 Michael Law , Peter Bühlmann , Ya'acov Ritov

Conformal prediction is a popular, modern technique for providing valid predictive inference for arbitrary machine learning models. Its validity relies on the assumptions of exchangeability of the data, and symmetry of the given model…

Methodology · Statistics 2023-03-20 Rina Foygel Barber , Emmanuel J. Candes , Aaditya Ramdas , Ryan J. Tibshirani