English
Related papers

Related papers: Forecasting using incomplete models

200 papers

Prediction is a central task of statistics and machine learning, yet many inferential settings provide only partial information, typically in the form of moment constraints or estimating equations. We develop a finite, fully Bayesian…

Statistics Theory · Mathematics 2026-03-20 Nicholas G. Polson , Daniel Zantedeschi

Probabilistic models analyze data by relying on a set of assumptions. Data that exhibit deviations from these assumptions can undermine inference and prediction quality. Robust models offer protection against mismatch between a model's…

Machine Learning · Statistics 2018-06-20 Yixin Wang , Alp Kucukelbir , David M. Blei

We develop a new method for generating prediction sets that combines the flexibility of conformal methods with an estimate of the conditional distribution $P_{Y \mid X}$. Existing methods, such as conformalized quantile regression and…

Machine Learning · Statistics 2024-10-10 Vincent Plassier , Alexander Fishkov , Mohsen Guizani , Maxim Panov , Eric Moulines

As the frontiers of applied statistics progress through increasingly complex experiments we must exploit increasingly sophisticated inferential models to analyze the observations we make. In order to avoid misleading or outright erroneous…

Methodology · Statistics 2018-03-23 Michael Betancourt

The problem of sequential probability forecasting is considered in the most general setting: a model set C is given, and it is required to predict as well as possible if any of the measures (environments) in C is chosen to generate the…

Machine Learning · Computer Science 2019-10-25 Daniil Ryabko

Bayesian model comparison (BMC) offers a principled probabilistic approach to study and rank competing models. In standard BMC, we construct a discrete probability distribution over the set of possible models, conditional on the observed…

Machine Learning · Statistics 2023-02-22 Marvin Schmitt , Stefan T. Radev , Paul-Christian Bürkner

Time series forecasting is a critical task in various domains, where accurate predictions can drive informed decision-making. Traditional forecasting methods often rely on current observations of variables to predict future outcomes,…

Machine Learning · Computer Science 2026-03-17 Wentao Gao , Xiaojing Du , Wenjun Yu , Xiongren Chen , Yifan Guo , Feiyu Yang

Observational astrophysics consists of making inferences about the Universe by comparing data and models. The credible intervals placed on model parameters are often as important as the maximum a posteriori probability values, as the…

Instrumentation and Methods for Astrophysics · Physics 2021-12-15 Will J. Percival , Oliver Friedrich , Elena Sellentin , Alan Heavens

We investigate Bayesian predictive inference for finite population quantities when there are unequal probabilities of selection. Only limited information about the sample design is available; i.e., only the first-order selection…

Methodology · Statistics 2018-04-10 Junheng Ma , Joe Sedransk , Balgobin Nandram , Lu Chen

There are various measures of predictive uncertainty in the literature, but their relationships to each other remain unclear. This paper uses a decomposition of statistical pointwise risk into components, associated with different sources…

Machine Learning · Statistics 2025-02-18 Nikita Kotelevskii , Vladimir Kondratyev , Martin Takáč , Éric Moulines , Maxim Panov

Bayesian inference requires specification of a single, precise prior distribution, whereas frequentist inference only accommodates a vacuous prior. Since virtually every real-world application falls somewhere in between these two extremes,…

Methodology · Statistics 2023-09-26 Ryan Martin

This expository paper discusses Bayesian decision analysis perspectives on problems of constrained forecasting. Foundational and pedagogic discussion contrasts decision analytic approaches with the traditional, but typically inappropriate,…

Methodology · Statistics 2021-12-01 Mike West

The Bayesian statistical paradigm provides a principled and coherent approach to probabilistic forecasting. Uncertainty about all unknowns that characterize any forecasting problem -- model, parameters, latent states -- is able to be…

Probability forecasts are intended to account for the uncertainties inherent in forecasting. It is suggested that from an end-user's point of view probability is not necessarily sufficient to reflect uncertainties that are not simply the…

Statistics Theory · Mathematics 2015-01-22 Kevin Judd

Time series forecasting using historical data has been an interesting and challenging topic, especially when the data is corrupted by missing values. In many industrial problem, it is important to learn the inference function between the…

Machine Learning · Computer Science 2023-06-02 Trang H. Tran , Lam M. Nguyen , Kyongmin Yeo , Nam Nguyen , Dzung Phan , Roman Vaculin , Jayant Kalagnanam

Conformal prediction has emerged as a cutting-edge methodology in statistics and machine learning, providing prediction intervals with finite-sample frequentist coverage guarantees. Yet, its interplay with Bayesian statistics, often…

Methodology · Statistics 2026-03-27 Nina Deliu , Brunero Liseo

Existing approaches to model uncertainty typically either compare models using a quantitative model selection criterion or evaluate posterior model probabilities having set a prior. In this paper, we propose an alternative strategy which…

Methodology · Statistics 2025-03-26 Vik Shirvaikar , Stephen G. Walker , Chris Holmes

A long noted difficulty when assessing the reliability (or calibration) of forecasting systems is that reliability, in general, is a hypothesis not about a finite dimensional parameter but about an entire functional relationship. A…

Data Analysis, Statistics and Probability · Physics 2020-12-09 Jochen Bröcker

The accurate representation of epistemic uncertainty is a challenging yet essential task in machine learning. A widely used representation corresponds to convex sets of probabilistic predictors, also known as credal sets. One popular way of…

Machine Learning · Computer Science 2025-07-30 Mira Jürgens , Thomas Mortier , Eyke Hüllermeier , Viktor Bengs , Willem Waegeman

Randomness in scientific estimation is generally assumed to arise from unmeasured or uncontrolled factors. However, when combining subjective probability estimates, heterogeneity stemming from people's cognitive or information diversity is…

Methodology · Statistics 2015-05-28 Ville Satopää , Robin Pemantle , Lyle Ungar