English
Related papers

Related papers: Forecasting using incomplete models

200 papers

In practical optimization problems, we typically model uncertainty as a random variable though its true probability distribution is unobservable to the decision maker. Historical data provides some information of this distribution that we…

Optimization and Control · Mathematics 2025-01-28 Arjun Ramachandra , Napat Rujeerapaiboon , Melvyn Sim

We study the problem of sequentially predicting properties of a probabilistic model and its next outcome over an infinite horizon, with the goal of ensuring that the predictions incur only finitely many errors with probability 1. We…

Statistics Theory · Mathematics 2024-02-08 Changlong Wu , Narayana Santhanam

We propose probabilistic task modelling -- a generative probabilistic model for collections of tasks used in meta-learning. The proposed model combines variational auto-encoding and latent Dirichlet allocation to model each task as a…

Machine Learning · Computer Science 2022-03-21 Cuong C. Nguyen , Thanh-Toan Do , Gustavo Carneiro

We consider the optimization of an uncertain objective over continuous and multi-dimensional decision spaces in problems in which we are only provided with observational data. We propose a novel algorithmic framework that is tractable,…

Machine Learning · Statistics 2018-10-30 Dimitris Bertsimas , Christopher McCord

For nearly any challenging scientific problem evaluation of the likelihood is problematic if not impossible. Approximate Bayesian computation (ABC) allows us to employ the whole Bayesian formalism to problems where we can use simulations…

Computation · Statistics 2011-07-04 Chris Barnes , Sarah Filippi , Michael P. H. Stumpf , Thomas Thorne

Conformal prediction is a model-free machine learning method for constructing prediction regions at a guaranteed coverage probability level. However, a data scientist often faces three challenges in practice: (i) the determination of a…

Machine Learning · Statistics 2026-03-31 Liang Hong , Noura Raydan Nasreddine

WeatherBench is a benchmark dataset for medium-range weather forecasting of geopotential, temperature and precipitation, consisting of preprocessed data, predefined evaluation metrics and a number of baseline models. WeatherBench…

Atmospheric and Oceanic Physics · Physics 2022-05-03 Sagar Garg , Stephan Rasp , Nils Thuerey

Ecological forecasts are model-based statements about currently unknown ecosystem states in time or space. For a model forecast to be useful to inform decision makers, model validation and verification determine adequateness. The measure of…

A method is discussed that allows combining sets of differential or inclusive measurements. It is assumed that at least one measurement was obtained with simultaneously fitting a set of nuisance parameters, representing sources of…

Data Analysis, Statistics and Probability · Physics 2018-01-09 Jan Kieseler

Estimating population models from uncertain observations is an important problem in ecology. Perretti et al. observed that standard Bayesian state-space solutions to this problem may provide biased parameter estimates when the underlying…

Populations and Evolution · Quantitative Biology 2013-10-28 Florian Hartig , Carsten F. Dormann

Using observation data to estimate unknown parameters in computational models is broadly important. This task is often challenging because solutions are non-unique due to the complexity of the model and limited observation data. However,…

Methodology · Statistics 2018-12-18 Jiacheng Wu , Jian-Xun Wang , Shawn C. Shadden

We study the problem of distributional matrix completion: Given a sparsely observed matrix of empirical distributions, we seek to impute the true distributions associated with both observed and unobserved matrix entries. This is a…

Machine Learning · Statistics 2025-06-09 Jacob Feitelberg , Kyuseong Choi , Anish Agarwal , Raaz Dwivedi

Conformal prediction is an uncertainty quantification method that constructs a prediction set for a previously unseen datum, ensuring the true label is included with a predetermined coverage probability. Adaptive conformal prediction has…

Machine Learning · Computer Science 2024-11-07 Erfan Hajihashemi , Yanning Shen

This chapter provides a overview of Bayesian inference, mostly emphasising that it is a universal method for summarising uncertainty and making estimates and predictions using probability statements conditional on observed data and an…

Methodology · Statistics 2010-02-11 Christian P. Robert , Jean-Michel Marin , Judith Rousseau

Given that machine learning algorithms are increasingly being deployed to aid in high stakes decision-making, uncertainty quantification methods that wrap around these black box models such as conformal prediction have received much…

Machine Learning · Statistics 2026-02-09 Kayla E. Scharfstein , Arun Kumar Kuchibhotla

Predictability estimates of ensemble prediction systems are uncertain due to limited numbers of past forecasts and observations. To account for such uncertainty, this paper proposes a Bayesian inferential framework that provides a simple…

With the ubiquitous availability of unstructured data, growing attention is paid as how to adjust for selection bias in such non-probability samples. The majority of the robust estimators proposed by prior literature are either fully or…

Methodology · Statistics 2022-04-08 Ali Rafei , Michael R. Elliott , Carol A. C. Flannagan

When split conformal prediction operates in batch mode with exchangeable data, we determine the exact distribution of the empirical coverage of prediction sets produced for a finite batch of future observables, as well as the exact…

Statistics Theory · Mathematics 2025-01-23 Paulo C. Marques F

In this article the issues are discussed with the Bayesian approach, least-square fits, and most-likely fits. Trying to counter these issues, a method, based on weighted confidence, is proposed for estimating probabilities and other…

Statistics Theory · Mathematics 2017-01-26 Fetze Pijlman

Detecting and measuring confounding effects from data is a key challenge in causal inference. Existing methods frequently assume causal sufficiency, disregarding the presence of unobserved confounding variables. Causal sufficiency is both…

Artificial Intelligence · Computer Science 2024-09-27 Abbavaram Gowtham Reddy , Vineeth N Balasubramanian