English
Related papers

Related papers: Evaluating probabilistic forecasts with scoringRul…

200 papers

We introduce Probabilistic Rank and Reward (PRR), a scalable probabilistic model for personalized slate recommendation. Our approach allows off-policy estimation of the reward in the scenario where the user interacts with at most one item…

Information Retrieval · Computer Science 2024-07-08 Imad Aouali , Achraf Ait Sidi Hammou , Otmane Sakhi , David Rohde , Flavian Vasile

Meteorological forecasting provides reliable prediction about the future weather within a given interval of time. Meteorological forecasting can be viewed as a form of hybrid diagnostic reasoning and can be mapped onto an integrated…

Artificial Intelligence · Computer Science 2019-02-11 Matteo Cristani , Francesco Domenichini , Claudio Tomazzoli , Luca Viganò , Margherita Zorzi

Flow matching has recently emerged as a powerful paradigm for generative modeling and has been extended to probabilistic time series forecasting in latent spaces. However, the impact of the specific choice of probability path model on…

Machine Learning · Statistics 2025-08-19 Soon Hoe Lim , Yijin Wang , Annan Yu , Emma Hart , Michael W. Mahoney , Xiaoye S. Li , N. Benjamin Erichson

Given an imprecise probabilistic model over a continuous space, computing lower/upper expectations is often computationally hard to achieve, even in simple cases. Because expectations are essential in decision making and risk analysis,…

Probability · Mathematics 2009-06-09 L. Utkin , S. Destercke

Accurate forecasts of extreme wind speeds are of high importance for many applications. Such forecasts are usually generated by ensembles of numerical weather prediction (NWP) models, which however can be biased and have errors in…

Machine Learning · Computer Science 2025-08-12 Jakob Benjamin Wessel , Christopher A. T. Ferro , Gavin R. Evans , Frank Kwasniok

We give an overview of some uses of proper scoring rules in statistical inference, including frequentist estimation theory and Bayesian model selection with improper priors.

Statistics Theory · Mathematics 2020-04-28 A. Philip Dawid , Monica Musio

Uncertainty representation and quantification are paramount in machine learning and constitute an important prerequisite for safety-critical applications. In this paper, we propose novel measures for the quantification of aleatoric and…

Machine Learning · Computer Science 2024-04-22 Paul Hofman , Yusuf Sale , Eyke Hüllermeier

To mitigate the impacts associated with adverse weather conditions, meteorological services issue weather warnings to the general public. These warnings rely heavily on forecasts issued by underlying prediction systems. When deciding which…

Applications · Statistics 2022-09-13 Sam Allen , Jonas Bhend , Olivia Martius , Johanna Ziegel

Forecast combinations have flourished remarkably in the forecasting community and, in recent years, have become part of the mainstream of forecasting research and activities. Combining multiple forecasts produced from single (target) series…

Methodology · Statistics 2022-09-26 Xiaoqian Wang , Rob J Hyndman , Feng Li , Yanfei Kang

The modeling of dynamical systems is essential in many fields, but applying machine learning techniques is often challenging due to incomplete or noisy data. This study introduces a variant of stochastic interpolation (SI) for probabilistic…

Computational Physics · Physics 2025-03-18 Siddharth Rout , Eldad Haber , Stéphane Gaudreault

We provide self-contained proof of a theorem relating probabilistic coherence of forecasts to their non-domination by rival forecasts with respect to any proper scoring rule. The theorem appears to be new but is closely related to results…

Machine Learning · Statistics 2016-11-15 Joel Predd , Robert Seiringer , Elliott H. Lieb , Daniel Osherson , Vincent Poor , Sanjeev Kulkarni

Forecasts support decision making in a variety of applications. Statistical models can produce accurate forecasts given abundant training data, but when data is sparse, rapidly changing, or unavailable, statistical models may not be able to…

Applications · Statistics 2020-05-19 Thomas McAndrew , Nutcha Wattanachit , G. Casey Gibson , Nicholas G. Reich

Distribution and sample models are two popular model choices in model-based reinforcement learning (MBRL). However, learning these models can be intractable, particularly when the state and action spaces are large. Expectation models, on…

Machine Learning · Computer Science 2020-07-31 Yi Wan , Zaheer Abbas , Adam White , Martha White , Richard S. Sutton

When providing probabilistic forecasts for uncertain future events, it is common to strive for calibrated forecasts, that is, the predictive distribution should be compatible with the observed outcomes. Several notions of calibration are…

Methodology · Statistics 2015-05-21 Christof Strähl , Johanna F. Ziegel

This paper investigates two feature-scoring criteria that make use of estimated class probabilities: one method proposed by \citet{shen} and a complementary approach proposed below. We develop a theoretical framework to analyze each…

Machine Learning · Computer Science 2012-07-03 Andrea Danyluk , Nicholas Arnosti

We introduce the notion of a stochastic probabilistic program and present a reference implementation of a probabilistic programming facility supporting specification of stochastic probabilistic programs and inference in them. Stochastic…

Machine Learning · Statistics 2020-01-23 David Tolpin , Tomer Dobkin

Though athletics statistics are abundant, it is a difficult task to quantitatively compare performances from different events of track, field, and road running in a meaningful way. There are several commonly-used methods, but each has its…

Applications · Statistics 2014-08-27 Brian Godsey

The Statistical Toolkit is an open source system specialized in the statistical comparison of distributions. It addresses requirements common to different experimental domains, such as simulation validation (e.g. comparison of experimental…

Computational Physics · Physics 2015-06-11 M Batic , A. M. Paganoni , A. Pfeiffer , M. G. Pia , A. Ribon

Probabilistic time-series models become popular in the forecasting field as they help to make optimal decisions under uncertainty. Despite the growing interest, a lack of thorough analysis hinders choosing what is worth applying for the…

Machine Learning · Computer Science 2020-11-24 Seungjae Jung , Kyung-Min Kim , Hanock Kwak , Young-Jin Park

The last decade has seen the success of stochastic parameterizations in short-term, medium-range and seasonal forecasts: operational weather centers now routinely use stochastic parameterization schemes to better represent model inadequacy…