English
Related papers

Related papers: Murphy Diagrams: Forecast Evaluation of Expected S…

200 papers

Quantiles and expected shortfalls are commonly used risk measures in financial risk management. The two measurements are correlated while have distinguished features. In this project, our primary goal is to develop stable and practical…

Methodology · Statistics 2022-08-24 Xiang Peng , Huixia Judy Wang

Proper scoring rules are used to assess the out-of-sample accuracy of probabilistic forecasts, with different scoring rules rewarding distinct aspects of forecast performance. Herein, we re-investigate the practice of using proper scoring…

Estimating the expectation of a real-valued function of a random variable from sample data is a critical aspect of statistical analysis, with far-reaching implications in various applications. Current methodologies typically assume…

Machine Learning · Computer Science 2026-02-18 Paweł Lorek , Rafał Nowak , Rafał Topolnicki , Tomasz Trzciński , Maciej Zięba , Aleksandra Krystecka

We consider the combination of value-at-risk (VaR) and expected shortfall (ES) forecasts when a large pool of candidate forecasts is available. Given the limited literature in this area, we implement a variety of new combining methods. In…

Risk Management · Quantitative Finance 2026-05-15 James W. Taylor , Chao Wang

Time-to-event forecasts are essential when decisions depend on event timing. This article develops a framework for evaluating such forecasts when the event has not yet occurred or is not predicted within the forecast horizon. We introduce a…

Statistics Theory · Mathematics 2026-03-17 Robert J. Taggart , Nicholas Loveday , Simon Louis

Financial institutions have to allocate so-called "economic capital" in order to guarantee solvency to their clients and counter parties. Mathematically speaking, any methodology of allocating capital is a "risk measure", i.e. a function…

Condensed Matter · Physics 2011-08-09 Dirk Tasche

Forecast evaluation plays a key role in how empirical evidence shapes the development of the discipline. Domain experts are interested in error measures relevant for their decision making needs. Such measures may produce unreliable results.…

Machine Learning · Computer Science 2021-08-10 Hansika Hewamalage , Pablo Montero-Manso , Christoph Bergmeir , Rob J Hyndman

We develop a forecasting methodology for providing credible forecasts for time series that have recently undergone a shock. We achieve this by borrowing knowledge from other time series that have undergone similar shocks for which…

Methodology · Statistics 2020-08-28 Jilei Lin , Daniel J. Eck

The quality of probabilistic forecasts is crucial for decision-making under uncertainty. While proper scoring rules incentivize truthful reporting of precise forecasts, they fall short when forecasters face epistemic uncertainty about their…

Machine Learning · Computer Science 2025-07-18 Anurag Singh , Siu Lun Chau , Krikamol Muandet

Systemic risk is a rapidly developing area of research. Classical financial models often do not adequately reflect the phenomena of bubbles, crises, and transitions between them during credit cycles. To study very improbable events,…

Mathematical Finance · Quantitative Finance 2023-05-11 Kamil Fortuna , Janusz Szwabiński

Point forecasts can be interpreted as functionals (i.e., point summaries) of predictive distributions. We consider the situation where forecasters' directives are hidden and develop methodology for the identification of the unknown…

Methodology · Statistics 2019-02-19 Patrick Schmidt , Matthias Katzfuß , Tilmann Gneiting

To use control charts in practice, the in-control state usually has to be estimated. This estimation has a detrimental effect on the performance of control charts, which is often measured for example by the false alarm probability or the…

Methodology · Statistics 2013-07-30 Axel Gandy , Jan Terje Kvaløy

Functional time series whose sample elements are recorded sequentially over time are frequently encountered with increasing technology. Recent studies have shown that analyzing and forecasting of functional time series can be performed…

Methodology · Statistics 2020-09-22 Ufuk Beyaztas , Han Lin Shang

The consultative papers for the Basel II Accord require rating systems to provide a ranking of obligors in the sense that the rating categories indicate the creditworthiness in terms of default probabilities. As a consequence, the default…

Condensed Matter · Physics 2011-08-09 Dirk Tasche

The relative performance of competing point forecasts is usually measured in terms of loss or scoring functions. It is widely accepted that these scoring function should be strictly consistent in the sense that the expected score is…

Statistics Theory · Mathematics 2019-04-08 Tobias Fissler , Johanna F. Ziegel

This paper introduces novel backtests for the risk measure Expected Shortfall (ES) following the testing idea of Mincer and Zarnowitz (1969). Estimating a regression framework for the ES stand-alone is infeasible, and thus, our tests are…

Risk Management · Quantitative Finance 2020-08-31 Sebastian Bayer , Timo Dimitriadis

A novel forecast combination and weighted quantile based tail-risk forecasting framework is proposed, aiming to reduce the impact of modelling uncertainty in tail-risk forecasting. The proposed approach is based on a two-step estimation…

Risk Management · Quantitative Finance 2021-07-20 Giuseppe Storti , Chao Wang

We present a simple comparative framework for testing and developing uncertainty modeling in uncertain marching cubes implementations. The selection of a model to represent the probability distribution of uncertain values directly…

Human-Computer Interaction · Computer Science 2024-09-16 Robert Sisneros , Tushar M. Athawale , David Pugmire , Kenneth Moreland

Proper scoring rules are commonly applied to quantify the accuracy of distribution forecasts. Given an observation they assign a scalar score to each distribution forecast, with the the lowest expected score attributed to the true…

Methodology · Statistics 2021-02-01 Carol Alexander , Michael Coulon , Yang Han , Xiaochun Meng

We propose a novel symbolic modeling framework for decision-making under risk that merges interpretability with the core insights of Prospect Theory. Our approach replaces opaque utility curves and probability weighting functions with…

Artificial Intelligence · Computer Science 2025-04-22 Ali Arslan Yousaf , Umair Rehman , Muhammad Umair Danish