English
Related papers

Related papers: Probabilistic Forecast Reconciliation with Kullbac…

200 papers

Many real-life applications involve simultaneously forecasting multiple time series that are hierarchically related via aggregation or disaggregation operations. For instance, commercial organizations often want to forecast inventories…

Machine Learning · Computer Science 2021-02-26 Xing Han , Sambarta Dasgupta , Joydeep Ghosh

Calibration means that forecasts and average realized frequencies are close. We develop the concept of forecast hedging, which consists of choosing the forecasts so as to guarantee that the expected track record can only improve. This…

Theoretical Economics · Economics 2022-10-14 Dean P. Foster , Sergiu Hart

Recently, continual learning has received a lot of attention. One of the significant problems is the occurrence of \emph{concept drift}, which consists of changing probabilistic characteristics of the incoming data. In the case of the…

Machine Learning · Computer Science 2022-10-11 Sebastián Basterrech , Michal Woźniak

Platform businesses operate on a digital core and their decision making requires high-dimensional accurate forecast streams at different levels of cross-sectional (e.g., geographical regions) and temporal aggregation (e.g., minutes to…

Econometrics · Economics 2024-06-03 Jeroen Rombouts , Marie Ternes , Ines Wilms

Propensity score methods are widely used for estimating treatment effects from observational studies. A popular approach is to estimate propensity scores by maximum likelihood based on logistic regression, and then apply inverse probability…

Methodology · Statistics 2017-10-24 Zhiqiang Tan

Estimating the Kullback-Leibler (KL) divergence between random variables is a fundamental problem in statistical analysis. For continuous random variables, traditional information-theoretic estimators scale poorly with dimension and/or…

Machine Learning · Computer Science 2025-10-08 Mikil Foss , Andrew Lamperski

We propose a novel probabilistic approach to multilevel clustering problems based on composite transportation distance, which is a variant of transportation distance where the underlying metric is Kullback-Leibler divergence. Our method…

Machine Learning · Computer Science 2018-10-30 Nhat Ho , Viet Huynh , Dinh Phung , Michael I. Jordan

Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting, where the goal is to model and forecast multivariate time-series that have underlying hierarchical relations. Most methods focus on point…

Machine Learning · Computer Science 2023-10-20 Harshavardhan Kamarthi , Lingkai Kong , Alexander Rodríguez , Chao Zhang , B. Aditya Prakash

Probabilistic hierarchical time-series forecasting is an important variant of time-series forecasting, where the goal is to model and forecast multivariate time-series that have underlying hierarchical relations. Most methods focus on point…

Machine Learning · Computer Science 2023-10-20 Harshavardhan Kamarthi , Lingkai Kong , Alexander Rodríguez , Chao Zhang , B. Aditya Prakash

When providing probabilistic forecasts for uncertain future events, it is common to strive for calibrated forecasts, that is, the predictive distribution should be compatible with the observed outcomes. Several notions of calibration are…

Methodology · Statistics 2015-05-21 Christof Strähl , Johanna F. Ziegel

We show that the Kullback-Leibler distance is a good measure of the statistical uncertainty of correlation matrices estimated by using a finite set of data. For correlation matrices of multivariate Gaussian variables we analytically…

Data Analysis, Statistics and Probability · Physics 2008-12-02 Michele Tumminello , Fabrizio Lillo , Rosario Nunzio Mantegna

We propose to estimate the weight matrix used for forecast reconciliation as parameters in a general linear model in order to quantify its uncertainty. This implies that forecast reconciliation can be formulated as an orthogonal projection…

Methodology · Statistics 2024-02-12 Jan Kloppenborg Møller , Peter Nystrup , Poul G. Hjorth , Henrik Madsen

We propose an algorithm to estimate the path-gradient of both the reverse and forward Kullback-Leibler divergence for an arbitrary manifestly invertible normalizing flow. The resulting path-gradient estimators are straightforward to…

Machine Learning · Computer Science 2022-07-19 Lorenz Vaitl , Kim A. Nicoli , Shinichi Nakajima , Pan Kessel

Probabilistic models must be well calibrated to support reliable decision-making. While calibration in single-output regression is well studied, defining and achieving multivariate calibration in multi-output regression remains considerably…

Machine Learning · Statistics 2025-10-28 Naomi Desobry , Elnura Zhalieva , Souhaib Ben Taieb

Probabilistic, hierarchically coherent forecasting is a key problem in many practical forecasting applications -- the goal is to obtain coherent probabilistic predictions for a large number of time series arranged in a pre-specified tree…

Machine Learning · Computer Science 2023-03-02 Abhimanyu Das , Weihao Kong , Biswajit Paria , Rajat Sen

The forecasting combination puzzle is a well-known phenomenon in forecasting literature, stressing the challenge of outperforming the simple average when aggregating forecasts from diverse methods. This study proposes a Reinforcement…

Econometrics · Economics 2025-08-29 Marcelo C. Medeiros , Jeronymo M. Pinro

Robustness to noise and outliers is a desirable trait in phase retrieval algorithms for many applications in imaging and signal processing. In this paper, we develop novel robust phase retrieval algorithms based on the minimization of…

Signal Processing · Electrical Eng. & Systems 2024-02-15 Nazia Afroz Choudhury , Bariscan Yonel , Birsen Yazici

This paper deals with the taking into account a given set of realizations as constraints in the Kullback-Leibler minimum principle, which is used as a probabilistic learning algorithm. This permits the effective integration of data into…

Machine Learning · Statistics 2022-05-09 Christian Soize

Long range forecasts are the starting point of many decision support systems that need to draw inference from high-level aggregate patterns on forecasted values. State of the art time-series forecasting methods are either subject to concept…

Machine Learning · Computer Science 2022-05-27 Prathamesh Deshpande , Sunita Sarawagi

Recently, diffusion probabilistic models (DPMs) have achieved promising results in diverse generative tasks. A typical DPM framework includes a forward process that gradually diffuses the data distribution and a reverse process that…

Machine Learning · Computer Science 2023-10-31 Tianyu Pang , Cheng Lu , Chao Du , Min Lin , Shuicheng Yan , Zhijie Deng