English
Related papers

Related papers: Optimal Forecast Reconciliation with Uncertainty Q…

200 papers

Deep learning models are being adopted and applied on various critical decision-making tasks, yet they are trained to provide point predictions without providing degrees of confidence. The trustworthiness of deep learning models can be…

Machine Learning · Computer Science 2024-10-28 Daniel Nolte , Souparno Ghosh , Ranadip Pal

This paper introduces a framework for uncertainty quantification in regression models defined in metric spaces. Leveraging a newly defined notion of homoscedasticity, we develop a conformal prediction algorithm that offers finite-sample…

Machine Learning · Statistics 2025-07-22 Gábor Lugosi , Marcos Matabuena

Calibration ensures that predicted uncertainties align with observed uncertainties. While there is an extensive literature on recalibration methods for univariate probabilistic forecasts, work on calibration for multivariate forecasts is…

Methodology · Statistics 2026-04-02 Lucas Kock , G. S. Rodrigues , Scott A. Sisson , Nadja Klein , David J. Nott

When shrinking a covariance matrix towards (a multiple) of the identity matrix, the trace of the covariance matrix arises naturally as the optimal scaling factor for the identity target. The trace also appears in other context, for example…

Methodology · Statistics 2020-09-01 Ansgar Steland

Time Series Forecasting is at the core of many practical applications such as sales forecasting for business, rainfall forecasting for agriculture and many others. Though this problem has been extensively studied for years, it is still…

Machine Learning · Computer Science 2020-03-23 Anirban Chatterjee , Subhadip Paul , Uddipto Dutta , Smaranya Dey

This paper tackles forecast combination with many forecasts or minimum variance portfolio selection with many assets. A novel convex problem called L2-relaxation is proposed. In contrast to standard formulations, L2-relaxation minimizes the…

Econometrics · Economics 2022-08-23 Zhentao Shi , Liangjun Su , Tian Xie

A new wave of work on covariance cleaning and nonlinear shrinkage has delivered asymptotically optimal analytical solutions for large covariance matrices. The same framework has been generalized to empirical cross-covariance matrices, whose…

Statistical Finance · Quantitative Finance 2026-01-22 Efstratios Manolakis , Christian Bongiorno , Rosario Nunzio Mantegna

Conformal prediction (CP) provides a framework for constructing prediction sets with guaranteed coverage, assuming exchangeable data. However, real-world scenarios often involve distribution shifts that violate exchangeability, leading to…

Machine Learning · Computer Science 2025-05-27 Shadi Alijani , Homayoun Najjaran

The comovement phenomenon in financial markets creates decision scenarios with positively correlated asset returns. This paper addresses covariance matrix estimation under such conditions, motivated by observations of significant positive…

Econometrics · Economics 2025-07-03 Weilong Liu , Yanchu Liu

This paper considers improved forecasting in possibly nonlinear dynamic settings, with high-dimension predictors ("big data" environments). To overcome the curse of dimensionality and manage data and model complexity, we examine shrinkage…

Econometrics · Economics 2019-04-26 Ali Habibnia , Esfandiar Maasoumi

One of the goals in scaling sequential machine learning methods pertains to dealing with high-dimensional data spaces. A key related challenge is that many methods heavily depend on obtaining the inverse covariance matrix of the data. It is…

Computation · Statistics 2017-07-28 Tomer Lancewicki

We assess the value of calibrating forecast models for significant wave height Hs, wind speed W and mean spectral wave period Tm for forecast horizons between zero and 168 hours from a commercial forecast provider, to improve forecast…

Applications · Statistics 2025-03-28 Conor Murphy , Ross Towe , Philip Jonathan

Time series data appears in a variety of applications such as smart transportation and environmental monitoring. One of the fundamental problems for time series analysis is time series forecasting. Despite the success of recent deep time…

Artificial Intelligence · Computer Science 2022-09-28 Baoyu Jing , Si Zhang , Yada Zhu , Bin Peng , Kaiyu Guan , Andrew Margenot , Hanghang Tong

Uncertainty estimates must be calibrated (i.e., accurate) and sharp (i.e., informative) in order to be useful. This has motivated a variety of methods for recalibration, which use held-out data to turn an uncalibrated model into a…

Machine Learning · Computer Science 2022-07-06 Charles Marx , Shengjia Zhao , Willie Neiswanger , Stefano Ermon

Managing insurance and financial risk when data is limited is a key task in the insurance industry. In this paper, we focus on cases where the risk distribution is modeled as a mixture with some components estimable to high precision or…

Optimization and Control · Mathematics 2026-03-03 N. D. Shyamalkumar , Tianrun Wang

Calibration is a common experimental physics problem, whose goal is to infer the value and uncertainty of an unobservable quantity Z given a measured quantity X. Additionally, one would like to quantify the extent to which X and Z are…

High Energy Physics - Phenomenology · Physics 2023-09-26 Rikab Gambhir , Benjamin Nachman , Jesse Thaler

Forecast reconciliation, an ex-post technique applied to forecasts that must satisfy constraints, has been a prominent topic in the forecasting literature over the past two decades. Recently, several efforts have sought to extend…

Machine Learning · Computer Science 2026-01-15 Lorenzo Nespoli , Anubhab Biswas , Roberto Rocchetta , Vasco Medici

Accurate forecasting of multivariate time series data is important in many engineering and scientific applications. Recent state-of-the-art works ignore the inter-relations between variates, using their model on each variate independently.…

Machine Learning · Computer Science 2025-03-18 Liran Nochumsohn , Hedi Zisling , Omri Azencot

In a sequential regression setting, a decision-maker may be primarily concerned with whether the future observation will increase or decrease compared to the current one, rather than the actual value of the future observation. In this…

Machine Learning · Computer Science 2023-06-09 Youngseog Chung , Aaron Rumack , Chirag Gupta

This paper studies linear overparameterized models in economic forecasting and highlights that including noise variables (regressors with no predictive power) regularizes the estimator. We consider a setting where both the outcome variable…

Econometrics · Economics 2026-04-16 Yuan Liao , Xinjie Ma , Andreas Neuhierl , Zhentao Shi