English
Related papers

Related papers: Spectral backtests of forecast distributions with …

200 papers

No matter the nature of the response and/or explanatory variables in a regression model, some basic issues such as the existence of an effect of the predictor on the response, or the assessment of a common shape across groups of…

Applications · Statistics 2020-09-01 María Alonso-Pena , Jose Ameijeiras-Alonso , Rosa M. Crujeiras

Risk assessment under different possible scenarios is a source of uncertainty that may lead to concerning financial losses. We address this issue, first, by adapting a robust framework to the class of spectral risk measures. Second, we…

Risk Management · Quantitative Finance 2019-05-21 Mohammed Berkhouch , Ghizlane Lakhnati , Marcelo Brutti Righi

Trading a financial asset pushes its price as well as the prices of other assets, a phenomenon known as cross-impact. We consider a general class of kernel-based cross-impact models and investigate suitable parameterisations for trading…

Trading and Market Microstructure · Quantitative Finance 2021-07-20 Mathieu Rosenbaum , Mehdi Tomas

Spectral kernel methods are techniques for transforming data into a coordinate system that efficiently reveals the geometric structure - in particular, the "connectivity" - of the data. These methods depend on certain tuning parameters. We…

Methodology · Statistics 2008-11-04 Ann B. Lee , Larry Wasserman

Explicit finite-sample statistical guarantees on model performance are an important ingredient in responsible machine learning. Previous work has focused mainly on bounding either the expected loss of a predictor or the probability that an…

Machine Learning · Computer Science 2024-03-07 Zhun Deng , Thomas P. Zollo , Jake C. Snell , Toniann Pitassi , Richard Zemel

We present a deep transformation model for probabilistic regression. Deep learning is known for outstandingly accurate predictions on complex data but in regression tasks, it is predominantly used to just predict a single number. This…

Machine Learning · Statistics 2020-04-02 Beate Sick , Torsten Hothorn , Oliver Dürr

Testing practices within the machine learning (ML) community have centered around assessing a learned model's predictive performance measured against a test dataset, often drawn from the same distribution as the training dataset. While…

Machine Learning · Computer Science 2021-12-07 Negar Rostamzadeh , Ben Hutchinson , Christina Greer , Vinodkumar Prabhakaran

This article concerns testing for equality of distribution between groups. We focus on screening variables with shared distributional features such as common support, modes and patterns of skewness. We propose a Bayesian testing method…

Methodology · Statistics 2016-02-19 Eric F. Lock , David B. Dunson

In this paper we suggest two statistical hypothesis tests for the regression function of binary classification based on conditional kernel mean embeddings. The regression function is a fundamental object in classification as it determines…

Machine Learning · Statistics 2022-06-22 Ambrus Tamás , Balázs Csanád Csáji

Many scientific problems involve data exhibiting both temporal and cross-sectional dependencies. While linear dependencies have been extensively studied, the theoretical analysis of regression estimators under nonlinear dependencies remains…

Statistics Theory · Mathematics 2025-02-27 Marie-Christine Düker , Adam Waterbury

Deferrable load control is essential for handling the uncertainties associated with the increasing penetration of renewable generation. Model predictive control has emerged as an effective approach for deferrable load control, and has…

Optimization and Control · Mathematics 2014-09-23 Niangjun Chen , Lingwen Gan , Steven H. Low , Adam Wierman

This paper applies an AR(1)-GARCH (1, 1) process to detail the conditional distributions of the return distributions for the S&P500, FT100, DAX, Hang Seng, and Nikkei225 futures contracts. It then uses the conditional distribution for these…

Risk Management · Quantitative Finance 2011-03-29 John Cotter , Kevin Dowd

Classification models are expected to perform equally well for different classes, yet in practice, there are often large gaps in their performance. This issue of class bias is widely studied in cases of datasets with sample imbalance, but…

Machine Learning · Computer Science 2024-06-04 Chiraag Kaushik , Ran Liu , Chi-Heng Lin , Amrit Khera , Matthew Y Jin , Wenrui Ma , Vidya Muthukumar , Eva L Dyer

Despite achieving excellent performance on benchmarks, deep neural networks often underperform in real-world deployment due to sensitivity to minor, often imperceptible shifts in input data, known as distributional shifts. These shifts are…

Machine Learning · Computer Science 2025-09-25 Birk Torpmann-Hagen , Pål Halvorsen , Michael A. Riegler , Dag Johansen

We derive analytical expressions for the generalization performance of kernel regression as a function of the number of training samples using theoretical methods from Gaussian processes and statistical physics. Our expressions apply to…

Machine Learning · Computer Science 2021-02-26 Blake Bordelon , Abdulkadir Canatar , Cengiz Pehlevan

Calibration tests based on the probability integral transform (PIT) are routinely used to assess the quality of univariate distributional forecasts. However, PIT-based calibration tests for multivariate distributional forecasts face various…

Econometrics · Economics 2023-12-13 Malte Knüppel , Fabian Krüger , Marc-Oliver Pohle

Model checking plays an important role in linear regression as model misspecification seriously affects the validity and efficiency of regression analysis. In practice, model checking is often performed by subjectively evaluating the plot…

Statistics Theory · Mathematics 2019-11-19 Rok Blagus , Jakob Peterlin , Janez Stare

In a regression model, prediction is typically performed after model selection. The large variability in the model selection makes the prediction unstable. Thus, it is essential to reduce the variability in model selection and improve…

Computation · Statistics 2024-04-11 Wataru Yoshida , Kei Hirose

Backtesting risk measures is a central task in financial regulation. While standard backtests evaluate whether a forecasting model is statistically consistent with observed losses, regulatory practice often requires assessing the…

Methodology · Statistics 2026-03-06 Zhanyi Jiao , Qiuqi Wang , Yimiao Zhao

Under covariate shift, training (source) data and testing (target) data differ in input space distribution, but share the same conditional label distribution. This poses a challenging machine learning task. Robust Bias-Aware (RBA)…

Machine Learning · Computer Science 2018-01-01 Anqi Liu , Rizal Fathony , Brian D. Ziebart