English
Related papers

Related papers: An Imbalance-Robust Evaluation Framework for Extre…

200 papers

We consider the estimation of rare-event probabilities using sample proportions output by naive Monte Carlo or collected data. Unlike using variance reduction techniques, this naive estimator does not have a priori relative efficiency…

Methodology · Statistics 2025-02-19 Yuanlu Bai , Henry Lam

While significant progress has been made in specifying neural networks capable of representing uncertainty, deep networks still often suffer from overconfidence and misaligned predictive distributions. Existing approaches for measuring this…

Machine Learning · Computer Science 2025-10-24 Spencer Young , Riley Sinema , Cole Edgren , Andrew Hall , Nathan Dong , Porter Jenkins

In this paper, we introduce a novel model for the meta-analysis of proportions that integrates the standard random-effects model (REM) with an extreme value theory (EVT)-based component. The proposed model, named XT-REM (Extreme-Tail Random…

We introduce a method to estimate simultaneously the tail and the threshold parameters of an extreme value regression model. This standard model finds its use in finance to assess the effect of market variables on extreme loss distributions…

Methodology · Statistics 2023-04-17 Julien Hambuckers , Marie Kratz , Antoine Usseglio-Carleve

Robust optimization safeguards decisions against uncertainty by optimizing against worst-case scenarios, yet their effectiveness hinges on a prespecified robustness level that is often chosen ad hoc, leading to either insufficient…

Machine Learning · Statistics 2026-02-02 Wenbin Zhou , Shixiang Zhu

Important tasks like record linkage and extreme classification demonstrate extreme class imbalance, with 1 minority instance to every 1 million or more majority instances. Obtaining a sufficient sample of all classes, even just to achieve…

Machine Learning · Computer Science 2021-06-03 Neil G. Marchant , Benjamin I. P. Rubinstein

Deep learning models are notoriously vulnerable to imperceptible perturbations. Most existing research centers on adversarial robustness (AR), which evaluates models under worst-case scenarios by examining the existence of deterministic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Yi Zhang , Zheng Wang , Zhen Chen , Wenjie Ruan , Qing Guo , Siddartha Khastgir , Carsten Maple , Xingyu Zhao

Heavy-tailed error distributions and predictors with anomalous values are ubiquitous in high-dimensional regression problems and can seriously jeopardize the validity of statistical analyses if not properly addressed. For more reliable…

Methodology · Statistics 2024-09-20 David Kepplinger

This paper presents first steps toward robust models for crisis prediction. We conduct a horse race of conventional statistical methods and more recent machine learning methods as early-warning models. As individual models are in the…

Statistical Finance · Quantitative Finance 2016-04-04 Markus Holopainen , Peter Sarlin

Empirical Risk Minimization (ERM) algorithms are widely used in a variety of estimation and prediction tasks in signal-processing and machine learning applications. Despite their popularity, a theory that explains their statistical…

Machine Learning · Statistics 2020-07-07 Hossein Taheri , Ramtin Pedarsani , Christos Thrampoulidis

We study distributional robustness in the context of Extreme Value Theory (EVT). We provide a data-driven method for estimating extreme quantiles in a manner that is robust against incorrect model assumptions underlying the application of…

Statistics Theory · Mathematics 2020-06-09 Jose Blanchet , Fei He , Karthyek R. A. Murthy

Forecasting rare events in multivariate time-series data is challenging due to severe class imbalance, long-range dependencies, and distributional uncertainty. We introduce EVEREST, a transformer-based architecture for probabilistic…

Machine Learning · Computer Science 2026-01-29 Antanas Zilinskas , Robert N. Shorten , Jakub Marecek

This paper investigates robust versions of the general empirical risk minimization algorithm, one of the core techniques underlying modern statistical methods. Success of the empirical risk minimization is based on the fact that for a…

Machine Learning · Statistics 2019-10-17 Stanislav Minsker , Timothée Mathieu

Extreme value applications commonly employ regression techniques to capture cross-sectional heterogeneity or time-variation in the data. Estimation of the parameters of an extreme value regression model is notoriously challenging due to the…

Methodology · Statistics 2022-05-12 Debbie J. Dupuis , Sebastian Engelke , Luca Trapin

Stated choice probabilities are increasingly used in conjunction with the random-coefficient model (RCM) to describe individual preferences. They allow survey respondents to express uncertainty about the future or the incompleteness of a…

General Economics · Economics 2025-03-19 Romuald Meango

This paper introduces novel backtests for the risk measure Expected Shortfall (ES) following the testing idea of Mincer and Zarnowitz (1969). Estimating a regression framework for the ES stand-alone is infeasible, and thus, our tests are…

Risk Management · Quantitative Finance 2020-08-31 Sebastian Bayer , Timo Dimitriadis

Outlying observations can be challenging to handle and adversely affect subsequent analyses, especially in data with increasing dimensional complexity. Although outliers are not always undesired anomalies in the data and may possess…

Methodology · Statistics 2025-09-18 Anthony-Alexander Christidis , Gabriela Cohen-Freue

Class distribution skews in imbalanced datasets may lead to models with prediction bias towards majority classes, making fair assessment of classifiers a challenging task. Metrics such as Balanced Accuracy are commonly used to evaluate a…

\noindent Randomized nomination sampling (RNS) is a rank-based sampling technique which has been shown to be effective in several nonparametric studies involving environmental and ecological applications. In this paper, we investigate…

Methodology · Statistics 2015-12-18 Mohammad Nourmohammadi , Mohammad Jafari Jozani , Brad Johnson

Many of the successes of machine learning are based on minimizing an averaged loss function. However, it is well-known that this paradigm suffers from robustness issues that hinder its applicability in safety-critical domains. These issues…

Machine Learning · Computer Science 2022-06-09 Alexander Robey , Luiz F. O. Chamon , George J. Pappas , Hamed Hassani