English
Related papers

Related papers: The tail wags the distribution: Only sample the ta…

200 papers

Excellent tail performance is crucial for modern machine learning tasks, such as algorithmic fairness, class imbalance, and risk-sensitive decision making, as it ensures the effective handling of challenging samples within a dataset. Tail…

Information Retrieval · Computer Science 2024-02-29 Riku Togashi , Tatsushi Oka , Naoto Ohsaka , Tetsuro Morimura

We study the asymptotic behaviour of widely used tests for evaluating and comparing predictive accuracy when forecast errors exhibit heavy tails. In particular, when loss differentials have infinite variance, the Diebold-Mariano test…

Methodology · Statistics 2026-05-20 Jonas F. Frederiksen , Muneya Matsui , Rasmus S. Pedersen

Gradient-boosted trees achieve strong performance on tabular data, yet often leave a long tail of poorly predicted instances. We introduce a Trajectory-based Difficulty Score (TDS), an instance-level difficulty estimator for boosted…

Machine Learning · Computer Science 2026-05-26 Tomer Lavi , Bracha Shapira , Nadav Rappoport

Real-world data is laden with outlying values. The challenge for machine learning is that the learner typically has no prior knowledge of whether the feedback it receives (losses, gradients, etc.) will be heavy-tailed or not. In this work,…

Machine Learning · Statistics 2020-12-16 Matthew J. Holland

For measuring tail risk with scarce extreme events, extreme value analysis is often invoked as the statistical tool to extrapolate to the tail of a distribution. The presence of large datasets benefits tail risk analysis by providing more…

Methodology · Statistics 2023-12-18 Liujun Chen , Deyuan Li , Chen Zhou

At high levels, the asymptotic distribution of a stationary, regularly varying Markov chain is conveniently given by its tail process. The latter takes the form of a geometric random walk, the increment distribution depending on the sign of…

Methodology · Statistics 2014-12-11 Holger Drees , Johan Segers , Michał Warchoł

The growing availability of large and complex datasets has increased interest in temporal stochastic processes that can capture stylized facts such as marginal skewness, non-Gaussian tails, long memory, and even non-Markovian dynamics.…

Machine Learning · Statistics 2025-10-09 Dan Leonte , Raphaël Huser , Almut E. D. Veraart

Tail risk measures are fully determined by the distribution of the underlying loss beyond its quantile at a certain level, with Value-at-Risk, Expected Shortfall and Range Value-at-Risk being prime examples. They are induced by law-based…

Statistical Finance · Quantitative Finance 2025-11-07 Tobias Fissler , Fangda Liu , Ruodu Wang , Linxiao Wei

The multivariate version of the Mixed Tempered Stable is proposed. It is a generalization of the Normal Variance Mean Mixtures. Characteristics of this new distribution and its capacity in fitting tails and capturing dependence structure…

Statistical Finance · Quantitative Finance 2016-10-04 Asmerilda Hitaj , Friedrich Hubalek , Lorenzo Mercuri , Edit Rroji

We propose a random walk model of asset returns where the parameters depend on market stress. Stress is measured by, e.g., the value of an implied volatility index. We show that model parameters including standard deviations and…

General Finance · Quantitative Finance 2016-05-11 Martin Gremm

We introduce a method to estimate simultaneously the tail and the threshold parameters of an extreme value regression model. This standard model finds its use in finance to assess the effect of market variables on extreme loss distributions…

Methodology · Statistics 2023-04-17 Julien Hambuckers , Marie Kratz , Antoine Usseglio-Carleve

Identifying risk spillovers in financial markets is of great importance for assessing systemic risk and portfolio management. Granger causality in tail (or in risk) tests whether past extreme events of a time series help predicting future…

Risk Management · Quantitative Finance 2021-05-07 Piero Mazzarisi , Silvia Zaoli , Carlo Campajola , Fabrizio Lillo

Risk measures, which typically evaluate the impact of extreme losses, are highly sensitive to misspecification in the tails. This paper studies a robust optimization approach to combat tail uncertainty by proposing a unifying framework to…

Optimization and Control · Mathematics 2024-12-09 Guanyu Jin , Roger J. A. Laeven , Dick den Hertog , Aharon Ben-Tal

We propose a computational framework to quantify (measure) and to optimize the reliability of complex systems. The approach uses a graph representation of the system that is subject to random failures of its components (nodes and edges).…

Optimization and Control · Mathematics 2021-06-25 Joshua L. Pulsipher , Victor M. Zavala

A new approach of obtaining stratified random samples from statistically dependent random variables is described. The proposed method can be used to obtain samples from the input space of a computer forward model in estimating expectations…

Methodology · Statistics 2019-11-25 Anirban Mondal , Abhijit Mandal

This work studies applications and generalizations of a simple estimation technique that provides exponential concentration under heavy-tailed distributions, assuming only bounded low-order moments. We show that the technique can be used…

Machine Learning · Computer Science 2016-04-19 Daniel Hsu , Sivan Sabato

We propose a multivariate generative model to capture the complex dependence structure often encountered in business and financial data. Our model features heterogeneous and asymmetric tail dependence between all pairs of individual…

Machine Learning · Computer Science 2025-12-10 Xiangqian Sun , Xing Yan , Qi Wu

Heavy rainfall distributional modeling is essential in any impact studies linked to the water cycle, e.g.\ flood risks. Still, statistical analyses that both take into account the temporal and multivariate nature of extreme rainfall are…

Methodology · Statistics 2022-05-13 Gloria Buriticá , Philippe Naveau

Meta learning is a promising paradigm in the era of large models and task distributional robustness has become an indispensable consideration in real-world scenarios. Recent advances have examined the effectiveness of tail task risk…

Machine Learning · Computer Science 2024-10-31 Yiqin Lv , Qi Wang , Dong Liang , Zheng Xie

Scenario generation is the construction of a discrete random vector to represent parameters of uncertain values in a stochastic program. Most approaches to scenario generation are distribution-driven, that is, they attempt to construct a…

Optimization and Control · Mathematics 2021-05-21 Jamie Fairbrother , Amanda Turner , Stein Wallace