English
Related papers

Related papers: Taming the Long Tail of Deep Probabilistic Forecas…

200 papers

In this paper, we introduce reduced-bias estimators for the estimation of the tail index of a Pareto-type distribution. This is achieved through the use of a regularised weighted least squares with an exponential regression model for…

Methodology · Statistics 2022-04-19 E. Ocran , R. Minkah , G. Kallah-Dagadu , K. Doku-Amponsah

We consider the estimation of small probabilities or other risk quantities associated with rare but catastrophic events. In the model-based literature, much of the focus has been devoted to efficient Monte Carlo computation or analytical…

Statistics Theory · Mathematics 2024-01-02 Zhiyuan Huang , Henry Lam , Zhenyuan Liu

This note presents an operational measure of fat-tailedness for univariate probability distributions, in $[0,1]$ where 0 is maximally thin-tailed (Gaussian) and 1 is maximally fat-tailed. Among others,1) it helps assess the sample size…

Methodology · Statistics 2019-04-30 Nassim Nicholas Taleb

Conformal prediction has emerged as a rigorous means of providing deep learning models with reliable uncertainty estimates and safety guarantees. Yet, its performance is known to degrade under distribution shift and long-tailed class…

Machine Learning · Computer Science 2023-07-06 Kevin Kasa , Graham W. Taylor

Heavy-tailed distributions are infamously difficult to estimate because their moments tend to infinity as the shape of the tail decay increases. Nevertheless, this study shows the utilization of a modified group of moments for estimating a…

Methodology · Statistics 2025-07-31 Amenah AL-Najafi , Ugur Tirnakli , Kenric P. Nelson

The imbalance (or long-tail) is the nature of many real-world data distributions, which often induces the undesirable bias of deep classification models toward frequent classes, resulting in poor performance for tail classes. In this paper,…

Machine Learning · Computer Science 2025-10-13 Fudong Lin , Xu Yuan

Modeling and predicting extreme movements in GDP is notoriously difficult and the selection of appropriate covariates and/or possible forms of nonlinearities are key in obtaining precise forecasts. In this paper, our focus is on using large…

Econometrics · Economics 2023-09-25 Jan Prüser , Florian Huber

While the estimation of risk is an important question in the daily business of banking and insurance, many existing plug-in estimation procedures suffer from an unnecessary bias. This often leads to the underestimation of risk and…

Risk Management · Quantitative Finance 2022-01-28 Marcin Pitera , Thorsten Schmidt

Climate extremes such as floods, storms, and heatwaves have caused severe economic and human losses across Europe in recent decades. To support the European Union's climate resilience efforts, we propose a statistical framework for…

Applications · Statistics 2025-05-26 Carlotta Pacifici , Simone A. Padoan , Jaroslav Mysiak

We propose a family of models that enable predictive estimation of time-varying extreme event probabilities in heavy-tailed and nonlinearly dependent time series. The models are a white noise process with conditionally log-Laplace…

Methodology · Statistics 2021-01-19 Gordon V. Chavez

I report a new statistical distribution formulated to confront the infamous, long-standing, computational/modeling challenge presented by highly skewed and/or leptokurtic ("fat- or heavy-tailed") data. The distribution is straightforward,…

Statistical Finance · Quantitative Finance 2011-11-01 Lawrence R. Thorne

We develop an unsupervised mixture model for non-negative, skewed and heavy-tailed data, such as losses in actuarial and risk management applications. The mixture has a lognormal component, which is usually appropriate for the body of the…

Methodology · Statistics 2025-05-29 Marco Bee , Flavio Santi

Accurate modeling is essential in integer-valued real phenomena, including the distribution of entire data, zero-inflated (ZI) data, and discrete exceedances. The Poisson and Negative Binomial distributions, along with their ZI variants,…

Methodology · Statistics 2025-10-20 Touqeer Ahmad , Irshad Ahmad Arshad

A location- and scale-invariant predictor is constructed which exhibits good probability matching for extreme predictions outside the span of data drawn from a variety of (stationary) general distributions. It is constructed via the…

Statistics Theory · Mathematics 2013-07-30 Allan McRobie

In recent years several attempts have been made to extend tail modelling towards the modal part of the data. Frigessi et al. (2002) introduced dynamic mixtures of two components with a weight function {\pi} = {\pi}(x) smoothly connecting…

Methodology · Statistics 2018-10-03 Jan Beirlant , Gaonyalelwe Maribe , Philippe Naveau , Andrehette Verster

We investigate the relation between moments and tails of heavy-tailed (in particular, Pareto-type) distributions. We also discuss the sharpness of our results in a number of examples under certain regularity conditions like log-convexity.…

Probability · Mathematics 2024-10-30 Paul Buterus , Holger Sambale

The double Pareto distribution is a heavy-tailed distribution with a power-law tail, that is generated via geometric Brownian motion with an exponentially distributed observation time. In this study, we examine a modified model wherein the…

Statistical Mechanics · Physics 2024-04-30 Ken Yamamoto , Takashi Bando , Hirokazu Yanagawa , Yoshihiro Yamazaki

While the {estimation} of risk is an important question in the daily business of banking and insurance, many existing plug-in estimation procedures suffer from an unnecessary bias. This often leads to the underestimation of risk and…

Risk Management · Quantitative Finance 2022-02-04 Marcin Pitera , Thorsten Schmidt

This paper presents a novel semiparametric method to study the effects of extreme events on binary outcomes and subsequently forecast future outcomes. Our approach, based on Bayes' theorem and regularly varying (RV) functions, facilitates a…

Econometrics · Economics 2025-02-25 Laura Liu , Yulong Wang

How to estimate the uncertainty of a given model is a crucial problem. Current calibration techniques treat different classes equally and thus implicitly assume that the distribution of training data is balanced, but ignore the fact that…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Jiahao Chen , Bing Su