English
Related papers

Related papers: Threshold selection and trimming in extremes

200 papers

It was shown that when one disposes of a parametric information of the truncation distribution, the semiparametric estimator of the distribution function for truncated data (Wang, 1989) is more efficient than the nonparametric one. On the…

Statistics Theory · Mathematics 2021-06-03 Saida Mancer , Abdelhakim Necir , Souad Benchaira

We develop a novel procedure for estimating the optimizer of general convex stochastic optimization problems of the form $\min_{x\in\mathcal{X}} \mathbb{E}[F(x,\xi)]$, when the given data is a finite independent sample selected according to…

Statistics Theory · Mathematics 2022-01-26 Daniel Bartl , Shahar Mendelson

Multivariate regular variation plays a role assessing tail risk in diverse applications such as finance, telecommunications, insurance and environmental science. The classical theory, being based on an asymptotic model, sometimes leads to…

Probability · Mathematics 2011-08-31 Bikramjit Das , Abhimanyu Mitra , Sidney Resnick

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Recent works have proposed incorporating heavy-tailed (HT) noise into diffusion- and flow-based generative models, with the goals of better recovering the tails of target distributions and improving generative diversity. This motivation is…

Machine Learning · Computer Science 2026-05-14 Hamza Cherkaoui , Hélène Halconruy , Antonio Ocello

Estimating a high-dimensional sparse covariance matrix from a limited number of samples is a fundamental problem in contemporary data analysis. Most proposals to date, however, are not robust to outliers or heavy tails. Towards bridging…

Statistics Theory · Mathematics 2020-08-04 John Goes , Gilad Lerman , Boaz Nadler

The key to successful statistical analysis of bivariate extreme events lies in flexible modelling of the tail dependence relationship between the two variables. In the extreme value theory literature, various techniques are available to…

Methodology · Statistics 2025-05-05 Emma S. Simpson , Jonathan A. Tawn

We introduce a novel regression model for the conditional left and right tail of a possibly heavy-tailed response. The proposed model can be used to learn the effect of covariates on an extreme value setting via a Lasso-type specification…

Methodology · Statistics 2021-08-11 Miguel de Carvalho , Soraia Pereira , Paula Pereira , Patrícia de Zea Bermudez

Here we suppose that the observed random variable has cumulative distribution function $F$ with regularly varying tail, i.e. $1-F \in RV_{-\alpha}$, $\alpha > 0$. Using the results about exponential order statistics we investigate…

Statistics Theory · Mathematics 2020-01-08 Pavlina K. Jordanova , Milan Stehlík

We investigate the application of the Adaptive Multilevel Splitting algorithm for the estimation of tail probabilities of solutions of Stochastic Differential Equations evaluated at a given time, and of associated temporal averages. We…

Probability · Mathematics 2019-03-27 Charles-Edouard Bréhier , Tony Lelièvre

Threshold selection is a critical issue for extreme value analysis with threshold-based approaches. Under suitable conditions, exceedances over a high threshold have been shown to follow the generalized Pareto distribution (GPD)…

Methodology · Statistics 2018-06-13 Brian Bader , Jun Yan , Xuebin Zhang

Extreme value theory provides rigorous theory and statistical tools for extrapolation in machine learning, particularly in settings where traditional methods struggle due to data scarcity in the tails. A broad range of tasks benefit from…

Machine Learning · Statistics 2026-05-05 Sebastian Engelke , Nicola Gnecco , Anne Sabourin

In this paper, we consider the problem of the estimation of a Weibull tail-coefficient. In particular, we propose a regression model, from which we derive a bias-reduced estimator. This estimator is based on a least-squares approach. The…

Statistics Theory · Mathematics 2011-04-01 J. Diebolt , L. Gardes , S. Girard , A. Guillou

In this paper we discuss the problem of the estimation of extreme event occurrence probability for data drawn from some multifractal process. We also study the heavy (power-law) tail behavior of probability density function associated with…

Statistical Mechanics · Physics 2009-11-11 Jean-Francois Muzy , Emmanuel Bacry , Alexey Kozhemyak

Inference over tails is usually performed by fitting an appropriate limiting distribution over observations that exceed a fixed threshold. However, the choice of such threshold is critical and can affect the inferential results. Extreme…

Statistical Finance · Quantitative Finance 2019-02-26 Chiara Lattanzi , Manuele Leonelli

Subject selection plays a critical role in experimental studies, especially ones with human subjects. Anecdotal evidence suggests that many such studies, done at or near university campus settings suffer from selection bias, i.e., the…

Machine Learning · Computer Science 2020-12-21 Tahereh Arabghalizi , Alexandros Labrinidis

In extreme value analysis, sensitivity of inference to the definition of extreme event is a paramount issue. Under the peaks-over-threshold (POT) approach, this translates directly into the need of fitting a Generalized Pareto distribution…

Methodology · Statistics 2020-09-01 Jessica Silva Lomba , Maria Isabel Fraga Alves

Importance sampling algorithms for heavy-tailed random walks are considered. Using a specification with algorithms based on mixtures of the original distribution with some other distribution, sufficient conditions for obtaining bounded…

Probability · Mathematics 2009-09-21 Henrik Hult , Jens Svensson

Let $(X_n:n\geq 0)$ be a sequence of i.i.d. r.v.'s with negative mean. Set $S_0=0$ and define $S_n=X_1+... +X_n$. We propose an importance sampling algorithm to estimate the tail of $M=\max \{S_n:n\geq 0\}$ that is strongly efficient for…

Probability · Mathematics 2008-08-21 Jose Blanchet , Peter Glynn

We propose GradTail, an algorithm that uses gradients to improve model performance on the fly in the face of long-tailed training data distributions. Unlike conventional long-tail classifiers which operate on converged - and possibly…

Machine Learning · Computer Science 2022-01-20 Zhao Chen , Vincent Casser , Henrik Kretzschmar , Dragomir Anguelov