English
Related papers

Related papers: Trimming the Hill estimator: robustness, optimalit…

200 papers

The Horvitz-Thompson (HT) estimator is widely used in survey sampling. However, the variance of the HT estimator becomes large when the inclusion probabilities are highly heterogeneous. To overcome this shortcoming, in this paper, a…

Methodology · Statistics 2018-04-13 Xianpeng Zong , Rong Zhu , Guohua Zou

Computation of extreme quantiles and tail-based risk measures using standard Monte Carlo simulation can be inefficient. A method to speed up computations is provided by importance sampling. We show that importance sampling algorithms,…

Probability · Mathematics 2009-09-21 Henrik Hult , Jens Svensson

We revisit the estimation of the extreme value index for randomly censored data from a heavy tailed distribution. We introduce a new class of estimators which encompasses earlier proposals given in Worms and Worms (2014) and Beirlant et al.…

Statistics Theory · Mathematics 2018-04-19 Jan Beirlant , Julien Worms , Rym Worms

Consider a random sample in the max-domain of attraction of a multivariate extreme value distribution such that the dependence structure of the attractor belongs to a parametric model. A new estimator for the unknown parameter is defined as…

Statistics Theory · Mathematics 2012-10-05 John H. J. Einmahl , Andrea Krajina , Johan Segers

Here we suppose that the observed random variable has cumulative distribution function $F$ with regularly varying tail, i.e. $1-F \in RV_{-\alpha}$, $\alpha > 0$. Using the results about exponential order statistics we investigate…

Statistics Theory · Mathematics 2020-01-08 Pavlina K. Jordanova , Milan Stehlík

In samples from a heavy-tailed distribution a second-order approximation is often use to approximate the tail function. Based on the parameters of the approximation, an optimal sample fraction can be estimated which is then used to estimate…

Statistics Theory · Mathematics 2016-12-15 J. Martin van Zyl

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

We investigate the use of optimization to compute bounds for extremal performance measures. This approach takes a non-parametric viewpoint that aims to alleviate the issue of model misspecification possibly encountered by conventional…

Methodology · Statistics 2017-11-03 Clementine Mottet , Henry Lam

The estimation of the Extreme Value Index (EVI) is fundamental in extreme value analysis but suffers from high variance due to reliance on only a few extreme observations. We propose a control variates based transfer learning approach in a…

Methodology · Statistics 2025-11-20 Louison Bocquet-Nouaille , Jérôme Morio , Benjamin Bobbia

This paper addresses the problem of estimating, in the presence of random censoring as well as competing risks, the extreme value index of the (sub)-distribution function associated to one particular cause, in the heavy-tail case.…

Statistics Theory · Mathematics 2017-01-20 Julien Worms , Rym Worms

In R\'enyi's representation for exponential order statistics, we replace the iid exponential sequence with any iid sequence, and call the resulting order statistic generalized R\'enyi statistic. We prove that by randomly reordering the…

Statistics Theory · Mathematics 2025-02-24 Péter Kevei , László Viharos

The upper tail of a claim size distribution of a property line of business is frequently modelled by Pareto distribution. However, the upper tail does not need to be Pareto distributed, extraordinary shapes are possible. Here, the…

Methodology · Statistics 2020-02-19 Mathias Raschke

In survey sampling, survey data do not necessarily represent the target population, and the samples are often biased. However, information on the survey weights aids in the elimination of selection bias. The Horvitz-Thompson estimator is a…

Methodology · Statistics 2024-04-05 Kosuke Morikawa , Yoshikazu Terada , Jae Kwang Kim

This work proposes a novel method to robustly and accurately model time series with heavy-tailed noise, in non-stationary scenarios. In many practical application time series have heavy-tailed noise that significantly impacts the…

Machine Learning · Statistics 2022-08-01 Elena Ehrlich , Laurent Callot , François-Xavier Aubet

Adaptive experiment designs can dramatically improve statistical efficiency in randomized trials, but they also complicate statistical inference. For example, it is now well known that the sample mean is biased in adaptive trials.…

Machine Learning · Statistics 2021-02-16 Vitor Hadad , David A. Hirshberg , Ruohan Zhan , Stefan Wager , Susan Athey

In a companion paper (McRobie(2013) arxiv:1304.3918), a simple set of `elemental' estimators was presented for the Generalized Pareto tail parameter. Each elemental estimator: involves only three log-spacings; is absolutely unbiased for all…

Statistics Theory · Mathematics 2013-04-17 Allan McRobie

This paper presents a novel semiparametric method to study the effects of extreme events on binary outcomes and subsequently forecast future outcomes. Our approach, based on Bayes' theorem and regularly varying (RV) functions, facilitates a…

Econometrics · Economics 2025-02-25 Laura Liu , Yulong Wang

The study of loss function distributions is critical to characterize a model's behaviour on a given machine learning problem. For example, while the quality of a model is commonly determined by the average loss assessed on a testing set,…

Machine Learning · Computer Science 2023-06-06 Etrit Haxholli , Marco Lorenzi

We consider multivariate extreme value statistics for independent but nonidentically distributed random vectors. In particular, the data may have varying tail copulas and also heteroscedastic marginal distributions. Assuming smoothly…

Statistics Theory · Mathematics 2026-04-14 John H. J. Einmahl , Chen Zhou

We adapt a manifold sampling algorithm for the nonsmooth, nonconvex formulations of learning that arise when imposing robustness to outliers present in the training data. We demonstrate the approach on objectives based on trimmed loss.…

Optimization and Control · Mathematics 2018-07-10 Matt Menickelly , Stefan M. Wild