English
Related papers

Related papers: Estimating the Tail Index by using Model Averaging

200 papers

Model averaging is an important alternative to model selection with attractive prediction accuracy. However, its application to high-dimensional data remains under-explored. We propose a high-dimensional model averaging method via…

Statistics Theory · Mathematics 2025-06-11 Zhengyan Wan , Fang Fang , Binyan Jiang

Heavy tailed distributions present a tough setting for inference. They are also common in industrial applications, particularly with Internet transaction datasets, and machine learners often analyze such data without considering the biases…

Applications · Statistics 2016-10-14 Matt Taddy , Hedibert Freitas Lopes , Matt Gardner

This thesis evaluates most of the extreme mixture models and methods that have appended in the literature and implements them in the context of finance and insurance. The paper also reviews and studies extreme value theory, time series,…

General Economics · Economics 2024-07-09 Yujuan Qiu

Power law distributions, in particular Pareto distributions, describe data across diverse areas of study. We have developed a package in R to estimate the tail index for such datasets focusing on speed (in particular with large datasets),…

Methodology · Statistics 2020-06-19 Ranjiva Munasinghe , Pathum Kossinna , Dovini Jayasinghe , Dilanka Wijeratne

Background: Overweight and obesity are an increasing phenomenon worldwide. Predicting future overweight or obesity early in the childhood reliably could enable a successful intervention by experts. While a lot of research has been done…

Machine Learning · Computer Science 2019-11-20 Ilkka Rautiainen , Sami Äyrämö

We propose estimating the scale parameter (mean of the eigenvalues) of the scatter matrix of an unspecified elliptically symmetric distribution using weights obtained by solving Tyler's M-estimator of the scatter matrix. The proposed…

Methodology · Statistics 2023-05-09 Esa Ollila , Daniel P. Palomar , Frederic Pascal

A standard goal of model evaluation and selection is to find a model that approximates the truth well while at the same time is as parsimonious as possible. In this paper we emphasize the point of view that the models under consideration…

Methodology · Statistics 2010-10-05 Bruce Lindsay , Jiawei Liu

Object-oriented software metrics provide a numerical characterization of software quality. They have also been used in the assessment and identification of technical debt. However, metrics generally need to be used with thresholds as…

Software Engineering · Computer Science 2021-04-05 Sultan Alhusain

The existence of large and extreme claims of a non-life insurance portfolio influences the ability of (re)insurers to estimate the reserve. The excess over-threshold method provides a way to capture and model the typical behaviour of…

Applications · Statistics 2019-11-07 Yinzhi Wang , Ingrid Hobæk Haff , Arne Huseby

We investigate the use of optimization to compute bounds for extremal performance measures. This approach takes a non-parametric viewpoint that aims to alleviate the issue of model misspecification possibly encountered by conventional…

Methodology · Statistics 2017-11-03 Clementine Mottet , Henry Lam

This article describes posterior maximization for topic models, identifying computational and conceptual gains from inference under a non-standard parametrization. We then show that fitted parameters can be used as the basis for a novel…

Applications · Statistics 2011-12-30 Matthew A. Taddy

We propose thresholding as an approach to deal with class imbalance. We define the concept of thresholding as a process of determining a decision boundary in the presence of a tunable parameter. The threshold is the maximum value of this…

Machine Learning · Computer Science 2016-07-12 Charmgil Hong , Rumi Ghosh , Soundar Srinivasan

Classical peaks over threshold analysis is widely used for statistical modeling of sample extremes, and can be supplemented by a model for the sizes of clusters of exceedances. Under mild conditions a compound Poisson process model allows…

Applications · Statistics 2016-08-14 Mária Süveges , Anthony C. Davison

In the world of multivariate extremes, estimation of the dependence structure still presents a challenge and an interesting problem. A procedure for the bivariate case is presented that opens the road to a similar way of handling the…

Statistics Theory · Mathematics 2008-11-14 John H. J. Einmahl , Andrea Krajina , Johan Segers

The Peaks-Over Threshold is a fundamental method in the estimation of rare events such as small exceedance probabilities, extreme quantiles and return periods. The main problem with the Peaks-Over Threshold method relates to the selection…

Methodology · Statistics 2018-12-11 Richard Minkah , Tertius de Wet

Statistical analysis of extremes can be used to predict the probability of future extreme events, such as large rainfalls or devastating windstorms. The quality of these forecasts can be measured through scoring rules. Locally scale…

Methodology · Statistics 2024-02-22 Helga Kristin Olafsdottir , Holger Rootzén , David Bolin

This article proposes a new method of truncated estimation to estimate the tail index $\alpha$ of the extremely heavy-tailed distribution with infinite mean or variance. We not only present two truncated estimators $\hat{\alpha}$ and…

Statistics Theory · Mathematics 2022-09-13 F. Q. Tang , D. Han

Inverse probability weights are commonly used in epidemiology to estimate causal effects in observational studies. Researchers can typically focus on either the average treatment effect or the average treatment effect on the treated with…

Methodology · Statistics 2022-10-05 Eli Ben-Michael , Luke Keele

We develop an unsupervised mixture model for non-negative, skewed and heavy-tailed data, such as losses in actuarial and risk management applications. The mixture has a lognormal component, which is usually appropriate for the body of the…

Methodology · Statistics 2025-05-29 Marco Bee , Flavio Santi

This paper introduces a flexible framework for the estimation of the conditional tail index of heavy tailed distributions. In this framework, the tail index is computed from an auxiliary linear regression model that facilitates estimation…

Econometrics · Economics 2024-09-23 João Nicolau , Paulo M. M. Rodrigues