English
Related papers

Related papers: A survey of a hurdle model for heavy-tailed data b…

200 papers

Two-part models and Tweedie generalized linear models (GLMs) have been used to model loss costs for short-term insurance contract. For most portfolios of insurance claims, there is typically a large proportion of zero claims that leads to…

Applications · Statistics 2020-06-11 Zhiyu Quan , Zhiguo Wang , Guojun Gan , Emiliano A. Valdez

We introduce a new class of heavy-tailed distributions for which any weighted average of independent and identically distributed random variables is larger than one such random variable in (usual) stochastic order. We show that many…

Probability · Mathematics 2025-06-18 Yuyu Chen , Seva Shneer

Heavy tails are often found in practice, and yet they are an Achilles heel of a variety of mainstream random probability measures such as the Dirichlet process (DP). The first contribution of this paper focuses on characterizing the tails…

Statistics Theory · Mathematics 2025-04-04 Vianey Palacios Ramirez , Miguel de Carvalho , Luis Gutierrez Inostroza

The generalised linear model (GLM) is a very important tool for analysing real data in biology, sociology, agriculture, engineering and many other application domain where the relationship between the response and explanatory variables may…

Methodology · Statistics 2016-07-04 Abhik Ghosh , Ayanendranath Basu

Generalized linear models (GLM) are link function based statistical models. Many supervised learning algorithms are extensions of GLMs and have link functions built into the algorithm to model different outcome distributions. There are two…

Methodology · Statistics 2019-05-02 Colleen M. Farrelly , Srikanth Namuduri , Uchenna Chukwu

Some new survival distributions are introduced based on a generalised exponential function. This class of distributions includes heavy-tailed generalisations of exponential, Weibull and gamma distributions. Properties of the distributions…

Methodology · Statistics 2014-12-03 Rose Baker

The statistical modeling of discrete extremes has received less attention than their continuous counterparts in the Extreme Value Theory (EVT) literature. One approach to the transition from continuous to discrete extremes is the modeling…

Methodology · Statistics 2024-06-18 Touqeer Ahmad , Carlo Gaetan , Philippe Naveau

We introduce a trimmed version of the Hill estimator for the index of a heavy-tailed distribution, which is robust to perturbations in the extreme order statistics. In the ideal Pareto setting, the estimator is essentially finite-sample…

Methodology · Statistics 2017-11-15 Shrijita Bhattacharya , Michael Kallitsis , Stilian Stoev

Understanding the generalization abilities of modern machine learning algorithms has been a major research topic over the past decades. In recent years, the learning dynamics of Stochastic Gradient Descent (SGD) have been related to…

Machine Learning · Statistics 2023-12-04 Benjamin Dupuis , Paul Viallard

In this paper, we discuss a method to define prior distributions for the threshold of a generalised Pareto distribution, in particular when its applications are directed to heavy-tailed data. We propose to assign prior probabilities to the…

Methodology · Statistics 2016-04-06 Cristiano Villa

We propose GradTail, an algorithm that uses gradients to improve model performance on the fly in the face of long-tailed training data distributions. Unlike conventional long-tail classifiers which operate on converged - and possibly…

Machine Learning · Computer Science 2022-01-20 Zhao Chen , Vincent Casser , Henrik Kretzschmar , Dragomir Anguelov

Generalized linear models (GLMs) have been used quite effectively in the modeling of a mean response under nonstandard conditions, where discrete as well as continuous data distributions can be accommodated. The choice of design for a GLM…

Statistics Theory · Mathematics 2016-08-14 André I. Khuri , Bhramar Mukherjee , Bikas K. Sinha , Malay Ghosh

Real-world networks are generally claimed to be scale-free, meaning that the degree distributions follow the classical power-law, at least asymptotically. Yet, closer observation shows that the classical power-law distribution is often…

Statistics Theory · Mathematics 2022-07-18 Swarup Chattopadhyay , Tanujit Chakraborty , Kuntal Ghosh , Asit K. das

This article is devoted to the study of tail index estimation based on i.i.d. multivariate observations, drawn from a standard heavy-tailed distribution, i.e. of which 1-d Pareto-like marginals share the same tail index. A multivariate…

Statistics Theory · Mathematics 2014-04-10 Stéphan Clémençon , Antoine Dematteo

High-dimensional data arise routinely in modern statistics, econometrics, finance, genomics, and machine learning. While a large body of existing methodology is developed under Gaussian or light-tailed assumptions, many real data sets…

Methodology · Statistics 2026-04-16 Long Feng

The presence of non-Gaussian tails is a prevalent characteristic in many financial modeling scenarios, necessitating the use of complex non-Gaussian distributions such as the generalized beta of the second kind (GB2) and the skewed…

Applications · Statistics 2025-12-10 Xing Yan , Yue Zhao , Qi Wu , Wenxuan Ma

The past few years have seen impressive progress in the development of deep generative models capable of producing high-dimensional, complex, and photo-realistic data. However, current methods for evaluating such models remain incomplete:…

Machine Learning · Computer Science 2024-03-14 Marco Jiralerspong , Avishek Joey Bose , Ian Gemp , Chongli Qin , Yoram Bachrach , Gauthier Gidel

This paper studies the distributed optimization problem under the influence of heavy-tailed gradient noises. Here, a heavy-tailed noise means that the noise does not necessarily satisfy the bounded variance assumption. Instead, it satisfies…

Optimization and Control · Mathematics 2025-05-12 Chao Sun , Huiming Zhang , Bo Chen , Li Yu

Data exhibiting heavy-tails in one or more dimensions is often studied using the framework of regular variation. In a multivariate setting this requires identifying specific forms of dependence in the data; this means identifying that the…

Statistics Theory · Mathematics 2017-02-02 Bikramjit Das , Sidney I. Resnick

Finite mixture distributions arise in sampling a heterogeneous population. Data drawn from such a population will exhibit extra variability relative to any single subpopulation. Statistical models based on finite mixtures can assist in the…

Methodology · Statistics 2024-01-19 Andrew M. Raim , Nagaraj K. Neerchal , Jorge G. Morel