English
Related papers

Related papers: Heavy-Tailed NGG Mixture Models

200 papers

In this work, we study the convergence \emph{in high probability} of clipped gradient methods when the noise distribution has heavy tails, ie., with bounded $p$th moments, for some $1<p\le2$. Prior works in this setting follow the same…

Optimization and Control · Mathematics 2023-04-05 Ta Duy Nguyen , Alina Ene , Huy L. Nguyen

With the progress of information technology, large amounts of asymmetric, leptokurtic and heavy-tailed data are arising in various fields, such as finance, engineering, genetics and medicine. It is very challenging to model those kinds of…

Methodology · Statistics 2024-01-26 Chengdi Lian , Yaohua Rong , Weihu Cheng

We propose a stochastic process driven by memory effect with novel distributions including both exponential and leptokurtic heavy-tailed distributions. A class of distribution is analytically derived from the continuum limit of the discrete…

Statistical Finance · Quantitative Finance 2013-05-14 Jongwook Kim , Gabjin Oh

Given an arbitrary continuous probability density function, it is introduced a conjugated probability density, which is defined through the Shannon information associated with its cumulative distribution function. These new densities are…

Statistics Theory · Mathematics 2018-01-26 H. M. de Oliveira , R. J. Cintra

This article discusses modelling of the tail of a multivariate distribution function by means of a large deviation principle (LDP), and its application to the estimation of the probability of a multivariate extreme event from a sample of n…

Statistics Theory · Mathematics 2017-02-23 Cees de Valk

A new multivariate integer-valued Generalized AutoRegressive Conditional Heteroscedastic process based on a multivariate Poisson generalized inverse Gaussian distribution is proposed. The estimation of parameters of the proposed…

Computation · Statistics 2023-07-03 Yuhyeong Jang , Raanju R. Sundararajan , Wagner Barreto-Souza

The normal distribution and its perturbation has left an immense mark on the statistical literature. Hence, several generalized forms were developed to model different skewness, kurtosis, and body shapes. However, it is not easy to…

Methodology · Statistics 2019-12-10 Matthias Wagener , Mohammad Arashi

A particular direction of recent advance about stochastic deep-learning algorithms has been about uncovering a rather mysterious heavy-tailed nature of the stationary distribution of these algorithms, even when the data distribution is not…

Machine Learning · Computer Science 2022-04-28 Sayar Karmakar , Anirbit Mukherjee

In univariate data, there exist standard procedures for identifying dominating features that produce the largest observations. However, in the multivariate setting, the situation is quite different. This paper aims to provide tools and…

Statistics Theory · Mathematics 2023-08-29 Miriam Hägele , Jaakko Lehtomaa

Importance sampling algorithms for heavy-tailed random walks are considered. Using a specification with algorithms based on mixtures of the original distribution with some other distribution, sufficient conditions for obtaining bounded…

Probability · Mathematics 2009-09-21 Henrik Hult , Jens Svensson

In recent works on the theory of machine learning, it has been observed that heavy tail properties of Stochastic Gradient Descent (SGD) can be studied in the probabilistic framework of stochastic recursions. In particular,…

Machine Learning · Statistics 2024-03-22 Ewa Damek , Sebastian Mentemeier

Extreme events and the heavy tail distributions driven by them are ubiquitous in various scientific, engineering and financial research. They are typically associated with stochastic instability caused by hidden unresolved processes.…

Probability · Mathematics 2019-05-22 Andrew J. Majda , Xin T. Tong

A novel statistical method is proposed and investigated for estimating a heavy tailed density under mild smoothness assumptions. Statistical analyses of heavy-tailed distributions are susceptible to the problem of sparse information in the…

Methodology · Statistics 2022-11-18 Surya T Tokdar , Sheng Jiang , Erika L Cunningham

We propose an analytical approach to the computation of tail probabilities of compound distributions whose individual components have heavy tails. Our approach is based on the contour integration method, and gives rise to a representation…

Computational Finance · Quantitative Finance 2017-10-04 Igor Halperin

In the liquefied natural gas (LNG) shipping industry, the phenomenon of sloshing can lead to the occurrence of very high pressures in the tanks of the vessel. The issue of modelling or estimating the probability of the simultaneous…

Statistics Theory · Mathematics 2013-12-03 Antoine Dematteo , Stéphan CLEMENCON , Nicolas Vayatis , Mathilde Mougeot

Models based on multivariate t distributions are widely applied to analyze data with heavy tails. However, all the marginal distributions of the multivariate t distributions are restricted to have the same degrees of freedom, making these…

Methodology · Statistics 2016-04-08 Zhichao Jiang , Peng Ding

In this paper we consider the semi-parametric estimation of extreme quantiles of a right heavy-tail model. We propose a new Log Probability Weighted Moment estimator for extreme quantiles, which is obtained from the estimators of the shape…

Methodology · Statistics 2014-01-16 Frederico Caeiro , Dora Prata Gomes

Existing theory for multivariate extreme values focuses upon characterizations of the distributional tails when all components of a random vector, standardized to identical margins, grow at the same rate. In this paper, we consider the…

Statistics Theory · Mathematics 2013-12-20 J. L. Wadsworth , J. A. Tawn

This article introduces a general class of heavy-tailed autoregressions for modeling integer-valued time series with outliers. The proposed specification is based on a heavy-tailed mixture of negative binomial distributions that features an…

Statistics Theory · Mathematics 2019-09-09 Paolo Gorgi

In the context of long-tail classification on graphs, the vast majority of existing work primarily revolves around the development of model debiasing strategies, intending to mitigate class imbalances and enhance the overall performance.…

Machine Learning · Computer Science 2024-06-03 Haohui Wang , Baoyu Jing , Kaize Ding , Yada Zhu , Wei Cheng , Si Zhang , Yonghui Fan , Liqing Zhang , Dawei Zhou