中文
相关论文

相关论文: Approximating Heavy-Tailed Distributions with a Mi…

200 篇论文

We extend the construction principle of phase-type (PH) distributions to allow for inhomogeneous transition rates and show that this naturally leads to direct probabilistic descriptions of certain transformations of PH distributions. In…

概率论 · 数学 2019-07-01 Hansjörg Albrecher , Mogens Bladt

Real-world data are long-tailed, the lack of tail samples leads to a significant limitation in the generalization ability of the model. Although numerous approaches of class re-balancing perform well for moderate class imbalance problems,…

计算机视觉与模式识别 · 计算机科学 2024-09-04 Yanbiao Ma , Licheng Jiao , Fang Liu , Shuyuan Yang , Xu Liu , Puhua Chen

This work proposes a novel method to robustly and accurately model time series with heavy-tailed noise, in non-stationary scenarios. In many practical application time series have heavy-tailed noise that significantly impacts the…

机器学习 · 统计学 2022-08-01 Elena Ehrlich , Laurent Callot , François-Xavier Aubet

Heavy tailed distributions present a tough setting for inference. They are also common in industrial applications, particularly with Internet transaction datasets, and machine learners often analyze such data without considering the biases…

应用统计 · 统计学 2016-10-14 Matt Taddy , Hedibert Freitas Lopes , Matt Gardner

This study introduces the Exponentiated-Exponential-Pareto-Half Normal Mixture Distribution (EEPHND), a novel hybrid model developed to overcome the limitations of classical distributions in modeling complex real-world data. By compounding…

Diffusion models achieve state-of-the-art generation quality across many applications, but their ability to capture rare or extreme events in heavy-tailed distributions remains unclear. In this work, we show that traditional diffusion and…

机器学习 · 计算机科学 2024-10-30 Kushagra Pandey , Jaideep Pathak , Yilun Xu , Stephan Mandt , Michael Pritchard , Arash Vahdat , Morteza Mardani

The dominant approaches to text representation in natural language rely on learning embeddings on massive corpora which have convenient properties such as compositionality and distance preservation. In this paper, we develop a novel method…

Locally adaptive shrinkage in the Bayesian framework is achieved through the use of local-global prior distributions that model both the global level of sparsity as well as individual shrinkage parameters for mean structure parameters. The…

统计理论 · 数学 2019-03-05 Andrew Womack , Zikun Yang

This note provides some new inequalities and approximations for beta distributions, including tail inequalities, exponential inequalities of Hoeffding and Bernstein type, Gaussian inequalities and approximations.

统计理论 · 数学 2023-08-21 Alexander Henzi , Lutz Duembgen

An important question in health services research is the estimation of the proportion of medical expenditures that exceed a given threshold. Typically, medical expenditures present highly skewed, heavy tailed distributions, for which (a)…

应用统计 · 统计学 2008-07-30 Sergio Venturini , Francesca Dominici , Giovanni Parmigiani

We consider deep neural networks in a Bayesian framework with a prior distribution sampling the network weights at random. Following a recent idea of Agapiou and Castillo (2023), who show that heavy-tailed prior distributions achieve…

机器学习 · 统计学 2025-04-16 Ismaël Castillo , Paul Egels

Models based on multivariate t distributions are widely applied to analyze data with heavy tails. However, all the marginal distributions of the multivariate t distributions are restricted to have the same degrees of freedom, making these…

统计方法学 · 统计学 2016-04-08 Zhichao Jiang , Peng Ding

In this paper, a novel approach to the problem of estimating the heavy-tail exponent alpha>0 of a distribution is proposed. It is based on the fact that block-maxima of size m of the independent and identically distributed data scale at a…

统计理论 · 数学 2007-06-13 Stilian A. Stoev , George Michailidis , Murad S. Taqqu

In this paper we present a novel methodology to perform Bayesian model selection in linear models with heavy-tailed distributions. We consider a finite mixture of distributions to model a latent variable where each component of the mixture…

统计方法学 · 统计学 2017-08-21 Flávio B Gonçalves , Marcos O. Prates , Victor H. Lachos

Since the turn of the century, there has been increased interest in the application of heavy-tailed distributions, particularly stable distributions, to problems in physics and finance. Although, the tails of stable distributions provide a…

概率论 · 数学 2016-08-08 Lev B. Klebanov , Lenka Slámová

Deploying deep models in real-world scenarios entails a number of challenges, including computational efficiency and real-world (e.g., long-tailed) data distributions. We address the combined challenge of learning long-tailed distributions…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Jihun Kim , Dahyun Kim , Hyungrok Jung , Taeil Oh , Jonghyun Choi

Diffusion models have emerged as powerful generative frameworks with widespread applications across machine learning and artificial intelligence systems. While current research has predominantly focused on linear diffusions, these…

The non-asymptotic tail bounds of random variables play crucial roles in probability, statistics, and machine learning. Despite much success in developing upper bounds on tail probability in literature, the lower bounds on tail…

概率论 · 数学 2020-09-08 Anru R. Zhang , Yuchen Zhou

In this paper, we study the learning rate of generalized Bayes estimators in a general setting where the hypothesis class can be uncountable and have an irregular shape, the loss function can have heavy tails, and the optimal hypothesis may…

统计理论 · 数学 2021-11-22 Lam Si Tung Ho , Binh T. Nguyen , Vu Dinh , Duy Nguyen

Heavy-tailed distributions are widely used in robust mixture modelling due to possessing thick tails. As a computationally tractable subclass of the stable distributions, sub-Gaussian $\alpha$-stable distribution received much interest in…

机器学习 · 统计学 2017-01-25 Mahdi Teimouri , Saeid Rezakhah , Adel Mohammdpour