English
Related papers

Related papers: A Heavy-Tailed Algebra for Probabilistic Programmi…

200 papers

State-space models are pivotal for dynamic system analysis but often struggle with outlier data that deviates from Gaussian distributions, frequently exhibiting skewness and heavy tails. This paper introduces a robust extension utilizing…

Signal Processing · Electrical Eng. & Systems 2025-07-31 Yifan Yu , Shengjie Xiu , Daniel P. Palomar

We extend a result of Goldreich and Ron about estimating the collision probability of a hash function. Their estimate has a polynomial tail. We prove that when the load factor is greater than a certain constant, the estimator has a gaussian…

Data Structures and Algorithms · Computer Science 2007-05-23 Dawei Hong , Jean-Camille Birget , Shushuang Man

In this paper, we provide a review on the kernel method, which is one of the options for characterizing so-called exact tail asymptotic properties in stationary probabilities of two-dimensional random walks, discrete or continuous (or…

Probability · Mathematics 2021-01-29 Yiqiang Q. Zhao

We develop two new estimators for a general class of stationary GARCH models with possibly heavy tailed asymmetrically distributed errors, covering processes with symmetric and asymmetric feedback like GARCH, Asymmetric GARCH, VGARCH and…

Statistics Theory · Mathematics 2015-07-29 Jonathan B. Hill

We establish exponential inequalities and Cramer-type moderate deviation theorems for a class of V-statistics under strong mixing conditions. Our theory is developed via kernel expansion based on random Fourier features. This type of…

Statistics Theory · Mathematics 2019-02-08 Yandi Shen , Fang Han , Daniela Witten

A fundamental characteristic of natural language is the high rate at which speakers produce novel expressions. Because of this novelty, a heavy-tail of rare events accounts for a significant amount of the total probability mass of…

Computation and Language · Computer Science 2022-03-25 Benjamin LeBrun , Alessandro Sordoni , Timothy J. O'Donnell

Linear regression with the classical normality assumption for the error distribution may lead to an undesirable posterior inference of regression coefficients due to the potential outliers. This paper considers the finite mixture of two…

Methodology · Statistics 2021-01-12 Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

Heavy-tailed noise is pervasive in modern machine learning applications, arising from data heterogeneity, outliers, and non-stationary stochastic environments. While second-order methods can significantly accelerate convergence in…

Optimization and Control · Mathematics 2025-10-14 Abdurakhmon Sadiev , Peter Richtárik , Ilyas Fatkhullin

Many statistical models are algebraic in that they are defined by polynomial constraints or by parameterizations that are polynomial or rational maps. This opens the door for tools from computational algebraic geometry. These tools can be…

Statistics Theory · Mathematics 2007-06-13 Mathias Drton

A particular direction of recent advance about stochastic deep-learning algorithms has been about uncovering a rather mysterious heavy-tailed nature of the stationary distribution of these algorithms, even when the data distribution is not…

Machine Learning · Computer Science 2022-04-28 Sayar Karmakar , Anirbit Mukherjee

We consider two independent random variables with the given tail asymptotic (e.g. power or exponential). We find tail asymptotic for their sum and product. This is done by some cumbersome but purely technical computations and requires the…

Probability · Mathematics 2013-05-09 Andrey Sarantsev

We study the large-time asymptotic of renewal-reward processes with a heavy-tailed waiting time distribution. It is known that the heavy tail of the distribution produces an extremely slow dynamics, resulting in a singular large deviation…

Mathematical Physics · Physics 2022-01-05 Hiroshi Horii , Raphael Lefevere , Takahiro Nemoto

We consider a new approach in the definition of two-dimensional heavy-tailed distributions. Namely, we introduce the classes of two-dimensional long-tailed, of twodimensional dominatedly varying and of two-dimensional consistently varying…

Probability · Mathematics 2025-06-25 Dimitrios G. Konstantinides , Charalampos D. Passalidis

Given a finite collection of stochastic alternatives, we study the problem of sequentially allocating a fixed sampling budget to identify the optimal alternative with a high probability, where the optimal alternative is defined as the one…

Methodology · Statistics 2025-03-11 Dohyun Ahn , Taeho Kim

We investigate the use of optimization to compute bounds for extremal performance measures. This approach takes a non-parametric viewpoint that aims to alleviate the issue of model misspecification possibly encountered by conventional…

Methodology · Statistics 2017-11-03 Clementine Mottet , Henry Lam

We develop an asymptotic theory for extremes in decomposable graphical models by presenting results applicable to a range of extremal dependence types. Specifically, we investigate the weak limit of the distribution of suitably normalised…

Statistics Theory · Mathematics 2023-02-13 Adrian Casey , Ioannis Papastathopoulos

Concentration inequalities form an essential toolkit in the study of high dimensional (HD) statistical methods. Most of the relevant statistics literature in this regard is based on sub-Gaussian or sub-exponential tail assumptions. In this…

Statistics Theory · Mathematics 2023-01-09 Arun Kumar Kuchibhotla , Abhishek Chakrabortty

Continuous mixtures of distributions are widely employed in the statistical literature as models for phenomena with highly divergent outcomes; in particular, many familiar heavy-tailed distributions arise naturally as mixtures of…

Methodology · Statistics 2017-10-10 Carter T. Butts

Probabilistic programs provide an expressive representation language for generative models. Given a probabilistic program, we are interested in the task of posterior inference: estimating a latent variable given a set of observed variables.…

Machine Learning · Computer Science 2022-09-01 Mike Wu , Noah Goodman

Linear regression is ubiquitous in statistical analysis. It is well understood that conflicting sources of information may contaminate the inference when the classical normality of errors is assumed. The contamination caused by the light…

Methodology · Statistics 2019-06-13 Philippe Gagnon , Alain Desgagné , Mylène Bédard