English
Related papers

Related papers: Singularity analysis for heavy-tailed random varia…

200 papers

In this work, we study the convergence \emph{in high probability} of clipped gradient methods when the noise distribution has heavy tails, ie., with bounded $p$th moments, for some $1<p\le2$. Prior works in this setting follow the same…

Optimization and Control · Mathematics 2023-04-05 Ta Duy Nguyen , Alina Ene , Huy L. Nguyen

We present a new Monte Carlo methodology for the accurate estimation of the distribution of the sum of dependent log-normal random variables. The methodology delivers statistically unbiased estimators for three distributional quantities of…

Computation · Statistics 2017-06-20 Zdravko Botev , Robert Salomone , Daniel MacKinlay

We consider a class of stationary processes exhibiting both long-range dependence and heavy tails. Separate limit theorems for sums and for extremes have been established recently in literature with novel objects appearing in the limits. In…

Probability · Mathematics 2023-09-12 Shuyang Bai , He Tang

We provide finite sample upper and lower bounds on the Binomial tail probability which are a direct application of Sanov's theorem. We then use these to obtain high probability upper and lower bounds on the minimum of i.i.d. Binomial random…

Probability · Mathematics 2025-02-27 Xiaohan Zhu , Mesrob I. Ohannessian , Nathan Srebro

Many management decisions involve accumulated random realizations for which only the first and second moments of their distribution are available. The sharp Chebyshev-type bound for the tail probability and Scarf bound for the expected loss…

Econometrics · Economics 2025-05-15 Zhaolin Li , Artem Prokhorov

We describe a general reduction technique for analyzing learning algorithms that are subject to light-tailed (but not necessarily bounded) randomness, a scenario that is often the focus of theoretical analysis. We show that the analysis of…

Machine Learning · Computer Science 2025-05-21 Amit Attia , Tomer Koren

To draw inference on serial extremal dependence within heavy-tailed Markov chains, Drees, Segers and Warcho{\l} [Extremes (2015) 18, 369--402] proposed nonparametric estimators of the spectral tail process. The methodology can be extended…

Methodology · Statistics 2018-01-30 R. A. Davis , H. Drees , J. Segers , M. Warchoł

The exact expression for the probability density $p_{_N}(x)$ for sums of a finite number $N$ of random independent terms is obtained. It is shown that the very tail of $p_{_N}(x)$ has a Gaussian form if and only if all the random terms are…

Probability · Mathematics 2013-05-29 Michael I. Tribelsky

The authors announce a general tail estimate, called a decoupling inequality, for a symmetrized sum of non-linear $k$-correlations of $n>k$ independent random variables.

Functional Analysis · Mathematics 2016-09-06 Victor H. de la Peña , Stephen J. Montgomery-Smith

When applying multivariate extreme value statistics to analyze tail risk in compound events defined by a multivariate random vector, one often assumes that all dimensions share the same extreme value index. While such an assumption can be…

Methodology · Statistics 2026-02-16 Liujun Chen , Chen Zhou

We study stochastic dominance between portfolios of independent and identically distributed (iid) extremely heavy-tailed (i.e., infinite-mean) Pareto random variables. With the notion of majorization order, we show that a more diversified…

Portfolio Management · Quantitative Finance 2025-02-11 Yuyu Chen , Taizhong Hu , Ruodu Wang , Zhenfeng Zou

In univariate data, there exist standard procedures for identifying dominating features that produce the largest observations. However, in the multivariate setting, the situation is quite different. This paper aims to provide tools and…

Statistics Theory · Mathematics 2023-08-29 Miriam Hägele , Jaakko Lehtomaa

We study high-probability convergence guarantees of learning on streaming data in the presence of heavy-tailed noise. In the proposed scenario, the model is updated in an online fashion, as new information is observed, without storing any…

Machine Learning · Computer Science 2024-05-02 Aleksandar Armacki , Pranay Sharma , Gauri Joshi , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

The paper presents an algorithm for topological classification of nondegenerate saddle-focus singularities of integrable Hamiltonian systems with three degrees of freedom up to semi-local equivalence. In particular, we prove that any…

Differential Geometry · Mathematics 2023-01-26 I. K. Kozlov , A. A. Oshemkov

For a risk vector $V$, whose components are shared among agents by some random mechanism, we obtain asymptotic lower and upper bounds for the individual agents' exposure risk and the aggregated risk in the market. Risk is measured by…

Risk Management · Quantitative Finance 2016-04-12 Oliver Kley , Claudia Kluppelberg

In this paper, we propose a new accelerated stochastic first-order method called clipped-SSTM for smooth convex stochastic optimization with heavy-tailed distributed noise in stochastic gradients and derive the first high-probability…

Optimization and Control · Mathematics 2020-10-26 Eduard Gorbunov , Marina Danilova , Alexander Gasnikov

Let $N > 1$ be a fixed integer and $(C_1,..., C_N,Q)$ a random element of $GL(d, \R)^N x \R^d$. We consider solutions of multivariate smoothing transforms, i.e. random variables $R$ satisfying $$R \eqdist \sum_{i=1}^N C_i R_i +Q $$ where…

Probability · Mathematics 2013-04-04 Dariusz Buraczewski , Ewa Damek , Sebastian Mentemeier , Mariusz Mirek

In this paper, a general stochastic optimization procedure is studied, unifying several variants of the stochastic gradient descent such as, among others, the stochastic heavy ball method, the Stochastic Nesterov Accelerated Gradient…

Optimization and Control · Mathematics 2021-07-13 A. Barakat , P. Bianchi , W. Hachem , Sh. Schechtman

The risk of catastrophes is related to the possibility of occurring extreme values. Several statistical methodologies have been developed in order to evaluate the propensity of a process for the occurrence of high values and the permanence…

Statistics Theory · Mathematics 2019-05-08 Helena Ferreira , Marta Ferreira

The task of estimation of the tails of probability distributions having small samples seems to be still opened and almost unsolvable. The paper tries to make a step in filling this gap. In 2017 Jordanova et al. introduce six new…

Statistics Theory · Mathematics 2018-11-14 Pavlina Jordanova , Monika Peteva