English
Related papers

Related papers: Tail Analysis without Parametric Models: A Worst-c…

200 papers

The rate of uniform convergence in extreme value statistics is non-universal and can be arbitrarily slow. Further, the relative error can be unbounded in the tail of the approximation, leading to difficulty in extrapolating the extreme…

Statistics Theory · Mathematics 2014-12-05 Ashivni Shekhawat

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

Statistics Theory · Mathematics 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

This paper studies the distributed optimization problem under the influence of heavy-tailed gradient noises. Here, a heavy-tailed noise means that the noise does not necessarily satisfy the bounded variance assumption. Instead, it satisfies…

Optimization and Control · Mathematics 2025-05-12 Chao Sun , Huiming Zhang , Bo Chen , Li Yu

We study the tail behavior of regret in stochastic multi-armed bandits for algorithms that are asymptotically optimal in expectation. While minimizing expected regret is the classical objective, recent work shows that even such algorithms…

Information Theory · Computer Science 2026-04-17 Subhodip Panda , Shubhada Agrawal

Real-world data is laden with outlying values. The challenge for machine learning is that the learner typically has no prior knowledge of whether the feedback it receives (losses, gradients, etc.) will be heavy-tailed or not. In this work,…

Machine Learning · Statistics 2020-12-16 Matthew J. Holland

The ideas of model averaging are used to find weights in peak-over-threshold problems using a possible range of thresholds. A range of the largest observations are chosen and considered as possible thresholds, each time performing…

Other Statistics · Statistics 2014-10-30 J. Martin van Zyl

The key to successful statistical analysis of bivariate extreme events lies in flexible modelling of the tail dependence relationship between the two variables. In the extreme value theory literature, various techniques are available to…

Methodology · Statistics 2025-05-05 Emma S. Simpson , Jonathan A. Tawn

Procedures in assessing the impact of serial dependency on performance analysis are usually built on parametrically specified models. In this paper, we propose a robust, nonparametric approach to carry out this assessment, by computing the…

Methodology · Statistics 2016-06-22 Henry Lam

We consider multivariate extreme value statistics for independent but nonidentically distributed random vectors. In particular, the data may have varying tail copulas and also heteroscedastic marginal distributions. Assuming smoothly…

Statistics Theory · Mathematics 2026-04-14 John H. J. Einmahl , Chen Zhou

It has repeatedly been observed that loss minimization by stochastic gradient descent (SGD) leads to heavy-tailed distributions of neural network parameters. Here, we analyze a continuous diffusion approximation of SGD, called homogenized…

Machine Learning · Statistics 2024-02-05 Zhe Jiao , Martin Keller-Ressel

We analyze the tail behavior of solutions to sample average approximations (SAAs) of stochastic programs posed in Hilbert spaces. We require that the integrand be strongly convex with the same convexity parameter for each realization.…

Optimization and Control · Mathematics 2023-08-03 Johannes Milz

We significantly improve the generalization bounds for VC classes by using two main ideas. First, we consider the hypergeometric tail inversion to obtain a very tight non-uniform distribution-independent risk upper bound for VC classes.…

Machine Learning · Computer Science 2021-11-02 Jean-Samuel Leboeuf , Frédéric LeBlanc , Mario Marchand

Likelihood-based procedures are a common way to estimate tail dependence parameters. They are not applicable, however, in non-differentiable models such as those arising from recent max-linear structural equation models. Moreover, they can…

Methodology · Statistics 2016-01-20 John H. J. Einmahl , Anna Kiriliouk , Johan Segers

We propose an analytical approach to the computation of tail probabilities of compound distributions whose individual components have heavy tails. Our approach is based on the contour integration method, and gives rise to a representation…

Computational Finance · Quantitative Finance 2017-10-04 Igor Halperin

This paper introduces a novel measure to quantify the directional dependence of extreme events between two variables. The proposed approach is designed to capture asymmetric tail dependence by studying conditional tail expectations of…

Methodology · Statistics 2026-04-06 Matthieu Garcin , Maxime L. D. Nicolas

The study of tail behaviour of SGD-induced processes has been attracting a lot of interest, due to offering strong guarantees with respect to individual runs of an algorithm. While many works provide high-probability guarantees, quantifying…

Machine Learning · Computer Science 2026-02-06 Aleksandar Armacki , Dragana Bajović , Dušan Jakovetić , Soummya Kar , Ali H. Sayed

We study multi-robot persistent monitoring on weighted graphs, where node weights encode monitoring priorities and edge weights encode travel distances. The goal is to design joint robot trajectories that minimize the worst-case weighted…

Robotics · Computer Science 2026-05-12 Weizhen Wang , Ziheng Wang , Jianping He , Xinping Guan , Xiaoming Duan

Over the last few decades power law distributions have been suggested as forming generative mechanisms in a variety of disparate fields, such as, astrophysics, criminology and database curation. However, fitting these heavy tailed…

Computation · Statistics 2014-08-26 Colin S. Gillespie

This paper addresses the problem of estimating the tail index of distributions with heavy, Pareto-type tails for dependent data, that is of interest in the areas of finance, insurance, environmental monitoring and teletraffic analysis. A…

Methodology · Statistics 2010-05-25 Stilian A Stoev , George Michailidis

We develop an efficient simulation algorithm for computing the tail probabilities of the infinite series $S = \sum_{n \geq 1} a_n X_n$ when random variables $X_n$ are heavy-tailed. As $S$ is the sum of infinitely many random variables, any…

Probability · Mathematics 2016-09-08 Henrik Hult , Sandeep Juneja , Karthyek Murthy