English
Related papers

Related papers: Tail Structure and the Ordering of the Standard De…

200 papers

Stochastic Gradient Descent (SGD) based methods have been widely used for training large-scale machine learning models that also generalize well in practice. Several explanations have been offered for this generalization performance, a…

Machine Learning · Computer Science 2021-02-11 Yikai Zhang , Wenjia Zhang , Sammy Bald , Vamsi Pingali , Chao Chen , Mayank Goswami

We study stochastic dominance between portfolios of independent and identically distributed (iid) extremely heavy-tailed (i.e., infinite-mean) Pareto random variables. With the notion of majorization order, we show that a more diversified…

Portfolio Management · Quantitative Finance 2025-02-11 Yuyu Chen , Taizhong Hu , Ruodu Wang , Zhenfeng Zou

We study large deviation upper bounds and mean-squared error (MSE) guarantees of a general framework of nonlinear stochastic gradient methods in the online setting, in the presence of heavy-tailed noise. Unlike existing works that rely on…

Machine Learning · Computer Science 2025-03-25 Aleksandar Armacki , Shuhua Yu , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

We present a generic and powerful approach to study the statistics of extreme phenomena (meteorology, finance, biology...) that we apply to the statistical estimation of the tail of the distribution of earthquake sizes. The chief innovation…

Geophysics · Physics 2008-05-13 V. F. Pisarenko , A. Sornette , D. Sornette , M. V. Rodkin

Tail dependence models for distributions attracted to a max-stable law are fitted using observations above a high threshold. To cope with spatial, high-dimensional data, a rank-based M-estimator is proposed relying on bivariate margins…

Methodology · Statistics 2015-01-12 John Einmahl , Anna Kiriliouk , Andrea Krajina , Johan Segers

For the comparison of inequality and welfare in multiple attributes the use of generalized Gini indices is proposed. Individual endowment vectors are summarized by using attribute weights and aggregated in a spectral social evaluation…

Applications · Statistics 2022-11-10 Karl Mosler

Score-based model research in the last few years has produced state of the art generative models by employing Gaussian denoising score-matching (DSM). However, the Gaussian noise assumption has several high-dimensional limitations,…

Machine Learning · Computer Science 2022-04-13 Jacob Deasy , Nikola Simidjievski , Pietro Liò

It is well-known that value added per worker is extremely heterogeneous among firms, but relatively little has been done to characterize this heterogeneity more precisely. Here we show that the distribution of value-added per worker…

In traditional extreme value analysis, the bulk of the data is ignored, and only the tails of the distribution are used for inference. Extreme observations are specified as values that exceed a threshold or as maximum values over distinct…

Applications · Statistics 2021-10-20 Mitchell Krock , Julie Bessac , Michael L. Stein , Adam H. Monahan

We investigate front propagation in systems with diffusive and sub-diffusive behavior. The scaling behavior of moments of the diffusive problem, both in the standard and in the anomalous cases, is not enough to determine the features of the…

Statistical Mechanics · Physics 2016-09-06 Maurizio Serva , Davide Vergni , Angelo Vulpiani

We propose a variational tail bound for norms of random vectors under moment assumptions on their one-dimensional marginals. A simplified version of the bound that parametrizes the ``aggregating distribution'' using a certain pushforward of…

Probability · Mathematics 2026-02-02 Sohail Bahmani

Neural network compression techniques have become increasingly popular as they can drastically reduce the storage and computation requirements for very large networks. Recent empirical studies have illustrated that even simple pruning…

Machine Learning · Statistics 2021-06-08 Melih Barsbey , Milad Sefidgaran , Murat A. Erdogdu , Gaël Richard , Umut Şimşekli

Eigenvalues of Wigner matrices has been a major topic of investigation. A particularly important subclass of such random matrices is formed by the adjacency matrix of an Erd\H{o}s-R\'{e}nyi graph $\mathcal{G}_{n,p}$ equipped with i.i.d.…

Probability · Mathematics 2022-06-15 Shirshendu Ganguly , Ella Hiesmayr , Kyeongsik Nam

Periodontal pocket depth is a widely used biomarker for diagnosing risk of periodontal disease. However, pocket depth typically exhibits skewness and heavy-tailedness, and its relationship with clinical risk factors is often nonlinear.…

Methodology · Statistics 2025-05-06 Qingyang Liu , Shijie Wang , Ray Bai , Dipankar Bandyopadhyay

Multivariate regular variation plays a role assessing tail risk in diverse applications such as finance, telecommunications, insurance and environmental science. The classical theory, being based on an asymptotic model, sometimes leads to…

Probability · Mathematics 2011-08-31 Bikramjit Das , Abhimanyu Mitra , Sidney Resnick

We study high-probability convergence guarantees of learning on streaming data in the presence of heavy-tailed noise. In the proposed scenario, the model is updated in an online fashion, as new information is observed, without storing any…

Machine Learning · Computer Science 2024-05-02 Aleksandar Armacki , Pranay Sharma , Gauri Joshi , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

We extend the class of tempered stable distributions first introduced in Rosinski 2007. Our new class allows for more structure and more variety of tail behaviors. We discuss various subclasses and the relation between them. To characterize…

Probability · Mathematics 2013-06-11 Michael Grabchak

Using the framework of factor models, we establish the general expression of the coefficient of tail dependence between the market and a stock (i.e., the probability that the stock incurs a large loss, assuming that the market has also…

Statistical Mechanics · Physics 2008-12-10 Y. Malevergne , D. Sornette

Condensation phenomena are ubiquitous in nature and are found in condensed matter, disordered systems, networks, finance, etc. In the present work we investigate one of the best frameworks in which condensation phenomena take place, namely,…

Statistical Mechanics · Physics 2015-02-03 Mario Filiasi , Elia Zarinelli , Erik Vesselli , Matteo Marsili

Recent studies have shown that gradient descent (GD) can achieve improved generalization when its dynamics exhibits a chaotic behavior. However, to obtain the desired effect, the step-size should be chosen sufficiently large, a task which…

Machine Learning · Statistics 2022-10-25 Soon Hoe Lim , Yijun Wan , Umut Şimşekli