English
Related papers

Related papers: Large deviations for heavy-tailed random elements …

200 papers

Despite the successes of probabilistic models based on passing noise through neural networks, recent work has identified that such methods often fail to capture tail behavior accurately, unless the tails of the base distribution are…

Machine Learning · Statistics 2023-06-16 Feynman Liang , Liam Hodgkinson , Michael W. Mahoney

The dominant approaches to text representation in natural language rely on learning embeddings on massive corpora which have convenient properties such as compositionality and distance preservation. In this paper, we develop a novel method…

Motivated by metastability in the zero-range process, we consider i.i.d.\ random variables with values in $\N_0$ and Weibull-like (stretched exponential) law $\mathbb P(X_i =k) = c \exp( - k^\alpha)$, $\alpha \in (0,1)$. We condition on…

Probability · Mathematics 2024-05-28 Sabine Jansen

Understanding the generalization properties of heavy-tailed stochastic optimization algorithms has attracted increasing attention over the past years. While illuminating interesting aspects of stochastic optimizers by using heavy-tailed…

Machine Learning · Statistics 2025-06-03 Benjamin Dupuis , Umut Şimşekli

We characterise the learning of a mixture of two clouds of data points with generic centroids via empirical risk minimisation in the high dimensional regime, under the assumptions of generic convex loss and convex regularisation. Each cloud…

Machine Learning · Statistics 2024-03-19 Urte Adomaityte , Gabriele Sicuro , Pierpaolo Vivo

We consider moderately trimmed sums of non-negative i.i.d. random variables. We show that for every distribution function there exists a proper moderate trimming such that for the trimmed sum a non-trivial strong law of large numbers holds.…

Probability · Mathematics 2019-05-23 Marc Kesseböhmer , Tanja Schindler

We obtain large deviations theorems for nonconventional sums with underlying process being a Markov process satisfying the Doeblin condition or a dynamical system such as subshift of finite type or hyperbolic or expanding transformation.

Probability · Mathematics 2013-02-21 Yuri Kifer , S. R. S. Varadhan

We establish sharp large deviation principles for cumulative rewards associated with a discrete-time renewal model, supposing that each renewal involves a broad-sense reward taking values in a real separable Banach space. The framework we…

Probability · Mathematics 2023-04-24 Marco Zamparo

We establish the weak large deviations principle for empirical measures of Markov chains on $\mathbb R^d$ under mild assumptions. In particular, no irreducibility is assumed and the initial measure may be arbitrary. The proof is entirely…

Probability · Mathematics 2026-04-24 Léo Daures

The Ensemble Kalman methodology in an inverse problems setting can be viewed as an iterative scheme, which is a weakly tamed discretization scheme for a certain stochastic differential equation (SDE). Assuming a suitable approximation…

Probability · Mathematics 2018-06-19 Dirk Blömker , Claudia Schillings , Philipp Wacker

Characterising intractable high-dimensional random variables is one of the fundamental challenges in stochastic computation. The recent surge of transport maps offers a mathematical foundation and new insights for tackling this challenge by…

Machine Learning · Statistics 2021-10-20 Tiangang Cui , Sergey Dolgov

We provide large deviations estimates for the upper tail of the number of triangles in scale-free inhomogeneous random graphs where the degrees have power law tails with index $-\alpha, \alpha \in (1,2)$. We show that upper tail…

Probability · Mathematics 2024-03-25 Clara Stegehuis , Bert Zwart

We prove Fuk-Nagaev and Rosenthal-type inequalities for sums of independent random matrices, focusing on the situation when the norms of the matrices possess finite moments of only low orders. Our bounds depend on the ``intrinsic''…

Probability · Mathematics 2025-11-20 Moritz Jirak , Stanislav Minsker , Yiqiu Shen , Martin Wahl

Deep learning algorithms face great challenges with long-tailed data distribution which, however, is quite a common case in real-world scenarios. Previous methods tackle the problem from either the aspect of input space (re-sampling classes…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Jiequan Cui , Shu Liu , Zhuotao Tian , Zhisheng Zhong , Jiaya Jia

We study cluster sizes in supercritical $d$-dimensional inhomogeneous percolation models with long-range edges -- such as long-range percolation -- and/or heavy-tailed degree distributions -- such as geometric inhomogeneous random graphs…

Probability · Mathematics 2025-11-12 Joost Jorritsma , Júlia Komjáthy , Dieter Mitsche

Within the realm of QCD sum rules, one of the most important areas of application of this nonperturbative approach is the prediction of the decay constants of heavy mesons. However, in spite of the fact that, indisputably, the adopted…

High Energy Physics - Phenomenology · Physics 2016-01-26 Wolfgang Lucha , Dmitri Melikhov , Silvano Simula

The objective of this paper is to present two types of results on Minkowski sums of convex polytopes. The first is about a special class of polytopes we call perfectly centered and the combinatorial properties of the Minkowski sum with…

Combinatorics · Mathematics 2009-02-14 Komei Fukuda , Christophe Weibel

We offer a survey of recent results on covariance estimation for heavy-tailed distributions. By unifying ideas scattered in the literature, we propose user-friendly methods that facilitate practical implementation. Specifically, we…

Methodology · Statistics 2019-03-12 Yuan Ke , Stanislav Minsker , Zhao Ren , Qiang Sun , Wen-Xin Zhou

We provide in a unified way quantitative forms of strong convergence results for numerous iterative procedures which satisfy a general type of Fejer monotonicity where the convergence uses the compactness of the underlying set. These…

Logic · Mathematics 2015-08-25 Ulrick Kohlenbach , Laurentiu Leustean , Adriana Nicolae

The distribution of the cosmic convergence field is modeled using a large-deviation principle where all non-Gaussian contributions are computed from first principles. The geometry of the past light cone is accounted for by constructing the…

Cosmology and Nongalactic Astrophysics · Physics 2020-01-22 Alexandre Barthelemy , Sandrine Codis , Cora Uhlemann , Francis Bernardeau , Raphael Gavazzi