English
Related papers

Related papers: Efficient rare-event simulation for the maximum of…

200 papers

In this paper we develop a novel inferential approach based on geometric records for estimating the tail index of heavy-tailed distributions. We construct a maximum likelihood estimator for the Pareto model and establish its strong…

Statistics Theory · Mathematics 2026-04-30 Martín Alcalde , Raúl Gouet , Miguel Lafuente , F. Javier López , Gerardo Sanz

It has repeatedly been observed that loss minimization by stochastic gradient descent (SGD) leads to heavy-tailed distributions of neural network parameters. Here, we analyze a continuous diffusion approximation of SGD, called homogenized…

Machine Learning · Statistics 2024-02-05 Zhe Jiao , Martin Keller-Ressel

A particular direction of recent advance about stochastic deep-learning algorithms has been about uncovering a rather mysterious heavy-tailed nature of the stationary distribution of these algorithms, even when the data distribution is not…

Machine Learning · Computer Science 2022-04-28 Sayar Karmakar , Anirbit Mukherjee

One of the main goal of extreme value analysis is to estimate the probability of rare events given a sample from an unknown distribution. The upper tail behavior of this distribution is described by the extreme value index. We present a new…

Probability · Mathematics 2007-05-23 Laurent Gardes , Stephane Girard

This paper proposes niching importance sampling, a framework that combines concepts from reliability analysis, e.g. Markov chains, importance sampling, and relative cross entropy minimisation, with niching techniques from evolutionary…

Computation · Statistics 2026-04-09 Hugh J. Kinnear , F. A. DiazDelaO

Despite the successes of probabilistic models based on passing noise through neural networks, recent work has identified that such methods often fail to capture tail behavior accurately, unless the tails of the base distribution are…

Machine Learning · Statistics 2023-06-16 Feynman Liang , Liam Hodgkinson , Michael W. Mahoney

The presence of erratic or unstable paths in standard kinetic Monte Carlo simulations significantly undermines the accurate simulation and sampling of transition pathways. While typically reliable methods, such as the Gillespie algorithm,…

Statistical Mechanics · Physics 2024-12-03 Elad Korngut , Ohad Vilk , Michael Assaf

We consider the problem of choosing design parameters to minimize the probability of an undesired rare event that is described through the average of $n$ iid random variables. Since the probability of interest for near optimal design…

Optimization and Control · Mathematics 2019-02-22 Amarjit Budhiraja , Shu Lu , Yang Yu , Quoc Tran-Dinh

In the field of computational physics and material science, the efficient sampling of rare events occurring at atomic scale is crucial. It aids in understanding mechanisms behind a wide range of important phenomena, including protein…

Machine Learning · Computer Science 2024-01-17 Xinru Hua , Rasool Ahmad , Jose Blanchet , Wei Cai

In this paper, we propose self-tuned robust estimators for estimating the mean of heavy-tailed distributions, which refer to distributions with only finite variances. Our approach introduces a new loss function that considers both the mean…

Methodology · Statistics 2024-01-25 Qiang Sun

Let $X_{1,n}\le\cdots\le X_{n,n}$ be the order statistics of $n$ independent random variables with a common distribution function $F$ having right heavy tail with tail index $\gamma$. Given known constants $d_{i,n}$, $1\le i\le n$, consider…

Probability · Mathematics 2021-04-13 Lillian Achola Oluoch , László Viharos

We consider a one-dimensional random walk $S_n$ with i.i.d. increments with zero mean and finite variance. We study the asymptotic expansion for the tail distribution $\mathbf P(\tau_x>n)$ of the first passage times…

Probability · Mathematics 2024-01-19 Denis Denisov , Alexander Tarasov , Vitali Wachtel

Empirical likelihood is a well-known nonparametric method in statistics and has been widely applied in statistical inference. The method has been employed by Lu and Peng (2002) to constructing confidence intervals for the tail index of a…

Methodology · Statistics 2019-04-19 Yizeng Li , Yongcheng Qi

Bias reduction in tail estimation has received considerable interest in extreme value analysis. Estimation methods that minimize the bias while keeping the mean squared error (MSE) under control, are especially useful when applying…

Statistics Theory · Mathematics 2016-06-21 Gaonyalelwe Maribe , Andréhette Verster , Jan Beirlant

The busy period for a queue is cast as the area swept under the random walk until it first returns to zero, $B$. Encompassing non-i.i.d. increments, the large-deviations asymptotics of $B$ is addressed, under the assumption that the…

Probability · Mathematics 2015-09-16 Ken R. Duffy , Sean P. Meyn

We make use of the empirical process theory to approximate the adapted Hill estimator, for censored data, in terms of Gaussian processes. Then, we derive its asymptotic normality, only under the usual second-order condition of regular…

Statistics Theory · Mathematics 2015-07-07 Brahim Brahimi , Djamel Meraghni , Abdelhakim Necir

The non-asymptotic tail bounds of random variables play crucial roles in probability, statistics, and machine learning. Despite much success in developing upper bounds on tail probability in literature, the lower bounds on tail…

Probability · Mathematics 2020-09-08 Anru R. Zhang , Yuchen Zhou

This paper focuses on rare events associated with the tail probabilities of the extremal eigenvalues in the $\beta$-Jacobi ensemble, which plays a critical role in both multivariate statistical analysis and statistical physics. Under the…

Probability · Mathematics 2024-09-26 Yutao Ma , Siyu Wang

In extreme value inference it is a fundamental problem how the target value is required to be extreme by the extreme value theory. In iid settings this study both theoretically and numerically compares tail estimators, which are based on…

Statistics Theory · Mathematics 2024-09-04 Taku Moriyama

We study the long-time behavior of decoupled continuous-time random walks characterized by superheavy-tailed distributions of waiting times and symmetric heavy-tailed distributions of jump lengths. Our main quantity of interest is the…

Statistical Mechanics · Physics 2011-12-30 S. I. Denisov , S. B. Yuste , Yu. S. Bystrik , H. Kantz , K. Lindenberg