English
Related papers

Related papers: Essential barrier height and a probabilistic appro…

200 papers

The problem of estimating the coefficient of bivariate tail dependence is considered here from the robustness point of view; it combines two apparently contradictory theories of robust statistics and extreme value statistics. The usual…

Applications · Statistics 2014-07-08 Abhik Ghosh

In existing distributed stochastic optimization studies, it is usually assumed that the gradient noise has a bounded variance. However, recent research shows that the heavy-tailed noise, which allows an unbounded variance, is closer to…

Optimization and Control · Mathematics 2025-05-15 Jun Hu , Chao Sun , Bo Chen , Jianzheng Wang , Zheming Wang

We characterize the complex, heavy-tailed probability distribution functions (pdf) describing the response and its local extrema for structural systems subjected to random forcing that includes extreme events. Our approach is based on the…

Chaotic Dynamics · Physics 2017-06-02 Han Kyul Joo , Mustafa A. Mohamad , Themistoklis P. Sapsis

We consider a one-dimensional random walk among biased i.i.d. conductances, in the case where the random walk is transient but sub-ballistic: this occurs when the conductances have a heavy-tail at $+\infty$ or at $0$. We prove that the…

Probability · Mathematics 2019-04-16 Quentin Berger , Michele Salvi

We study large deviation upper bounds and mean-squared error (MSE) guarantees of a general framework of nonlinear stochastic gradient methods in the online setting, in the presence of heavy-tailed noise. Unlike existing works that rely on…

Machine Learning · Computer Science 2025-03-25 Aleksandar Armacki , Shuhua Yu , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

Dispersion of a passive scalar from concentrated sources in fully developed turbulent channel flow is studied with the probability density function (PDF) method. The joint PDF of velocity, turbulent frequency and scalar concentration is…

Fluid Dynamics · Physics 2010-03-24 J. Bakosi , P. Franzese , Z. Boybeyi

Recently, several studies consider the stochastic optimization problem but in a heavy-tailed noise regime, i.e., the difference between the stochastic gradient and the true gradient is assumed to have a finite $p$-th moment (say being upper…

Optimization and Control · Mathematics 2023-05-23 Zijian Liu , Zhengyuan Zhou

Extreme events over large spatial domains may exhibit highly heterogeneous tail dependence characteristics, yet most existing spatial extremes models yield only one dependence class over the entire spatial domain. To accurately characterize…

Methodology · Statistics 2025-11-14 Muyang Shi , Likun Zhang , Mark D. Risser , Benjamin A. Shaby

Potential functionals have been introduced recently as an important tool for the analysis of coupled scalar systems (e.g. density evolution equations). In this contribution, we investigate interesting properties of this potential. Using the…

Information Theory · Computer Science 2017-01-16 Rafah El-Khatib , Nicolas Macris , Tom Richardson , Rüdiger Urbanke

Motivated by the prominence of Conditional Value-at-Risk (CVaR) as a measure for tail risk in settings affected by uncertainty, we develop a new formula for approximating CVaR based optimization objectives and their gradients from limited…

Methodology · Statistics 2020-08-25 Anand Deo , Karthyek Murthy

A host of spatially extended systems, both in physics and in other disciplines, are well described at a coarse-grained scale by a Langevin equation with multiplicative-noise. Such systems may exhibit non-equilibrium phase transitions, which…

Condensed Matter · Physics 2015-06-24 Miguel A. Munoz , F. de los Santos , A. Achahbar

In this paper, we present a new framework to obtain tail inequalities for sums of random matrices. Compared with existing works, our tail inequalities have the following characteristics: 1) high feasibility--they can be used to study the…

Machine Learning · Computer Science 2019-10-10 Chao Zhang , Min-Hsiu Hsieh , Dacheng Tao

The task for a general and useful classification of the tail behaviors of probability distributions still has no satisfactory solution. Due to lack of information outside the range of the data the tails of the distribution should be…

Probability · Mathematics 2019-07-23 Pavlina Jordanova

For stationary interface growth, governed by the Kardar-Parisi-Zhang (KPZ) equation in 1 + 1 dimensions, typical fluctuations of the interface height at long times are described by the Baik-Rains distribution. Recently Chhita et al. [1]…

Statistical Mechanics · Physics 2017-11-22 Baruch Meerson , Johannes Schmidt

Impact assessment of natural hazards requires the consideration of both extreme and non-extreme events. Extensive research has been conducted on the joint modeling of bulk and tail in univariate settings; however, the corresponding body of…

Methodology · Statistics 2026-03-31 Chenglei Hu , Ben Swallow , Daniela Castro-Camilo

High-probability analysis of stochastic first-order optimization methods under mild assumptions on the noise has been gaining a lot of attention in recent years. Typically, gradient clipping is one of the key algorithmic ingredients to…

In this work we investigate a class of random walks that interacts with its environment called Tree Builder Random Walk (TBRW). In our settings, at each step, the walker adds a random number of vertices to its position sampled according to…

Probability · Mathematics 2026-03-31 Caio Alves , Rodrigo Ribeiro

We present a method for upper and lower bounding the right and the left tail probabilities of continuous random variables (RVs). For the right tail probability of RV $X$ with probability density function $f (x)$, this method requires first…

Probability · Mathematics 2026-01-07 Nikola Zlatanov

Neural networks provide a rich class of high-dimensional, non-convex optimization problems. Despite their non-convexity, gradient-descent methods often successfully optimize these models. This has motivated a recent spur in research…

Optimization and Control · Mathematics 2020-06-18 Luca Venturi , Afonso S. Bandeira , Joan Bruna

The purpose of this paper is to introduce a new Markov chain Monte Carlo method and exhibit its efficiency by simulation and high-dimensional asymptotic theory. Key fact is that our algorithm has a reversible proposal transition kernel,…

Methodology · Statistics 2014-12-22 Kengo Kamatani