English
Related papers

Related papers: Large Deviations and Metastability Analysis for He…

200 papers

We address the reachability problem for continuous-time stochastic dynamic systems. Our objective is to present a unified framework that characterizes the reachable set of a dynamic system in the presence of both stochastic disturbances and…

Systems and Control · Electrical Eng. & Systems 2024-09-04 Saber Jafarpour , Zishun Liu , Yongxin Chen

In univariate data, there exist standard procedures for identifying dominating features that produce the largest observations. However, in the multivariate setting, the situation is quite different. This paper aims to provide tools and…

Statistics Theory · Mathematics 2023-08-29 Miriam Hägele , Jaakko Lehtomaa

We discuss the Donsker-Varadhan theory of large deviations in the framework of Hamiltonian systems thermostated by a Gaussian stochastic coupling. We derive a general formula for the Donsker-Varadhan large deviation functional for dynamics…

Mathematical Physics · Physics 2009-11-13 T. Bodineau , R. Lefevere

We consider Stochastic Volatility processes with heavy tails and possible long memory in volatility. We study the limiting conditional distribution of future events given that some present or past event was extreme (i.e. above a level which…

Statistics Theory · Mathematics 2011-08-17 Rafał Kulik , Philippe Soulier

The purpose of this paper is to ensure the conditions of G\"artner-Ellis Theorem for evaluations of the empirical measure. We show that up-to-date conditions for ensuring the convergence to a quasi-stationary distribution can be applied…

Probability · Mathematics 2020-04-21 Aurélien Velleret

We prove a large deviation principle for the slow-fast rough differential equations under the controlled rough path framework. The driver rough paths are lifted from the mixed fractional Brownian motion with Hurst parameter $H\in…

Probability · Mathematics 2025-02-05 Xiaoyu Yang , Yong Xu

Principal Component Analysis (PCA) is a cornerstone of dimensionality reduction, yet its classical formulation relies critically on second-order moments and is therefore fragile in the presence of heavy-tailed data and impulsive noise.…

Machine Learning · Computer Science 2026-05-05 Mario Sayde , Christopher Khater , Jihad Fahs , Ibrahim Abou-Faycal

Stochastic first-order methods such as Stochastic Extragradient (SEG) or Stochastic Gradient Descent-Ascent (SGDA) for solving smooth minimax problems and, more generally, variational inequality problems (VIP) have been gaining a lot of…

Optimization and Control · Mathematics 2022-11-02 Eduard Gorbunov , Marina Danilova , David Dobre , Pavel Dvurechensky , Alexander Gasnikov , Gauthier Gidel

Deep learning networks are typically trained by Stochastic Gradient Descent (SGD) methods that iteratively improve the model parameters by estimating a gradient on a very small fraction of the training data. A major roadblock faced when…

Machine Learning · Computer Science 2020-06-11 Tao Lin , Lingjing Kong , Sebastian U. Stich , Martin Jaggi

Recently, several studies consider the stochastic optimization problem but in a heavy-tailed noise regime, i.e., the difference between the stochastic gradient and the true gradient is assumed to have a finite $p$-th moment (say being upper…

Optimization and Control · Mathematics 2023-05-23 Zijian Liu , Zhengyuan Zhou

This paper studies the distributed optimization problem under the influence of heavy-tailed gradient noises. Here, a heavy-tailed noise means that the noise does not necessarily satisfy the bounded variance assumption. Instead, it satisfies…

Optimization and Control · Mathematics 2025-05-12 Chao Sun , Huiming Zhang , Bo Chen , Li Yu

A variety of methods have been proposed for inference about extreme dependence for multivariate or spatially-indexed stochastic processes and time series. Most of these proceed by first transforming data to some specific extreme value…

Statistics Theory · Mathematics 2018-05-22 James E. Johndrow , Robert L. Wolpert

Small random perturbations may have a dramatic impact on the long time evolution of dynamical systems, and large deviation theory is often the right theoretical framework to understand these effects. At the core of the theory lies the…

Numerical Analysis · Mathematics 2017-10-11 Tobias Grafke , Tobias Schaefer , Eric Vanden-Eijnden

In this paper, we consider the tail probabilities of extremals of $\beta$-Jacobi ensemble which plays an important role in multivariate analysis. The key steps in constructing estimators rely on the rate functions of large deviations.…

Statistics Theory · Mathematics 2024-09-26 Yutao Ma , Siyu Wang

Long-tailed distributions in class-imbalanced data present a fundamental challenge for deep learning models, which tend to be biased toward majority classes. While recent methods for long-tailed recognition have mitigated this issue, they…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Heegeon Yoon , Heeyoung Kim

Stochastic volatility processes with heavy-tailed innovations are a well-known model for financial time series. In these models, the extremes of the log returns are mainly driven by the extremes of the i.i.d. innovation sequence which leads…

Probability · Mathematics 2016-03-25 Anja Janssen , Holger Drees

Generic dynamical systems have `typical' Lyapunov exponents, measuring the sensitivity to small perturbations of almost all trajectories. A generic system has also trajectories with exceptional values of the exponents, corresponding to…

Statistical Mechanics · Physics 2013-06-06 Tanguy Laffargue , Khanh-Dang Nguyen Thu Lam , Jorge Kurchan , Julien Tailleur

In the era of large-scale neural network models, optimization algorithms often struggle with generalization due to an overreliance on training loss. One key insight widely accepted in the machine learning community is the idea that wide…

Machine Learning · Computer Science 2025-09-01 Bodu Gong , Gustavo Enrique Batista , Pierre Lafaye de Micheaux

We consider a general class of finite dimensional deterministic dynamical systems with finitely many local attractors $K^i$ each of which supports a unique ergodic probability measure $P^i$, which includes in particular the class of…

Probability · Mathematics 2014-05-22 Michael Högele , Ilya Pavlyukevich

This work is concerned with the large deviation principle for a family of slow-fast systems perturbed by infinite-dimensional mixed fractional Brownian motion with Hurst parameter $H\in(\frac12,1)$. We adopt the weak convergence method…

Probability · Mathematics 2025-09-16 Wenting Xu , Yong Xu , Xiaoyu Yang , Bin Pei