English
Related papers

Related papers: Stochastic Recursive Inclusions with Non-Additive …

200 papers

Noisy dynamical models are employed to describe a wide range of phenomena. Since exact modeling of these phenomena requires access to their microscopic dynamics, whose time scales are typically much shorter than the observable time scales,…

Statistical Mechanics · Physics 2015-11-18 Giovanni Volpe , Jan Wehr

Dropout is a regularisation technique in neural network training where unit activations are randomly set to zero with a given probability \emph{independently}. In this work, we propose a generalisation of dropout and other multiplicative…

Machine Learning · Statistics 2019-09-24 Beyrem Khalfaoui , Joseph Boyd , Jean-Philippe Vert

We propose some backward-forward martingale decompositions for functions of reversible Markov chains. These decompositions are used to prove the functional CLT for reversible Markov chains with asymptotically linear variance of partial…

Probability · Mathematics 2018-01-16 Martial Longla

This paper is devoted to proving the small noise asymptotic behaviour, particularly large deviation principle, for multi-scale stochastic dynamical systems with fully local monotone coefficients driven by multiplicative noise. The main…

Probability · Mathematics 2024-03-11 Wei Hong , Wei Liu , Luhan Yang

We study the statistical inference of nonlinear stochastic approximation algorithms utilizing a single trajectory of Markovian data. Our methodology has practical applications in various scenarios, such as Stochastic Gradient Descent (SGD)…

Statistics Theory · Mathematics 2023-02-21 Xiang Li , Jiadong Liang , Zhihua Zhang

We analyse various properties of stochastic Markov processes with multiplicative white noise. We take a single-variable problem as a simple example, and we later extend the analysis to the Landau-Lifshitz-Gilbert equation for the stochastic…

This paper proposes a thorough theoretical analysis of Stochastic Gradient Descent (SGD) with non-increasing step sizes. First, we show that the recursion defining SGD can be provably approximated by solutions of a time inhomogeneous…

Optimization and Control · Mathematics 2021-02-02 Xavier Fontaine , Valentin De Bortoli , Alain Durmus

Many systems across the sciences evolve through a combination of multiplicative growth and diffusive transport. In the presence of disorder, these systems tend to form localized structures which alternate between long periods of relative…

Statistical Mechanics · Physics 2022-12-19 Matteo Smerlak

In this paper we present a rigorous asymptotic analysis for stochastic systems with two fast relaxation times. The mathematical model analyzed in this paper consists of a Langevin equation for the particle motion with time-dependent force…

Mathematical Physics · Physics 2007-05-23 G. A. Pavliotis , A. M. Stuart

We study asymptotic error distributions associated with standard approximation scheme for one-dimensional stochastic differential equations driven by fractional Brownian motions. This problem was studied by, for instance, Gradinaru-Nourdin…

Probability · Mathematics 2019-11-27 Shigeki Aida , Nobuaki Naganuma

We investigate the dynamical behavior of pull-back trajectories for nonautonomous stochastic feedback systems with multiplicative noise. We proved that there exists a random periodic solution of this system and all pull-back trajectories…

Dynamical Systems · Mathematics 2022-03-17 Zhao Dong , Weili Zhang , Zuohuan Zheng

This work proposes a general framework for capturing noise-driven transitions in spatially extended non-equilibrium systems and explains the emergence of coherent patterns beyond the instability onset. The framework relies on stochastic…

Dynamical Systems · Mathematics 2024-12-16 Mickaël D. Chekroun , Honghu Liu , James C. McWilliams

The asymptotic behavior of stochastic gradient algorithms is studied. Relying on results from differential geometry (Lojasiewicz gradient inequality), the single limit-point convergence of the algorithm iterates is demonstrated and…

Optimization and Control · Mathematics 2013-09-19 Vladislav B. Tadic

This work explores a synchronization-like phenomenon induced by common noise for continuous-time Markov jump processes given by chemical reaction networks. A corresponding random dynamical system is formulated in a two-step procedure, at…

Dynamical Systems · Mathematics 2022-07-05 Maximilian Engel , Guillermo Olicón-Méndez , Nathalie Unger , Stefanie Winkelmann

In this paper, we study the asymptotic of exit problem for controlled Markov diffusion processes with random jumps and vanishing diffusion terms, where the random jumps are introduced in order to modify the evolution of the controlled…

Dynamical Systems · Mathematics 2018-02-08 Getachew K. Befekadu

Stochastic resonance (SR) - a counter-intuitive phenomenon in which the signal due to a weak periodic force in a nonlinear system can be {\it enhanced} by the addition of external noise - is reviewed. A theoretical approach based on linear…

We consider a prospect theoretic version of the classical Q-learning algorithm for discounted reward Markov decision processes, wherein the controller perceives a distorted and noisy future reward, modeled by a nonlinearity that accentuates…

Systems and Control · Electrical Eng. & Systems 2021-09-02 Vivek S. Borkar , Siddharth Chandak

We present a theoretical analysis of some popular adaptive Stochastic Gradient Descent (SGD) methods in the small learning rate regime. Using the stochastic modified equations framework introduced by Li et al., we derive effective…

Machine Learning · Statistics 2025-09-29 Luca Callisti , Marco Romito , Francesco Triggiano

Stochastic resetting describes dynamics which are reinitialized to a reference state at random times. These protocols are attracting significant interest: they can stabilize nonequilibrium stationary states, generate correlations in…

Quantum Physics · Physics 2026-01-21 Federico Carollo , Sascha Wald

In this paper, a stochastic asymptotic stabilization method is proposed for deterministic input-affine control systems, which are randomized by including Gaussian white noises in control inputs. The sufficient condition is derived for the…

Optimization and Control · Mathematics 2016-04-07 Yuki Nishimura , Kanya Tanaka , Yuji Wakasa , Yuh Yamashita