English
Related papers

Related papers: Revisiting the Constant Stepsize Stochastic Approx…

200 papers

We prove quantitative convergence rates at which discrete Langevin-like processes converge to the invariant distribution of a related stochastic differential equation. We study the setup where the additive noise can be non-Gaussian and…

Machine Learning · Computer Science 2020-11-20 Xiang Cheng , Dong Yin , Peter L. Bartlett , Michael I. Jordan

This paper investigates the well-posedness and small-noise asymptotics of a class of stochastic partial differential equations defined on a bounded domain of $\mathbb{R}^d$, where the diffusion coefficient depends nonlinearly and…

Probability · Mathematics 2025-06-23 Sandra Cerrai , Giuseppina Guatteri , Gianmario Tessitore

In this paper we study the sensitivity of nonlinear stochastic differential equations of McKean-Vlasov type generated by stable-like processes. By using the method of stochastic characteristics, we transfer these equations to the…

Optimization and Control · Mathematics 2022-04-21 Vassili Kolokoltsov , Marianna Troeva

Stochastic gradient descent is the method of choice for large scale optimization of machine learning objective functions. Yet, its performance is greatly variable and heavily depends on the choice of the stepsizes. This has motivated a…

Machine Learning · Statistics 2019-02-28 Xiaoyu Li , Francesco Orabona

We analyze a stochastic 5-neighbor cellular automaton with several conserved quantities, including the particle density. By examining the eigenvalue problem of the associated transition matrix, we derive an explicit formula for the…

Mathematical Physics · Physics 2026-05-28 Kazushige Endo , Shinsuke Iwao , Hidetomo Nagai , Yushi Nakano

Motivated by collaborative reinforcement learning (RL) and optimization with time-correlated data, we study a generic federated stochastic approximation problem involving $M$ agents, where each agent is characterized by an agent-specific…

Machine Learning · Computer Science 2025-04-17 Feng Zhu , Aritra Mitra , Robert W. Heath

The paper deals with non-linear Poisson neuron network models with bounded memory dynamics, that can include both Hebbian learning mechanisms and refractory periods. The state of a network is described by the times elapsed since its neurons…

Probability · Mathematics 2012-06-21 Konstantin Borovkov , Geoffrey Decrouez , Matthieu Gilson

This paper proposes a thorough theoretical analysis of Stochastic Gradient Descent (SGD) with non-increasing step sizes. First, we show that the recursion defining SGD can be provably approximated by solutions of a time inhomogeneous…

Optimization and Control · Mathematics 2021-02-02 Xavier Fontaine , Valentin De Bortoli , Alain Durmus

We study some regularity properties in locally stationary Markov models which are fundamental for controlling the bias of nonparametric kernel estimators. In particular, we provide an alternative to the standard notion of derivative process…

Statistics Theory · Mathematics 2018-12-07 Lionel Truquet

We consider one-dimensional stochastic differential equations with a boundary condition, driven by a Poisson process. We study existence and uniqueness of solutions and the absolute continuity of the law of the solution. In the case when…

Probability · Mathematics 2007-05-23 Aureli Alabert , Miguel A. Marmolejo

This paper provide a comprehensive analysis of the finite and long time behavior of continuous-time non-Markovian dynamical systems, with a focus on the forward Stochastic Volterra Integral Equations(SVIEs).We investigate the properties of…

Probability · Mathematics 2025-11-06 Emmanuel Gnabeyeu , Gilles Pagès

Stochastic gradient descent (SGD) is a popular algorithm for minimizing objective functions that arise in machine learning. For constant step-sized SGD, the iterates form a Markov chain on a general state space. Focusing on a class of…

Optimization and Control · Mathematics 2025-03-26 David Shirokoff , Philip Zaleski

This paper focuses on stochastic partial differential equations (SPDEs) under two-time-scale formulation. Distinct from the work in the existing literature, the systems are driven by $\alpha$-stable processes with $\alpha \in(1,2)$. In…

Statistics Theory · Mathematics 2016-09-30 Jianhai Bao , George Yin , Chenggui Yuan

Semilinear stochastic evolution equations with multiplicative Poisson noise and monotone nonlinear drift are considered. We do not impose coercivity conditions on coefficients. A novel method of proof for establishing existence and…

Probability · Mathematics 2014-06-17 Erfan Salavati , Bijan Z. Zangeneh

We consider Markov Decision Problems defined over continuous state and action spaces, where an autonomous agent seeks to learn a map from its states to actions so as to maximize its long-term discounted accumulation of rewards. We address…

Machine Learning · Computer Science 2018-04-23 Alec Koppel , Ekaterina Tolstaya , Ethan Stump , Alejandro Ribeiro

The results of the author and Gess [27] develop a robust well-posedness theory for a broad class of conservative stochastic PDEs, with both probabilistically stationary and non-stationary Stratonovich noise, and with irregular noise…

Probability · Mathematics 2025-04-28 Benjamin Fehrman

We study a fairly general class of time-homogeneous stochastic evolutions driven by noises that are not white in time. As a consequence, the resulting processes do not have the Markov property. In this setting, we obtain constructive…

Probability · Mathematics 2009-02-12 M. Hairer

Stochastic Gradient Descent (SGD) often slows in the late stage of training due to anisotropic curvature and gradient noise. We analyze preconditioned SGD in the geometry induced by a symmetric positive definite matrix $\mathbf{M}$,…

Numerical Analysis · Mathematics 2025-11-26 Mitchell Scott , Tianshi Xu , Ziyuan Tang , Alexandra Pichette-Emmons , Qiang Ye , Yousef Saad , Yuanzhe Xi

Confined active particles constitute simple, yet realistic, examples of systems that converge into a non-equilibrium steady state. We investigate a run-and-tumble particle in one spatial dimension, trapped by an external potential, with a…

Statistical Mechanics · Physics 2024-04-09 Oded Farago , Naftali R. Smith

We consider a stable driven degenerate stochastic differential equation, whose coefficients satisfy a kind of weak H{\"o}rmander condition. Under mild smoothness assumptions we prove the uniqueness of the martingale problem for the…

Probability · Mathematics 2015-03-06 Lorick Huang , Stephane Menozzi