English
Related papers

Related papers: Concentration bounds for two time scale stochastic…

200 papers

We consider a simple but important class of metastable discrete time Markov chains, which we call perturbed Markov chains. Basically, we assume that the transition matrices depend on a parameter $\varepsilon$, and converge as $\varepsilon$.…

Probability · Mathematics 2014-12-23 Volker Betz , Stéphane Le Roux

We consider the study of a numerical scheme for an initial- and Dirichlet boundary- value problem for a nonlinear Schr\"odinger equation. We approximate the solution using a, local (non-uniform) two level scheme in time (see C. Besse [6]…

Numerical Analysis · Mathematics 2017-11-02 Mohammad Asadzadeh , Christoffer Standar

This paper studies quantitative deviation bounds for statistical ensembles evolving under the one-parameter flow of a nearly integrable Hamiltonian system. Combining Nekhoroshev-type stability estimates with phase-mixing arguments, we…

Dynamical Systems · Mathematics 2026-02-23 Xinyu Liu , Yong Li

This paper provides a non-asymptotic analysis of linear stochastic approximation (LSA) algorithms with fixed stepsize. This family of methods arises in many machine learning tasks and is used to obtain approximate solutions of a linear…

Machine Learning · Statistics 2021-06-03 Alain Durmus , Eric Moulines , Alexey Naumov , Sergey Samsonov , Kevin Scaman , Hoi-To Wai

This paper gives a review of concentration inequalities which are widely employed in non-asymptotical analyses of mathematical statistics in a wide range of settings, from distribution-free to distribution-dependent, from sub-Gaussian to…

Statistics Theory · Mathematics 2025-02-24 Huiming Zhang , Song Xi Chen

The dynamics of the spin-boson Hamiltonian is considered in the stochastic approximation. The Hamiltonian describes a two-level system coupled to an environment and is widely used in physics, chemistry and the theory of quantum measurement.…

Quantum Physics · Physics 2016-09-08 L. Accardi , S. V. Kozyrev , I. V. Volovich

Stochastic approximation (SA) is an iterative algorithm for finding the fixed point of an operator using noisy samples and widely used in optimization and Reinforcement Learning (RL). The noise in RL exhibits a Markovian structure, and in…

Machine Learning · Computer Science 2025-05-13 Shaan Ul Haque , Sajad Khodadadian , Siva Theja Maguluri

Numerical methods for stochastic partial differential equations typically estimate moments of the solution from sampled paths. Instead, we shall directly target the deterministic equations satisfied by the first and second moments, as well…

Numerical Analysis · Mathematics 2020-11-17 Kristin Kirchner

We consider the problem of adaptive stabilization for discrete-time, multi-dimensional linear systems with bounded control input constraints and unbounded stochastic disturbances, where the parameters of the true system are unknown. To…

Systems and Control · Electrical Eng. & Systems 2023-04-04 Seth Siriya , Jingge Zhu , Dragan Nešić , Ye Pu

In this article we establish exponential moment bounds, moment bounds in fractional order smoothness spaces, a uniform H\"older continuity in time, and strong convergence rates for a class of fully discrete exponential Euler-type numerical…

Probability · Mathematics 2021-11-02 Arnulf Jentzen , Felix Lindner , Primož Pušnik

This paper is concerned with developing and analyzing two novel implicit temporal discretization methods for the stochastic semilinear wave equations with multiplicative noise. The proposed methods are natural extensions of well-known…

Numerical Analysis · Mathematics 2024-08-26 Xiaobing Feng , Yukun Li , Liet Vo

A determinantal approximation is obtained for the permanent of a doubly stochastic matrix. For moderate-deviation matrix sequences, the asymptotic relative error is of order $O(n^{-1})$.

Combinatorics · Mathematics 2012-05-28 Peter McCullagh

We study the finite-time convergence of projected linear two-time-scale stochastic approximation with constant step sizes and Polyak--Ruppert averaging. We establish an explicit mean-square error bound, decomposing it into two interpretable…

Systems and Control · Electrical Eng. & Systems 2026-04-02 Yitao Bai , Thinh T. Doan , Justin Romberg

The main goal of this work is to provide sample-path estimates for the solution of slowly time-dependent SPDEs perturbed by a cylindrical fractional Brownian motion. Our strategy is similar to the approach by Berglund and Nader for…

Probability · Mathematics 2025-02-25 Nils Berglund , Alexandra Blessing

Perturbation theory can be reformulated as dynamical theory. Then a sequence of perturbative approximations is bijective to a trajectory of dynamical system with discrete time, called the approximation cascade. Here we concentrate our…

Statistical Mechanics · Physics 2015-06-25 V. I. Yukalov , E. P. Yukalova

This work provides a novel convergence analysis for stochastic optimization in terms of stopping times, addressing the practical reality that algorithms are often terminated adaptively based on observed progress. Unlike prior approaches,…

Optimization and Control · Mathematics 2025-07-17 Yasong Feng , Yifan Jiang , Tianyu Wang , Zhiliang Ying

Stochastic approximation is a framework unifying many random iterative algorithms occurring in a diverse range of applications. The stability of the process is often difficult to verify in practical applications and the process may even be…

Probability · Mathematics 2014-03-10 Christophe Andrieu , Matti Vihola

We provide non-asymptotic bounds for the well-known temporal difference learning algorithm TD(0) with linear function approximators. These include high-probability bounds as well as bounds in expectation. Our analysis suggests that a…

Machine Learning · Computer Science 2015-09-02 Nathaniel Korda , L. A. Prashanth

This paper establishes a stochastic maximum principle for optimal control problems governed by time-changed forward-backward stochastic differential equations with L\'evy noise. The system incorporates a random, non-decreasing operational…

Optimization and Control · Mathematics 2026-03-27 Jingwei Chen , Jun Ye , Feng Chen

This paper considers a novel multi-agent linear stochastic approximation algorithm driven by Markovian noise and general consensus-type interaction, in which each agent evolves according to its local stochastic approximation process which…

Machine Learning · Computer Science 2023-10-02 Yixuan Lin , Vijay Gupta , Ji Liu