English
Related papers

Related papers: Finite-Time Analysis of Projected Two-Time-Scale S…

200 papers

When using a finite difference method to solve an initial--boundary--value problem, the truncation error is often of lower order at a few grid points near boundaries than in the interior. Normal mode analysis is a powerful tool to analyze…

Numerical Analysis · Mathematics 2018-08-23 Siyang Wang , Anna Nissen , Gunilla Kreiss

This paper is devoted to the analysis of a finite horizon discrete-time stochastic optimal control problem, in presence of constraints. We study the regularity of the value function which comes from the dynamic programming algorithm. We…

Optimization and Control · Mathematics 2007-05-23 M. Papi , S. Sbaraglia

Exponential generalization bounds with near-tight rates have recently been established for uniformly stable learning algorithms. The notion of uniform stability, however, is stringent in the sense that it is invariant to the data-generating…

Machine Learning · Statistics 2022-06-09 Xiao-Tong Yuan , Ping Li

We propose and study Sparse Polyak, a variant of Polyak's adaptive step size, designed to solve high-dimensional statistical estimation problems where the problem dimension is allowed to grow much faster than the sample size. In such…

Optimization and Control · Mathematics 2025-10-16 Tianqi Qiao , Marie Maros

In this paper, we investigate the mean-square convergence of a novel symplectic local discontinuous Galerkin method in L^2-norm for stochastic linear Schroedinger equation with multiplicative noise. It is shown that the mean-square error is…

Numerical Analysis · Mathematics 2015-03-25 Chuchu Chen , Jialin Hong , Lihai Ji

We present for the first time an asymptotic convergence analysis of two time-scale stochastic approximation driven by "controlled" Markov noise. In particular, the faster and slower recursions have non-additive controlled Markov noise…

Machine Learning · Computer Science 2020-12-03 Prasenjit Karmakar

Two-stage stochastic optimization is a framework for modeling uncertainty, where we have a probability distribution over possible realizations of the data, called scenarios, and decisions are taken in two stages: we make first-stage…

Data Structures and Algorithms · Computer Science 2023-10-25 Andre Linhares , Chaitanya Swamy

We establish rigorous \emph{a posteriori} error bounds for a space-time finite element method of arbitrary order discretising linear wave problems in second order formulation. The method combines standard finite elements in space and…

Numerical Analysis · Mathematics 2026-04-24 Zhaonan Dong , Emmanuil H. Georgoulis , Lorenzo Mascotto , Zuodong Wang

Temporal-difference (TD) learning is widely regarded as one of the most popular algorithms in reinforcement learning (RL). Despite its widespread use, it has only been recently that researchers have begun to actively study its finite time…

Machine Learning · Computer Science 2025-04-16 Han-Dong Lim , Donghwan Lee

We present a finite-time analysis of two smoothed functional stochastic approximation algorithms for simulation-based optimization. The first is a two time-scale gradient-based method, while the second is a three time-scale Newton-based…

Machine Learning · Computer Science 2026-04-01 Kaustubh Kartikey , Shalabh Bhatnagar

We investigate the properties of the simultaneous projection method as applied to countably infinitely many closed and linear subspaces of a real Hilbert space. We establish the optimal error bound for linear convergence of this method,…

Optimization and Control · Mathematics 2021-08-31 Simeon Reich , Rafał Zalas

We present for the first time an asymptotic convergence analysis of two time-scale stochastic approximation driven by `controlled' Markov noise. In particular, both the faster and slower recursions have non-additive controlled Markov noise…

Dynamical Systems · Mathematics 2017-02-28 Prasenjit Karmakar , Shalabh Bhatnagar

Viewing a two time scale stochastic approximation scheme as a noisy discretization of a singularly perturbed differential equation, we obtain a concentration bound for its iterates that captures its behavior with quantifiable high…

Optimization and Control · Mathematics 2018-06-29 Vivek S. Borkar , Sarath Pattathil

We study the almost sure convergence of the Stochastic Approximation algorithm to the fixed point $x^\star$ of a nonlinear operator under a negative drift condition and a general noise sequence with finite $p$-th moment for some $p > 1$.…

Optimization and Control · Mathematics 2026-02-23 Quang Dinh Thien Nguyen , Duc Anh Nguyen , Hoang Huy Nguyen , Siva Theja Maguluri

We study a stochastically perturbed version of the well-known Krasnoselski--Mann iteration for computing fixed points of nonexpansive maps in finite dimensional normed spaces. We discuss sufficient conditions on the stochastic noise and…

Optimization and Control · Mathematics 2023-04-04 Mario Bravo , Roberto Cominetti

We unify and extend the semigroup and the PDE approaches to stochastic maximal regularity of time-dependent semilinear parabolic problems with noise given by a cylindrical Brownian motion. We treat random coefficients that are only…

Analysis of PDEs · Mathematics 2019-02-12 Pierre Portal , Mark Veraar

This paper presents a strong convergence rate analysis of general discretization approximations for McKean-Vlasov SDEs with super-linear growth coefficients over infinite time horizon. Under some specified non-globally Lipschitz conditions,…

Numerical Analysis · Mathematics 2025-09-12 Taiyuan Liu , Yaozhong Hu , Siqing Gan

We derive computable error estimates for finite element approximations of linear elliptic partial differential equations (PDE) with rough stochastic coefficients. In this setting, the exact solutions contain high frequency content that…

Numerical Analysis · Mathematics 2018-09-18 Eric Joseph Hall , Håkon Hoel , Mattias Sandberg , Anders Szepessy , Raúl Tempone

We consider multistage stochastic linear optimization problems combining joint dynamic probabilistic constraints with hard constraints. We develop a method for projecting decision rules onto hard constraints of wait-and-see type. We…

Optimization and Control · Mathematics 2016-09-16 Vincent Guigues , Rene Henrion

We investigate the finite-time convergence properties of Temporal Difference (TD) learning with linear function approximation, a cornerstone algorithm in the field of reinforcement learning. We are interested in the so-called ``robust''…

Machine Learning · Computer Science 2025-09-26 Wei-Cheng Lee , Francesco Orabona