English
Related papers

Related papers: Finite-Time Analysis of Projected Two-Time-Scale S…

200 papers

We consider Linear Stochastic Approximation (LSA) with a constant stepsize and Markovian data. Viewing the joint process of the data and LSA iterate as a time-homogeneous Markov chain, we prove its convergence to a unique limiting and…

Machine Learning · Statistics 2026-01-21 Dongyan Huo , Yudong Chen , Qiaomin Xie

Driven by a wide range of applications, many principal subspace estimation problems have been studied individually under different structural constraints. This paper presents a unified framework for the statistical analysis of a general…

Statistics Theory · Mathematics 2020-11-17 T. Tony Cai , Hongzhe Li , Rong Ma

Nested-error regression models are widely used for analyzing clustered data. For example, they are often applied to two-stage sample surveys, and in biology and econometrics. Prediction is usually the main goal of such analyses, and…

Statistics Theory · Mathematics 2007-06-13 Peter Hall , Tapabrata Maiti

This paper generalizes results concerning strong convexity of two-stage mean-risk models with linear recourse to distortion risk measures. Introducing the concept of (restricted) partial strong convexity, we conduct an in-depth analysis of…

Optimization and Control · Mathematics 2018-12-20 Matthias Claus , Kai Spürkel

We establish general conditions under which there exists uniform in time convergence between a stochastic process and its approximated system. These standardised conditions consist of a local in time estimate between the original and the…

Probability · Mathematics 2024-12-09 Katharina Schuh , Iain Souttar

Motivated by engineering applications such as resource allocation in networks and inventory systems, we consider average-reward Reinforcement Learning with unbounded state space and reward function. Recent works studied this problem in the…

Machine Learning · Computer Science 2025-11-10 Shaan Ul Haque , Siva Theja Maguluri

The stochastic Euler scheme is known to converge to the exact solution of a stochastic differential equation with globally Lipschitz continuous drift and diffusion coefficient. Recent results extend this convergence to coefficients which…

Numerical Analysis · Mathematics 2021-11-02 Martin Hutzenthaler , Arnulf Jentzen , Peter E. Kloeden

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

Optimization and Control · Mathematics 2020-05-05 Andrei Patrascu

Stochastic approximation is a powerful class of algorithms with celebrated success. However, a large body of previous analysis focuses on stochastic approximations driven by contractive operators, which is not applicable in some important…

Machine Learning · Computer Science 2025-11-21 Ethan Blaser , Shangtong Zhang

Two time scale stochastic approximation algorithms emulate singularly perturbed deterministic differential equations in a certain limiting sense, i.e., the interpolated iterates on each time scale approach certain differential equations in…

Probability · Mathematics 2023-06-12 Fathima Zarin Faizal , Vivek Borkar

We consider two approaches to balanced truncation of stochastic linear systems, which follow from different generalizations of the reachability Gramian of deterministic systems. Both preserve mean-square asymptotic stability, but only the…

Dynamical Systems · Mathematics 2017-03-14 Peter Benner , Tobias Damm , Yolanda Rocio Rodriguez Cruz

A finite dimensional abstract approximation and convergence theory is developed for estimation of the distribution of random parameters in infinite dimensional discrete time linear systems with dynamics described by regularly dissipative…

Optimization and Control · Mathematics 2019-03-15 Melike Sirlanci , Susan E. Luczak , I. Gary Rosen

In this contribution, we provide convergence rates for a finite volume scheme of a stochastic non-linear parabolic equation with multiplicative Lipschitz noise and homogeneous Neumann boundary conditions. More precisely, we give an error…

Numerical Analysis · Mathematics 2025-12-22 Kavin Rajasekaran , Niklas Sapountzoglou

In this paper, we establish the almost sure convergence of two-timescale stochastic gradient descent algorithms in continuous time under general noise and stability conditions, extending well known results in discrete time. We analyse…

Optimization and Control · Mathematics 2021-10-01 Louis Sharrock , Nikolas Kantas

We develop polynomial-time algorithms for near-optimal minimax mean estimation under $\ell_2$-squared loss in a Gaussian sequence model under convex constraints. The parameter space is an origin-symmetric, type-2 convex body $K \subset…

Statistics Theory · Mathematics 2026-02-27 Matey Neykov

We study the finite-time convergence of TD learning with linear function approximation under Markovian sampling. Existing proofs for this setting either assume a projection step in the algorithm to simplify the analysis, or require a fairly…

Machine Learning · Computer Science 2024-06-27 Aritra Mitra

Error estimates are proved for finite element approximations to the solution of second-order hyperbolic partial differential equations with coefficients varying in both space and time. Optimal rates of convergence in the energy norm are…

Numerical Analysis · Mathematics 2026-03-17 Oussama Al Jarroudi , Marcus J. Grote

Strong approximation errors of both finite element semi-discretization and spatio-temporal full discretization are analyzed for the stochastic Allen-Cahn equation driven by additive noise in space dimension $d \leq 3$. The full…

Numerical Analysis · Mathematics 2020-08-04 Ruisheng Qi , Xiaojie Wang

In this work, we investigate the regularized solutions and their finite element solutions to the inverse source problems governed by partial differential equations, and establish the stochastic convergence and optimal finite element…

Numerical Analysis · Mathematics 2021-10-25 Zhiming Chen , Wenlong Zhang , Jun Zou

Statistical inverse learning aims at recovering an unknown function $f$ from randomly scattered and possibly noisy point evaluations of another function $g$, connected to $f$ via an ill-posed mathematical model. In this paper we blend…

Statistics Theory · Mathematics 2024-01-22 Tapio Helin
‹ Prev 1 3 4 5 6 7 10 Next ›