English
Related papers

Related papers: Semimartingale Stochastic Approximation Procedures…

200 papers

In the modelling of stochastic phenomena, such as quasi-reaction systems, parameter estimation of kinetic rates can be challenging, particularly when the time gap between consecutive measurements is large. Local linear approximation…

Methodology · Statistics 2026-03-10 Matteo Framba , Veronica Vinciotti , Ernst C. Wit

This paper analyzes the convergence for a large class of Riemannian stochastic approximation (SA) schemes, which aim at tackling stochastic optimization problems. In particular, the recursions we study use either the exponential map of the…

Machine Learning · Statistics 2021-05-20 Alain Durmus , Pablo Jiménez , Éric Moulines , Salem Said , Hoi-To Wai

We consider estimation procedures which are recursive in the sense that each successive estimator is obtained from the previous one by a simple adjustment. We study rate of convergence of recursive estimation procedures for the general…

Statistics Theory · Mathematics 2007-05-23 Teo Sharia

In this paper, we consider asymptotic behaviors of multiscale multivalued stochastic systems with small noises. First of all, for general, fully coupled systems for multivalued stochastic differential equations of slow and fast motions with…

Probability · Mathematics 2025-09-30 Huijie Qiao

We develop a complete and rigorous mathematical framework for the analysis of stochastic neural field equations under the influence of spatially extended additive noise. By comparing a solution to a fixed deterministic front profile it is…

Probability · Mathematics 2019-02-11 Jennifer Krüger , Wilhelm Stannat

An estimation method is proposed for a wide variety of discrete time stochastic processes that have an intractable likelihood function but are otherwise conveniently specified by an integral transform such as the characteristic function,…

Statistics Theory · Mathematics 2009-09-29 T. Merkouris

We discuss a class of Backward Stochastic Differential Equations(BSDEs) with no driving martingale. When the randomness of the driver depends on a general Markov process $X$, those BSDEs are denominated Markovian BSDEs and can be associated…

Probability · Mathematics 2017-12-29 Adrien Barrasso , Francesco Russo

The standard theory of stochastic approximation (SA) is extended to the case when the constraint set is a Riemannian manifold. Specifically, the standard ODE method for analyzing SA schemes is extended to iterations constrained to stay on a…

Optimization and Control · Mathematics 2017-11-30 Suhail M. Shah

The majority of machine learning methods can be regarded as the minimization of an unavailable risk function. To optimize the latter, given samples provided in a streaming fashion, we define a general stochastic Newton algorithm and its…

Statistics Theory · Mathematics 2023-06-30 Claire Boyer , Antoine Godichon-Baggioni

We consider a family of parallel methods for constrained optimization based on projected gradient descents along individual coordinate directions. In the case of polyhedral feasible sets, local convergence towards a regular solution occurs…

Optimization and Control · Mathematics 2015-09-18 Olivier Bilenne

With the rapid advancements in technology for data collection, the application of the spatial autoregressive (SAR) model has become increasingly prevalent in real-world analysis, particularly when dealing with large datasets. However, the…

Econometrics · Economics 2025-05-05 Xuan Liang , Tao Zou

We introduce deterministic perturbation schemes for the recently proposed random directions stochastic approximation (RDSA) [17], and propose new first-order and second-order algorithms. In the latter case, these are the first second-order…

Optimization and Control · Mathematics 2019-03-29 Prashanth L A , Shalabh Bhatnagar , Nirav Bhavsar , Michael Fu , Steven I. Marcus

The Robbins-Monro algorithm is a recursive, simulation-based stochastic procedure to approximate the zeros of a function that can be written as an expectation. It is known that under some technical assumptions, a Gaussian convergence can be…

Probability · Mathematics 2025-10-17 Lorick Huang , V Konakov

This paper proposes a flexible Bayesian approach to multiple imputation using conditional Gaussian mixtures. We introduce novel shrinkage priors for covariate-dependent mixing proportions in the mixture models to automatically select the…

Methodology · Statistics 2022-08-17 Shonosuke Sugasawa , Jae Kwang Kim , Kosuke Morikawa

We investigate the almost sure asymptotic properties of vector martingale transforms. Assuming some appropriate regularity conditions both on the increasing process and on the moments of the martingale, we prove that normalized moments of…

Probability · Mathematics 2018-12-05 Bernard Bercu , Peggy Cénac , Guy Fayolle

In this paper, we establish non-asymptotic bounds for accuracy of normal approximation for linear two-timescale stochastic approximation (TTSA) algorithms driven by martingale difference or Markov noise. Focusing on both the last iterate…

Machine Learning · Statistics 2025-12-10 Bogdan Butyrin , Artemy Rubtsov , Alexey Naumov , Vladimir Ulyanov , Sergey Samsonov

In multivariate regression estimation, the rate of convergence depends on the dimension of the regressor. This fact, known as the curse of the dimensionality, motivated several works. The additive model, introduced by Stone (10), offers an…

Statistics Theory · Mathematics 2008-02-26 Mohammed Debbarh , Bertrand Maillot

We delve deeper into the study of semimartingale attractors that we recently introduced in Allouba and Langa \cite{AL0}. In this article we focus on second order SPDEs of the Allen-Cahn type. After proving existence, uniqueness, and…

Probability · Mathematics 2011-05-04 Hassan Allouba , Jose A. Langa

Constructing approximations that can accurately mimic the behavior of complex models at reduced computational costs is an important aspect of uncertainty quantification. Despite their flexibility and efficiency, classical surrogate models…

Computation · Statistics 2020-06-29 S. Marelli , P. -R. Wagner , C. Lataniotis , B. Sudret

A fully discrete approximation of the semi-linear stochastic wave equation driven by multiplicative noise is presented. A standard linear finite element approximation is used in space and a stochastic trigonometric method for the temporal…

Numerical Analysis · Mathematics 2015-11-26 Rikard Anton , David Cohen , Stig Larsson , Xiaojie Wang