中文
相关论文

相关论文: Semimartingale Stochastic Approximation Procedures…

200 篇论文

In this paper, we investigate a general class of stochastic gradient descent (SGD) algorithms, called Conditioned SGD, based on a preconditioning of the gradient direction. Using a discrete-time approach with martingale tools, we establish…

统计理论 · 数学 2023-10-17 Rémi Leluc , François Portier

We consider estimation procedures which are recursive in the sense that each successive estimator is obtained from the previous one by a simple adjustment. The model considered in the paper is very general as we do not impose any…

统计理论 · 数学 2007-05-23 Teo Sharia

Numerical approximation of the long time behavior of a stochastic differential equation (SDE) is considered. Error estimates for time-averaging estimators are obtained and then used to show that the stationary behavior of the numerical…

概率论 · 数学 2013-11-26 Jonathan C. Mattingly , Andrew M. Stuart , M. V. Tretyakov

We propose and analyze an algorithm for the sequential estimation of a conditional quantile in the context of real stochastic codes with vectorvalued inputs. Our algorithm is based on k-nearest neighbors smoothing within a Robbins-Monro…

The Robbins-Monro algorithm is a recursive, simulation-based stochastic procedure to approximate the zeros of a function that can be written as an expectation. It is known that under some technical assumptions, Gaussian limit distributions…

概率论 · 数学 2025-10-22 Valentin Konakov , Enno Mammen , Lorick Huang

In this article we propose a new, explicit and easily implementable numerical method for approximating a class of semilinear stochastic evolution equations with non-globally Lipschitz continuous nonlinearities. We establish strong…

概率论 · 数学 2021-11-02 Arnulf Jentzen , Primož Pušnik

We consider the robust adaptive nonparametric estimation problem for a periodic function observed in the framework of a continuous time regression model with semimartingale noises.

统计理论 · 数学 2020-05-26 Evgeny A. Pchelintsev , Serguei M. Pergamenshchikov , Maria A. Povzun

This paper considers the problem of estimating a periodic function in a continuous time regression model with a general square integrable semimartingale noise. A model selection adaptive procedure is proposed. Sharp non-asymptotic oracle…

统计理论 · 数学 2009-09-18 Victor Konev , Serguei Pergamenchtchikov

We propose an iterative estimating equations procedure for analysis of longitudinal data. We show that, under very mild conditions, the probability that the procedure converges at an exponential rate tends to one as the sample size…

统计理论 · 数学 2007-12-18 Jiming Jiang , Yihui Luan , You-Gan Wang

We give a new global presentation of our results on the asymptotic behavior of an iteration. This paper brings many improvements and corrections to our previous preprints on the subject. Among the applications, we use new methods to compute…

动力系统 · 数学 2012-06-29 Guy Cirier

Isotonic regression or monotone function estimation is a problem of estimating function values under monotonicity constraints, which appears naturally in many scientific fields. This paper proposes a new Bayesian method with global-local…

统计方法学 · 统计学 2024-02-07 Ryo Okano , Yasuyuki Hamura , Kaoru Irie , Shonosuke Sugasawa

The asymptotic pseudo-trajectory approach to stochastic approximation of Benaim, Hofbauer and Sorin is extended for asynchronous stochastic approximations with a set-valued mean field. The asynchronicity of the process is incorporated into…

机器学习 · 统计学 2011-12-13 Steven Perkins , David S. Leslie

In this paper we prove the asymptotic efficiency of the model selection procedure proposed by the authors in the first part. To this end we introduce the robust risk as the least upper bound of the quadratical risk over a broad class of…

统计理论 · 数学 2009-09-18 Victor Konev , Serguei Pergamenchtchikov

We present a novel solution method for It\^o stochastic differential equations (SDEs). We subdivide the time interval into sub-intervals, then we use the quadratic polynomials for the approximation between two successive intervals. The main…

数值分析 · 数学 2024-08-01 Faezeh Nassajian Mojarrad

We develop a stochastic calculus that makes it easy to capture a variety of predictable transformations of semimartingales such as changes of variables, stochastic integrals, and their compositions. The framework offers a unified treatment…

概率论 · 数学 2022-01-13 Aleš Černý , Johannes Ruf

This paper addresses second-order stochastic optimization for estimating the minimizer of a convex function written as an expectation. A direct recursive estimation technique for the inverse Hessian matrix using a Robbins-Monro procedure is…

最优化与控制 · 数学 2025-03-11 Antoine Godichon-Baggioni , Wei Lu , Bruno Portier

The aim of this paper is to introduce a new formalism for the deterministic analysis associated with backward stochastic differential equations driven by general c{\`a}dl{\`a}g martingales. When the martingale is a standard Brownian motion,…

概率论 · 数学 2016-03-25 Ismail Laachir , Francesco Russo

This article proposes and analyzes explicit and easily implementable temporal numerical approximation schemes for additive noise-driven stochastic partial differential equations (SPDEs) with polynomial nonlinearities such as, e.g.,…

概率论 · 数学 2021-11-02 Sebastian Becker , Arnulf Jentzen

Monotone inclusions have a wide range of applications, including minimization, saddle-point, and equilibria problems. We introduce new stochastic algorithms, with or without variance reduction, to estimate a root of the expectation of…

最优化与控制 · 数学 2024-05-24 Abdurakhmon Sadiev , Laurent Condat , Peter Richtárik

Stochastic approximation is a powerful class of algorithms with celebrated success. However, a large body of previous analysis focuses on stochastic approximations driven by contractive operators, which is not applicable in some important…

机器学习 · 计算机科学 2025-11-21 Ethan Blaser , Shangtong Zhang