Related papers: Stochastic control for Backward Stochastic Differe…
The semimartingale stochastic approximation procedure, namely, the Robbins-Monro type SDE is introduced which naturally includes both generalized stochastic approximation algorithms with martingale noises and recursive parameter estimation…
Backward stochastic differential equations extend the martingale representation theorem to the nonlinear setting. This can be seen as path-dependent counterpart of the extension from the heat equation to fully nonlinear parabolic equations…
In this note, we propose two different approaches to rigorously justify a pseudo-Markov property for controlled diffusion processes which is often (explicitly or implicitly) used to prove the dynamic programming principle in the stochastic…
We study in this article the stochastic Zakharov-Kuznetsov equation driven by a multiplicative noise. We establish, in space dimensions two and three the global existence of martingale solutions, and in space dimension two the global…
In the present paper, we consider multidimensional nonlinear backward stochastic differential equations (BSDEs) with a driver depending on the martingale part $M$ of a solution. We assume that the nonlinear term is merely monotone…
The aim of this notes is to give a concise introduction to control theory for systems governed by stochastic partial differential equations. We shall mainly focus on controllability and optimal control problems for these systems. For the…
The literature on Bayesian methods for the analysis of discrete-time semi-Markov processes is sparse. In this paper, we introduce the semi-Markov beta-Stacy process, a stochastic process useful for the Bayesian non-parametric analysis of…
In this paper, we first investigate the well-posedness of a backward stochastic differential equation where the driver depends on the law of the solution conditioned to a common noise. Under standard assumptions, we show that existence and…
This paper presents a central limit theorem for a pre-averaged version of the realized covariance estimator for the quadratic covariation of a discretely observed semimartingale with noise. The semimartingale possibly has jumps, while the…
The purpose of these notes is to distribute, mostly without proofs, fundamental definitions and results concerning the theory of semimartingales and stochastic integration. The material serves as a foundational guide for those interested in…
In this paper, we investigate the controlled system described by forward-backward stochastic differential equations with the control contained in drift, diffusion and generator of BSDE. A new verification theorem is derived within the…
The stochastic properties of a Langevin-type Markov process can be extracted from a given time series by a Markov analysis. Also processes that obey a stochastically forced second order differential equation can be analyzed this way by…
We consider the influence of stochastic perturbations on stability of a unique positive equilibrium of a difference equation subject to prediction-based control. These perturbations may be multiplicative $$x_{n+1}=f(x_n)-\left( \alpha +…
This paper studies the exponential stability of random matrix products driven by a general (possibly unbounded) state space Markov chain. It is a cornerstone in the analysis of stochastic algorithms in machine learning (e.g. for parameter…
Using a martingale concentration inequality, concentration bounds `from time $n_0$ on' are derived for stochastic approximation algorithms with contractive maps and both martingale difference and Markov noises. These are applied to…
This paper presents a Newton-based stochastic extremum-seeking control method for real-time optimization in multi-input systems with distinct input delays. It combines predictor-based feedback and Hessian inverse estimation via stochastic…
In this paper we are interested in a new type of {\it mean-field}, non-Markovian stochastic control problems with partial observations. More precisely, we assume that the coefficients of the controlled dynamics depend not only on the paths…
This work explores the use of a forward-backward martingale method together with a decoupling argument and entropic estimates between the conditional and averaged measures to prove a strong averaging principle for stochastic differential…
We introduce a novel class of semilinear nonlocal backward stochastic partial differential equations (BSPDE) on half-spaces driven by an infinite-dimensional c\`adl\`ag martingale. The equations exhibit a degeneracy and have no explicit…
This paper is a continuation of the paper \cite{JL}, which focuses on exploring the global stability of nonlinear stochastic feedback systems on the nonnegative orthant driven by multiplicative white noise and presenting a couple of…