Related papers: Polynomial deviation bounds for recurrent Harris p…
We study a stochastically perturbed version of the well-known Krasnoselski--Mann iteration for computing fixed points of nonexpansive maps in finite dimensional normed spaces. We discuss sufficient conditions on the stochastic noise and…
Numerical simulation of stochastic differential equations over long time intervals poses significant computational challenges. In this paper, we propose a novel recursive polynomial chaos evolution method that achieves model reduction…
Passive discrete-time systems with Hilbert spaces as an incoming and outgoing space and a Pontryagin space as a state space are investigated. A geometric characterization when the index of the transfer function coincides with the negative…
We study the problem of exponential mixing and large deviations for discrete-time Markov processes associated with a class of random dynamical systems. Under some dissipativity and regularisation hypotheses for the underlying deterministic…
A degenerate dynamical system is characterized by a state-dependent multiplier of the time derivative of the state in the time evolution equation. It can give rise to Hamiltonian systems whose symplectic structure possesses a non-constant…
We present the first uniform-in-time high-probability bound for SGD under the PL condition, where the gradient noise contains both Markovian and martingale difference components. This significantly broadens the scope of finite-time…
Irreversibility is commonly quantified by entropy production. An external observer can estimate it through measuring an observable that is antisymmetric under time-reversal like a current. We introduce a general framework that, inter alia,…
We consider a controlled quantum system whose finite dimensional state is governed by a discrete-time nonlinear Markov process. In open-loop, the measurements are assumed to be quantum non-demolition (QND). The eigenstates of the measured…
The existence of global-in-time bounded martingale solutions to a general class of cross-diffusion systems with multiplicative Stratonovich noise is proved. The equations describe multicomponent systems from physics or biology with…
We introduce a mesh-type approach for tackling discrete-time, finite-horizon Markov Decision Processes (MDPs) characterized by state and action spaces that are general, encompassing both finite and infinite (yet suitably regular) subsets of…
The effect of refractory periods in partial resetting processes is studied. Under Poissonian partial resets, a state variable jumps to a value closer to the origin by a fixed fraction at constant rate, $x\to a x$. Following each reset, a…
In this paper, we derive high-dimensional asymptotic properties of the Moore-Penrose inverse and, as a byproduct, of various ridge-type inverses of the sample covariance matrix. In particular, the analytical expressions of the asymptotic…
We provide sufficient conditions for the existence of invariant probability measures for generic stochastic differential equations with finite time delay. This is achieved by means of the Krylov-Bogoliubov method. Furthermore, we focus on…
We study a class of semi-linear differential Volterra equations with polynomial-type potentials that incorporates the effects of memory while being subjected to random perturbations via an additive Gaussian noise. We show that for a broad…
Given a compact parameter set $Y\subset R^p$, we consider polynomial optimization problems $(P_y$) on $R^n$ whose description depends on the parameter $y\inY$. We assume that one can compute all moments of some probability measure $\phi$ on…
We study the existence of densities for distributions of piecewise deterministic Markov processes. We also obtain relationships between invariant densities of the continuous time process and that of the process observed at jump times. In…
This paper deals with unconstrained discounted continuous-time Markov decision processes in Borel state and action spaces. Under some conditions imposed on the primitives, allowing unbounded transition rates and unbounded (from both above…
This paper studies the fundamental limits of reinforcement learning (RL) in the challenging \emph{partially observable} setting. While it is well-established that learning in Partially Observable Markov Decision Processes (POMDPs) requires…
Our aim is to unify and extend the large deviation upper and lower bounds for the occupation times of a Markov process with $L_2$ semigroups under minimal conditions on the state space and the process trajectories; for example, no strong…
Under multiplicative drift and other regularity conditions, it is established that the asymptotic variance associated with a particle filter approximation of the prediction filter is bounded uniformly in time, and the nonasymptotic,…