Related papers: Polynomial deviation bounds for recurrent Harris p…
In this paper, we study mixed power-exponential moment functionals of nonlinearly perturbed semi-Markov processes in discrete time. Conditions under which the moment functionals of interest can be expanded in asymptotic power series with…
A sequence of invertible matrices given by a small random perturbation around a fixed diagonal partially hyperbolic matrix induces a random dynamics on the Grassmann manifolds. Under suitable weak conditions it is known to have a unique…
We investigate a piecewise-deterministic Markov process, evolving on a Polish metric space, whose deterministic behaviour between random jumps is governed by some semi-flow, and any state right after the jump is attained by a randomly…
We study a class of discrete-time random dynamical systems with compact phase space. Assuming that the deterministic counterpart of the system in question possesses a dissipation property, its linearisation is approximately controllable,…
This paper is devoted to the study of general (Laurent) polynomial modifications of moment functionals on the unit circle, i.e., associated with hermitian Toeplitz matrices. We present a new approach which allows us to study polynomial…
We address a class of backward stochastic differential equations on a bounded interval, where the driving noise is a marked, or multivariate, point process. Assuming that the jump times are totally inaccessible and a technical condition…
We consider reinforcement learning for continuous-time Markov decision processes (MDPs) in the infinite-horizon, average-reward setting. In contrast to discrete-time MDPs, a continuous-time process moves to a state and stays there for a…
In this paper, we revisit energy-based concepts of controllability and reformulate them for control-affine nonlinear systems perturbed by white noise. Specifically, we discuss the relation between controllability of deterministic systems…
We study invariant boundary conditions for one dimensional discrete Gaussian Markov processes, basic toy models of spatial Markov processes in statistical mechanics. More precisely, we give a decomposition of boundary objects in a non…
Consider an intersection measure $\ell_t ^{\mathrm{IS}}$ of $p$ independent (possibly different) $m$-symmetric Hunt processes up to time $t$ in a metric measure space $E$ with a Radon measure $m$. We derive a Donsker-Varadhan type large…
We introduce a multivariate Markov transform which generalizes the well-known one-dimensional Stieltjes transform from the Moment problem and Spectral theory. Our main result states that two measures {\mu} and {\nu} with bounded support…
We revisit closed-loop performance guarantees for Model Predictive Control in the deterministic and stochastic cases, which extend to novel performance results applicable to receding horizon control of Partially Observable Markov Decision…
This paper studies the exponential stability of random matrix products driven by a general (possibly unbounded) state space Markov chain. It is a cornerstone in the analysis of stochastic algorithms in machine learning (e.g. for parameter…
Recursive stochastic algorithms have gained significant attention in the recent past due to data driven applications. Examples include stochastic gradient descent for solving large-scale optimization problems and empirical dynamic…
Given a parabolic cylinder $Q =(0,T)\times\Omega$, where $\Omega\subset \mathbb{R}^{N}$ is a bounded domain, we prove new properties of solutions of \[ u_t-\Delta_p u = \mu \quad \text{in $Q$} \] with Dirichlet boundary conditions, where…
We obtain Fisher-Hartwig asymptotics with root and jump type singularities in space-time under the law of the stationary Hermitian Ornstein-Uhlenbeck process, which serve as a dynamical generalization of earlier static results obtained by…
In this paper, we seek to understand the behavior of dynamical systems that are perturbed by a parameter that changes discretely in time. If we impose certain conditions, we can study certain embedded systems within a hybrid system as…
A continuous-time random walk in the quarter plane with homogeneous transition rates is considered. Given a non-negative reward function on the state space, we are interested in the expected stationary performance. Since a direct derivation…
Via operator theoretic methods, we formalize the concentration phenomenon for a given observable `$r$' of a discrete time Markov chain with `$\mu_{\pi}$' as invariant ergodic measure, possibly having support on an unbounded state space. The…
A time inhomogeneous generalized Mehler semigroup on a real separable Hilbert space ${\mathds{H}}$ is defined through $$ p_{s,t}f(x)=\int_{\mathds{H}} f(U(t,s)x+y)\,\mu_{t,s}(dy), \quad t\geq s, \ x\in{\mathds{H}} $$ for every bounded…