Related papers: Polynomial deviation bounds for recurrent Harris p…
We prove a moment majorization principle for matrix-valued functions with domain $\{-1,1\}^{m}$, $m\in\mathbb{N}$. The principle is an inequality between higher-order moments of a non-commutative multilinear polynomial with different random…
We study discrete-time discounted constrained Markov decision processes (CMDPs) on Borel spaces with unbounded reward functions. In our approach the transition probability functions are weakly or set-wise continuous. The reward functions…
We compute the deterministic approximation for mixed fluctuation moments of products of deterministic matrices and general Sobolev functions of Wigner matrices. Restricting to polynomials, our formulas reproduce recent results of [Male,…
We prove existence and uniqueness of the invariant measure and exponential mixing in the total-variation norm for a class of stochastic differential equations driven by degenerate compound Poisson processes. In addition to mild assumptions…
In order to give quantitative estimates for approximating the ergodic limit, we investigate probabilistic limit behaviors of time-averaging estimators of numerical discretizations for a class of time-homogeneous Markov processes, by…
Extending our own and others' earlier approaches to reasoning about termination of probabilistic programs, we propose and prove a new rule for termination with probability one, also known as "almost-certain termination". The rule uses both…
Time-irreversible stochastic processes are frequently used in natural sciences to explain non-equilibrium phenomena and to design efficient stochastic algorithms. Our main goal in this thesis is to analyse their dynamics by means of large…
We derive an invariance principle for the lift to the rough path topology of stochastic processes with delayed regenerative increments under an optimal moment condition. An interesting feature of the result is the emergence of area anomaly,…
In this paper we derive quantitative boundary H\"older estimates, with explicit constants, for the inhomogeneous Poisson problem in a bounded open set $D\subset \mathbb{R}^d$. Our approach has two main steps: firstly, we consider an…
We establish sharp large deviation principles for cumulative rewards associated with a discrete-time renewal model, supposing that each renewal involves a broad-sense reward taking values in a real separable Banach space. The framework we…
The discrete data encoded in the power moments of a positive measure, fast decaying at infinity on euclidean space, is incomplete for recovery, leading to the concept of moment indeterminateness. On the other hand, classical integral…
We consider an interacting particle system on $\Z^d$ with finite state space and interactions of infinite range in a high-noise regime. Assuming that the rate of change is continuous and that a Dobrushin-like condition holds, we show that…
We introduce polynomial processes taking values in an arbitrary Banach space $B$ via their infinitesimal generator $L$ and the associated martingale problem. We obtain two representations of the (conditional) moments in terms of solutions…
Suppose $ E$ is a space with a null-recurrent Markov kernel $ P$. Furthermore, suppose there are infinite particles with variable weights on $ E$ performing a random walk following $ P$. Let $ X_{t}$ be a weighted functional of the position…
We show that for several variations of partially observable Markov decision processes, polynomial-time algorithms for finding control policies are unlikely to or simply don't have guarantees of finding policies within a constant factor or a…
For general absorbed Markov processes $(X_t)_{0\leq t<\tau_{\partial}}$ having a quasi-stationary distribution (QSD) $\pi$ and absorption time $\tau_{\partial}$, we introduce a Dobrushin-type criterion providing for exponential convergence…
For one-dimensional random Schr\"odinger operators, the integrated density of states is known to be given in terms of the (averaged) rotation number of the Pr\"ufer phase dynamics. This paper develops a controlled perturbation theory for…
In this paper, we consider Caputo type fractional stochastic time-delay system with permutable matrices. We derive stochastic analogue of variation of constants formula via a newly defined delayed Mittag-Leffer type matrix function. Thus,…
We investigate partially observed Markov decision processes (POMDPs) with cost functions regularized by entropy terms describing state, observation, and control uncertainty. Standard POMDP techniques are shown to offer bounded-error…
Consider a sequence of Markov processes $X^1, X^2,...$ with state space $E$, where $X^N$ has a strong drift to $D \subseteq E$, such that $\Phi(X^N)$ is slow for some appropriate $\Phi: E\to D$. Using the method of martingale problems, we…