Related papers: Semiflow selection and Markov selection theorems
Stochastic symmetries and related invariance properties of finite dimensional SDEs driven by general c\`adl\`ag semimartingales taking values in Lie groups are defined and investigated. In order to enlarge the class of possible symmetries…
We consider a finite state discrete time process X. Without loss of generality the finite state space can be identified with the set of unit vectors {e1, e2, . . . , eN} with ei = (0, . . . , 0, 1, 0, . . . , 0)0 2 RN. For a Markov chain…
Opacity is a generic security property, that has been defined on (non probabilistic) transition systems and later on Markov chains with labels. For a secret predicate, given as a subset of runs, and a function describing the view of an…
We show that any stochastically monotone Feller semigroup on R can be extended by a consistent family of order-preserving Feller semigroups on the successive powers of R. We exhibit a specific such family, which is uniquely characterized by…
We study a class of Piecewise Deterministic Markov Processes with state space Rd x E where E is a finite set. The continuous component evolves according to a smooth vector field that is switched at the jump times of the discrete coordinate.…
We investigate the Markov property and the continuity with respect to the initial conditions (strong Feller property) for the solutions to the Navier-Stokes equations forced by an additive noise. First, we prove, by means of an abstract…
In this paper, we establish the law of the iterated logarithm for a wide class of non-stationary, continuous-time Markov processes evolving on Polish spaces. Specifically, our result applies to certain additive functionals of processes…
We consider sequences $(X_t^N)_{t\geq0}$ of Markov processes in two dimensions whose fluid limit is a stable solution of an ordinary differential equation of the form $\dot{x}_t=b(x_t)$, where $b(x)={\pmatrix{-\mu 0 0 \lambda}}x+\tau(x)$…
Weconsider Markov decision processes arising from a Markov model of an underlying natural phenomenon. Such phenomena are usually periodic (e.g. annual) in time, and so the Markov processes modelling them must be time-inhomogeneous, with…
This paper is concerned with ergodic properties of inhomogeneous Markov processes. Since the transition probabilities depend on initial times, the existing methods to obtain invariant measures for homogeneous Markov processes are not…
We provide a systematic study of the notion of duality of Markov processes with respect to a function. We discuss the relation of this notion with duality with respect to a measure as studied in Markov process theory and potential theory…
In this paper, we establish a spatial central limit theorem for a large class of supercritical branching, not necessarily symmetric, Markov processes with spatially dependent branching mechanisms satisfying a second moment condition. This…
We study time-changed Markov processes to speed up the convergence of Markov chain Monte Carlo (MCMC) algorithms. The time-changed process is defined by adjusting the speed of time of a base process via a user-chosen, state-dependent…
Continuity equations associated to continuous-time Markov processes can be considered as Euclidean Schr\"odinger equations, where the non-hermitian quantum Hamiltonian $\bold{H}={\bold{div}}{\bold J}$ is naturally factorized into the…
We develop the theory linking 'E-separation' in directed mixed graphs (DMGs) with conditional independence relations among coordinate processes in stochastic differential equations (SDEs), where causal relationships are determined by "which…
We establish central limit theorems for a large class of supercritical branching Markov processes in infinite dimension with spatially dependent and non-necessarily local branching mechanisms. This result relies on a fourth moment…
We study group decision making with changing preferences as a Markov Decision Process. We are motivated by the increasing prevalence of automated decision-making systems when making choices for groups of people over time. Our main…
In this note we connect the notion of solutions of a martingale problem to the notion of a strongly continuous and locally equi-continuous semigroup on the space of bounded continuous functions equipped with the strict topology. This…
We consider a type of Markov property for set-indexed processes which is satisfied by all processes with independent increments and which allows us to introduce a transition system theory leading to the construction of the process. A…
Recent works in Learning-Based Model Predictive Control of dynamical systems show impressive sample complexity performances using criteria from Information Theory to accelerate the learning procedure. However, the sequential exploration…