Related papers: Markov selection for constrained martingale proble…
For a class of stochastic differential equations with reflection for which a certain ${\mathbb{L}}^p$ continuity condition holds with $p>1$, it is shown that any weak solution that is a strong Markov process can be decomposed into the sum…
Two frameworks that have been used to characterize reflected diffusions include stochastic differential equations with reflection and the so-called submartingale problem. We introduce a general formulation of the submartingale problem for…
We establish the fractional diffusion limit of the kinetic scattering equation with diffusive boundary condition in a strongly convex bounded domain $\mathcal{D}\subset\mathbb{R}^d$. According to the nature of the boundary condition, two…
We prove existence and uniqueness for semimartingale reflecting diffusions in 2-dimensional piecewise smooth domains with varying, oblique directions of reflection on each "side", under geometric, easily verifiable conditions. Our…
Let $E$ be a complete, separable metric space and $A$ be an operator on $C_b(E)$. We give an abstract definition of viscosity sub/supersolution of the resolvent equation $\lambda u-Au=h$ and show that, if the comparison principle holds,…
We study the large deviations of current-type observables defined for Markov diffusion processes evolving in smooth bounded regions of $\mathbb{R}^d$ with reflections at the boundaries. We derive for these the correct boundary conditions…
We investigate one of the simplest multi-species generalizations of the one dimensional exclusion process with reflective boundaries. The Markov matrix governing the dynamics of the system splits into blocks (sectors) specified by the…
In this note, we propose two different approaches to rigorously justify a pseudo-Markov property for controlled diffusion processes which is often (explicitly or implicitly) used to prove the dynamic programming principle in the stochastic…
For a wide class of continuous-time Markov processes, including all irreducible hypoelliptic diffusions evolving on an open, connected subset of $\RL^d$, the following are shown to be equivalent: (i) The process satisfies (a slightly weaker…
In this work, we introduce a new Skorokhod problem with two reflecting barriers when the trajectories of the driven process and the barriers are right and left limited. We show that this problem has an explicit unique solution in a…
We study Markov processes conditioned so that their local time must grow slower than a prescribed function. Building upon recent work on Brownian motion with constrained local time in [5] and [33], we study transience and recurrence for a…
We prove uniqueness of a martingale problem with boundary conditions on a simplex associated to a differential operator with an unbounded drift. We show that the solution of the martingale problem remains absorbed at the boundary once it…
A Markov process fluctuating away from its typical behavior can be represented in the long-time limit by another Markov process, called the effective or driven process, having the same stationary states as the original process conditioned…
We study a simple singular control problem for a Brownian motion with constant drift and variance reflected at the origin. Exerting control pushes the process towards the origin and generates a concave increasing state-dependent yield which…
Characterizing whether a Markov process of discrete random variables has an homogeneous continuous-time realization is a hard problem. In practice, this problem reduces to deciding when a given Markov matrix can be written as the…
Score-based generative models based on stochastic differential equations (SDEs) achieve impressive performance in sampling from unknown distributions, but often fail to satisfy underlying constraints. We propose a constrained generative…
This paper introduces an approach to endow generative diffusion processes the ability to satisfy and certify compliance with constraints and physical principles. The proposed method recast the traditional sampling process of generative…
Consider a one-sided Markov additive process with an upper and a lower barrier, where each can be either reflecting or terminating. For both defective and non-defective processes and all possible scenarios we identify the corresponding…
Reinforcement Learning Algorithms are predominantly developed for stationary environments, and the limited literature that considers nonstationary environments often involves specific assumptions about changes that can occur in transition…
The problem of constrained Markov decision process is considered. An agent aims to maximize the expected accumulated discounted reward subject to multiple constraints on its costs (the number of constraints is relatively small). A new dual…