English
Related papers

Related papers: Markov selection for constrained martingale proble…

200 papers

For a class of stochastic differential equations with reflection for which a certain ${\mathbb{L}}^p$ continuity condition holds with $p>1$, it is shown that any weak solution that is a strong Markov process can be decomposed into the sum…

Probability · Mathematics 2010-10-12 Weining Kang , Kavita Ramanan

Two frameworks that have been used to characterize reflected diffusions include stochastic differential equations with reflection and the so-called submartingale problem. We introduce a general formulation of the submartingale problem for…

Probability · Mathematics 2014-12-03 Weining Kang , Kavita Ramanan

We establish the fractional diffusion limit of the kinetic scattering equation with diffusive boundary condition in a strongly convex bounded domain $\mathcal{D}\subset\mathbb{R}^d$. According to the nature of the boundary condition, two…

Probability · Mathematics 2025-12-22 Loïc Béthencourt , Nicolas Fournier

We prove existence and uniqueness for semimartingale reflecting diffusions in 2-dimensional piecewise smooth domains with varying, oblique directions of reflection on each "side", under geometric, easily verifiable conditions. Our…

Probability · Mathematics 2024-07-31 Cristina Costantini , Thomas G. Kurtz

Let $E$ be a complete, separable metric space and $A$ be an operator on $C_b(E)$. We give an abstract definition of viscosity sub/supersolution of the resolvent equation $\lambda u-Au=h$ and show that, if the comparison principle holds,…

Probability · Mathematics 2015-11-19 Cristina Costantini , Thomas G. Kurtz

We study the large deviations of current-type observables defined for Markov diffusion processes evolving in smooth bounded regions of $\mathbb{R}^d$ with reflections at the boundaries. We derive for these the correct boundary conditions…

Statistical Mechanics · Physics 2021-06-22 Emil Mallmin , Johan du Buisson , Hugo Touchette

We investigate one of the simplest multi-species generalizations of the one dimensional exclusion process with reflective boundaries. The Markov matrix governing the dynamics of the system splits into blocks (sectors) specified by the…

Statistical Mechanics · Physics 2014-09-18 Chikashi Arita

In this note, we propose two different approaches to rigorously justify a pseudo-Markov property for controlled diffusion processes which is often (explicitly or implicitly) used to prove the dynamic programming principle in the stochastic…

Probability · Mathematics 2015-01-19 Julien Claisse , Denis Talay , Xiaolu Tan

For a wide class of continuous-time Markov processes, including all irreducible hypoelliptic diffusions evolving on an open, connected subset of $\RL^d$, the following are shown to be equivalent: (i) The process satisfies (a slightly weaker…

Probability · Mathematics 2016-04-27 Ioannis Kontoyiannis , Sean P. Meyn

In this work, we introduce a new Skorokhod problem with two reflecting barriers when the trajectories of the driven process and the barriers are right and left limited. We show that this problem has an explicit unique solution in a…

Probability · Mathematics 2022-02-28 Astrid Hilbert , Imane Jarni , Youssef Ouknine

We study Markov processes conditioned so that their local time must grow slower than a prescribed function. Building upon recent work on Brownian motion with constrained local time in [5] and [33], we study transience and recurrence for a…

Probability · Mathematics 2020-12-24 Adam Barker

We prove uniqueness of a martingale problem with boundary conditions on a simplex associated to a differential operator with an unbounded drift. We show that the solution of the martingale problem remains absorbed at the boundary once it…

Probability · Mathematics 2015-05-06 J. Beltrán , M. Jara , C. Landim

A Markov process fluctuating away from its typical behavior can be represented in the long-time limit by another Markov process, called the effective or driven process, having the same stationary states as the original process conditioned…

Statistical Mechanics · Physics 2023-03-30 Florian Angeletti , Hugo Touchette

We study a simple singular control problem for a Brownian motion with constant drift and variance reflected at the origin. Exerting control pushes the process towards the origin and generates a concave increasing state-dependent yield which…

Probability · Mathematics 2024-08-30 Adam Jonsson

Characterizing whether a Markov process of discrete random variables has an homogeneous continuous-time realization is a hard problem. In practice, this problem reduces to deciding when a given Markov matrix can be written as the…

Probability · Mathematics 2021-06-23 Marta Casanellas , Jesús Fernández-Sánchez , Jordi Roca-Lacostena

Score-based generative models based on stochastic differential equations (SDEs) achieve impressive performance in sampling from unknown distributions, but often fail to satisfy underlying constraints. We propose a constrained generative…

Machine Learning · Statistics 2025-10-29 Adam Nordenhög , Akash Sharma

This paper introduces an approach to endow generative diffusion processes the ability to satisfy and certify compliance with constraints and physical principles. The proposed method recast the traditional sampling process of generative…

Machine Learning · Computer Science 2024-11-05 Jacob K Christopher , Stephen Baek , Ferdinando Fioretto

Consider a one-sided Markov additive process with an upper and a lower barrier, where each can be either reflecting or terminating. For both defective and non-defective processes and all possible scenarios we identify the corresponding…

Probability · Mathematics 2013-09-20 Jevgenijs Ivanovs

Reinforcement Learning Algorithms are predominantly developed for stationary environments, and the limited literature that considers nonstationary environments often involves specific assumptions about changes that can occur in transition…

Machine Learning · Computer Science 2025-09-25 Ranga Shaarad Ayyagari , Revanth Raj Eega , Ambedkar Dukkipati

The problem of constrained Markov decision process is considered. An agent aims to maximize the expected accumulated discounted reward subject to multiple constraints on its costs (the number of constraints is relatively small). A new dual…

Optimization and Control · Mathematics 2022-10-21 Egor Gladin , Maksim Lavrik-Karmazin , Karina Zainullina , Varvara Rudenko , Alexander Gasnikov , Martin Takáč
‹ Prev 1 2 3 10 Next ›