Related papers: Heat release by controlled continuous-time Markov …
In this paper, we aim to develop the theory of optimal stochastic control for branching diffusion processes where both the movement and the reproduction of the particles depend on the control. More precisely, we study the problem of…
In classical Markov jump processes, current fluctuations can only be reduced at the cost of increased dissipation. To explore how quantum effects influence this trade-off, we analyze the uncertainty of steady-state currents in Markovian…
A general nonequilibrium thermodynamic theory is developed for time-dependent Langevin dynamics, starting from the common definition of nonequilibrium Gibbs entropy. It is shown that the notations appearing in the First and the Second Law…
We solve two long standing problems for stochastic descriptions of open quantum system dynamics. First, we find the classical stochastic processes corresponding to non-Markovian quantum state diffusion and non-Markovian quantum jumps in…
We obtain macroscopic isothermal thermodynamic transformations by space-time scalings of a microscopic Hamiltonian dynamics in contact with a heat bath. The microscopic dynamics is given by a chain of anharmonic oscillators subject to a…
This article studies a portfolio optimization problem, where the market consisting of several stocks is modeled by a multi-dimensional jump-diffusion process with age-dependent semi-Markov modulated coefficients. We study risk sensitive…
We study the ergodic control problem for a class of controlled jump diffusions driven by a compound Poisson process. This extends the results of [SIAM J. Control Optim. 57 (2019), no. 2, 1516-1540] to running costs that are not…
Thermodynamics allows the application of Statistical Mechanics to finite and even small systems. As surface effects cannot be scaled away, one has to be careful with the standard arguments of splitting a system into two or bringing two…
In this work, we study the nonequilibrium statistical properties of the relaxation dynamics of a nanoparticle trapped in a harmonic potential. We report an exact time-dependent analytical solution to the Langevin dynamics that arises from…
In this paper, we study purely discontinuous symmetric Markov processes on closed subsets of ${\mathbb R}^d$, $d\ge 1$, with jump kernels of the form $J(x,y)=|x-y|^{-d-\alpha}{\mathcal B}(x,y)$, $\alpha\in (0,2)$, where the function…
We consider a Markov process $X$, which is the solution of a stochastic differential equation driven by a L\'{e}vy process $Z$ and an independent Wiener process $W$. Under some regularity conditions, including non-degeneracy of the…
We present limit theorems for a sequence of Piecewise Deterministic Markov Processes (PDMPs) taking values in a separable Hilbert space. This class of processes provides a rigorous framework for stochastic spatial models in which discrete…
Optimal control theory deals with finding protocols to steer a system between assigned initial and final states, such that a trajectory-dependent cost function is minimized. The application of optimal control to stochastic systems is an…
Thermodynamics serves as a universal means for studying physical systems from an energy perspective. In recent years, with the establishment of the field of stochastic and quantum thermodynamics, the ideas of thermodynamics have been…
A continuous-time Markov process $X$ can be conditioned to be in a given state at a fixed time $T > 0$ using Doob's $h$-transform. This transform requires the typically intractable transition density of $X$. The effect of the $h$-transform…
Up to now, the nonparametric analysis of multidimensional continuous-time Markov processes has focussed strongly on specific model choices, mostly related to symmetry of the semigroup. While this approach allows to study the performance of…
This paper investigates the optimal control problems for the finite-horizon continuous-time Markov decision processes with delay-dependent control policies. We develop compactification methods in decision processes, and show that the…
In this paper, we consider a symmetric pure jump Markov process $X$ on a metric measure space with volume doubling conditions. Our focus is on estimating the transition density $p(t,x,y)$ of $X$ and studying its stability when the jumping…
We start by providing an explicit characterization and analytical properties, including the persistence phenomena, of the distribution of the extinction time $\mathbb{T}$ of a class of non-Markovian self-similar stochastic processes with…
Multi-agent systems can be successfully described by kinetic models, which allow one to explore the large scale aggregate trends resulting from elementary microscopic interactions. The latter may be formalised as collision-like rules, in…