Related papers: Occupied Processes: Going with the Flow
We consider a class of stochastic dynamical systems, called piecewise deterministic Markov processes, with states $(x, \s)\in \O\times \G$, $\O$ being a region in $\bbR^d$ or the $d$--dimensional torus, $\G$ being a finite set. The…
We investigate the distribution of occupation times for a particle undergoing a random walk among random energy traps and in the presence of a deterministic potential field $U^{{\rm det}}(x)$. When the distribution of energy traps is…
Let $(X_t)_{t \geq 0}$ be a continuous time Markov process on some metric space $M,$ leaving invariant a closed subset $M_0 \subset M,$ called the {\em extinction set}. We give general conditions ensuring either "Stochastic persistence"…
This paper deals with the unconstrained and constrained cases for continuous-time Markov decision processes under the finite-horizon expected total cost criterion. The state space is denumerable and the transition and cost rates are allowed…
We propose a new class of parameterizations for spatio-temporal point processes which leverage Neural ODEs as a computational method and enable flexible, high-fidelity models of discrete events that are localized in continuous time and…
We present a unified operator-theoretic framework for stochastic calculus based on the factorization (Id - E)F = {\delta}_X {\Pi}_X D_X F, valid for F_T^X-measurable F in L^2({\Omega}) when the driving process X has the representation…
It is shown that under a certain condition on a semimartingale and a time-change, any stochastic integral driven by the time-changed semimartingale is a time-changed stochastic integral driven by the original semimartingale. As a direct…
Stochastic time-varying optimization is an integral part of learning in which the shape of the function changes over time in a non-deterministic manner. This paper considers multiple models of stochastic time variation and analyzes the…
We propose Occupancy Flow Fields, a new representation for motion forecasting of multiple agents, an important task in autonomous driving. Our representation is a spatio-temporal grid with each grid cell containing both the probability of…
In this paper we consider an Ornstein-Uhlenbeck (OU) process $(M(t))_{t\geqslant 0}$ whose parameters are determined by an external Markov process $(X(t))_{t\geqslant 0}$ on a finite state space $\{1,\ldots,d\}$; this process is usually…
In this paper, we introduce a nonlinear stochastic model to describe the propagation of information inside a computer processor. In this model, a computational task is divided into stages, and information can flow from one stage to another.…
In multi-period stochastic optimization problems, the future optimal decision is a random variable whose distribution depends on the parameters of the optimization problem. We analyze how the expected value of this random variable changes…
We consider a model for a queue in which only a fixed number $N$ of customers can join. Each customer joins the queue independently at an exponentially distributed time. Assuming further that the service times are independent and follow an…
We establish limit theorems for the fluctuations of the rescaled occupation time of a $(d,\alpha,\beta)$-branching particle system. It consists of particles moving according to a symmetric $\alpha$-stable motion in $\mathbb{R}^d$. The…
The problem of stochastic deadline scheduling is considered. A constrained Markov decision process model is introduced in which jobs arrive randomly at a service center with stochastic job sizes, rewards, and completion deadlines. The…
We provide a probabilistic analysis of the banker algorithm when transition probabilities may depend on time and space. The transition probabilities evolve, as time goes by, along the trajectory of an ergodic Markovian environment, whereas…
We develop a method of driving a Markov processes through a continuous flow. In particular, at the level of the transition functions we investigate an approach of adding a first order operator to the generator of a Markov process, when the…
Given a multi-dimensional It\^{o} process whose drift and diffusion terms are adapted processes, we construct a weak solution to a stochastic differential equation that matches the distribution of the It\^{o} process at each fixed time.…
We study the local (in time) expansion of a continuous-time process and its conditional moments, including the process' characteristic function. The expansions are conducted by using the properties of the (time-extended) Ito signature, a…
Many time series are effectively generated by a combination of deterministic continuous flows along with discrete jumps sparked by stochastic events. However, we usually do not have the equation of motion describing the flows, or how they…