Related papers: Myopic non-intersection in a periodic potential
Markov decision processes are typically used for sequential decision making under uncertainty. For many aspects however, ranging from constrained or safe specifications to various kinds of temporal (non-Markovian) dependencies in task and…
We adapt ideas and concepts developed in optimal transport (and its martingale variant) to give a geometric description of optimal stopping times of Brownian motion subject to the constraint that the distribution of the stopping time is a…
A statistical, path-dependent framework to describe time-dependent macroscopic theories using the Principle of Maximum Caliber is presented. By means of this procedure, it is possible to infer predictive non-equilibrium statistical…
This report considers a fairly general model of constrained queuing networks that allows us to represent both MMBP (Markov Modulated Bernoulli Processes) arrivals and time-varying service constraints. We derive a set of sufficient…
Due to the inherent safety concerns associated with traffic movement in unconstrained two-dimensional settings, it is important that pedestrians' and other modes' movements such as bicyclists are modeled as a risk-taking stochastic dynamic…
In this paper, we develop a systematic method for constructing a generalized discrete-time control Lyapunov function for the flexible-step Model Predictive Control (MPC) scheme, recently introduced in [2], when restricted to the class of…
The paper presents a multidimensional model for nonlinear Markovian random walks that generalizes one we developed previously (Phys. Rev. E v.79, 011110, 2009) in order to describe the Levy type stochastic processes in terms of continuous…
Brownian motion of an array of harmonically coupled particles subject to a periodic substrate potential and driven by an external bias is investigated. In the linear response limit (small bias), the coupling between particles may enhance…
We propose random walks on suitably defined graphs as a framework for finescale modeling of particle motion in an obstructed environment where the particle may have interactions with the obstructions and the mean path length of the particle…
In this paper we study the long term evolution of a continuous time Markov chain formed by two interacting birth-and-death processes. The interaction between the processes is modelled by transition rates which are functions with suitable…
We consider the problem of stochastic flow of multiple particles traveling on a closed loop, with a constraint that particles move without passing. We use a Markov chain description that reduces the problem to a generalized random walk on a…
We show that Brownian motion is spatially not symmetric for mesoscopic particles embedded in a fluid if the particle is not in thermal equilibrium and its shape is not spherical. In view of applications on molecular motors in biological…
We study the driven Brownian motion of hard rods in a one-dimensional cosine potential with an amplitude large compared to the thermal energy. In a closed system, we find surprising features of the steady-state current in dependence of the…
This paper presents a method for local motion planning in unstructured environments with static and moving obstacles, such as humans. Given a reference path and speed, our optimization-based receding-horizon approach computes a local…
Time-reversed evolution has substantial implications in physics, including prominent applications in refocusing of classical waves or spins and fundamental researches such as quantum information scrambling. In quantum metrology, nonlinear…
Consider the random set composed of particles initially distributed on Zd, d >= 2, according to a Poisson point process of intensity u > 0 and moving as independent simple symmetric random walks, the trap particles. We are interested in the…
In this paper, we consider a continuous-time mean-variance portfolio selection with regime-switching and random horizon. Unlike previous works, the dynamic of assets are described by non-Markovian regime-switching models in the sense that…
Model predictive control (MPC) for tracking is a recently introduced approach, which extends standard MPC formulations by incorporating an artificial reference as an additional optimization variable, in order to track external and…
This paper is concerned with the development of rigorous approximations to various expectations associated with Markov chains and processes having non-stationary transition probabilities. Such non-stationary models arise naturally in…
Consider n non-intersecting particles on the real line (Dyson Brownian motions), all starting from the origin at time=0, and forced to return to x=0 at time=1. For large n, the average mean density of particles has its support, for each…