Related papers: On the Control of Density-Dependent Stochastic Pop…
In this paper we study stochastic control problems with delayed information, that is, the control at time $t$ can depend only on the information observed before time $t-H$ for some delay parameter $H$. Such delay occurs frequently in…
In this paper, we analyze the use of the Ornstein-Uhlenbeck process to model dynamical systems subjected to bounded noisy perturbations. In order to discuss the main characteristics of this new approach we consider some basic models in…
Understanding how humans control unstable systems is central to many research problems, with applications ranging from quiet standing to aircraft landing. Increasingly much evidence appears in favor of event-driven control hypothesis: human…
Fine population distribution both in space and in time is crucial for epidemic management, disaster prevention,urban planning and more. Human mobility data have a great potential for mapping population distribution at a high level of…
We consider an individual-based spatially structured population for Darwinian evolution in an asexual population. The individuals move randomly on a bounded continuous space according to a reflected brownian motion. The dynamics involves…
Control of complex turbulent dynamical systems involving strong nonlinearity and high degrees of internal instability is an important topic in practice. Different from traditional methods for controlling individual trajectories, controlling…
This paper studies the approximation of optimal control policies by quantized (discretized) policies for a very general class of Markov decision processes (MDPs). The problem is motivated by applications in networked control systems,…
Population dynamics in random ecological networks are investigated by analyzing a simple deterministic equation. It is found that a sequence of abrupt changes of populations punctuating quiescent states characterize the long time behavior.…
We propose a modelling framework to analyse the stochastic behaviour of heterogeneous, multi-scale cellular populations. We illustrate our methodology with a particular example in which we study a population with an oxygen-regulated…
The paper is devoted to the study of a new class of optimal control problems for nonsmooth dynamical systems governed by nonconvex discontinuous differential inclusions of the sweeping type with involving variable time into optimization. We…
In this paper, we consider the gradual-impulse control problem of continuous-time Markov decision processes, where the system performance is measured by the expectation of the exponential utility of the total cost. We prove, under very…
Epochal dynamics, in which long periods of stasis in population fitness are punctuated by sudden innovations, is a common behavior in both natural and artificial evolutionary processes. We use a recent quantitative mathematical analysis of…
This paper deals with the stochastic control of nonlinear systems in the presence of state and control constraints, for uncertain discrete-time dynamics in finite dimensional spaces. In the deterministic case, the viability kernel is known…
We discuss the relationships between large deviations in stochastic systems, and "effective interactions" that induce particular rare events. We focus on the nature of these effective interactions in physical systems with many interacting…
Robust control of complex engineered and biological systems hinges on the integration of feedforward and feedback mechanisms. This is exemplified in neural motor control, where feedforward muscle co-contraction complements sensory-driven…
Non-smooth dynamics driven by stochastic disturbance arise in a wide variety of engineering problems. Impulsive interventions are often employed to control stochastic systems; however, the modeling and analysis subject to execution delay…
We investigate constrained optimal control problems for linear stochastic dynamical systems evolving in discrete time. We consider minimization of an expected value cost over a finite horizon. Hard constraints are introduced first, and then…
Environments such as shopping malls, airports, or hospital emergency departments often experience crowding, with many people simultaneously requesting service. Crowding is highly noisy, with sudden overcrowding "spikes". Past research has…
We consider the problem of optimally controlling stochastic, Markovian systems subject to joint chance constraints over a finite-time horizon. For such problems, standard Dynamic Programming is inapplicable due to the time correlation of…
In recent years modelling crowd and evacuation dynamics has become very important, with increasing huge numbers of people gathering around the world for many reasons and events. The fact that our global population grows dramatically every…