Related papers: Adaptive Dynamics for Interacting Markovian Proces…
The transfer entropy is a well-established measure of information flow, which quantifies directed influence between two stochastic time series and has been shown to be useful in a variety fields of science. Here we introduce the transfer…
In this paper, we model a decision-making process involving a set of interacting agents. We use Markovian opinion dynamics, where each agent switches between decisions according to a continuous time Markov chain. Existing opinion dynamics…
It is well established that gene expression can be modeled as a Markovian stochastic process and hence proper observables might be subjected to large fluctuations and rare events. Since dynamics is often more than statics, one can work with…
We endow a system of interacting particles with two distinct, local, Markovian and reversible microscopic dynamics. Using common field-theoretic techniques used to investigate the presence of a glass transition, we find that while the…
Reaction diffusion systems describe the behaviour of dynamic, interacting, particulate systems. Quantum stochastic processes generalise Brownian motion and Poisson processes, having operator valued It\^{o} calculus machinery. Here it is…
We investigate piecewise deterministic Markov processes (PDMP), where the deterministic dynamics follows a scalar conservation law and random jumps in the system are characterized by changes in the flux function. We show under which…
In this paper we consider a class of interacting particle systems on dynamic random networks, in which the joint dynamics of vertices and edges acts as one-way feedback, i.e., edges appear and disappear over time depending on the state of…
People organize in groups and contagions spread across them. A simple stochastic process, yet complex to model due to dynamical correlations within and between groups. Moreover, groups can evolve if agents join or leave in response to…
In stochastic dynamic environments, team Markov games have emerged as a versatile paradigm for studying sequential decision-making problems of fully cooperative multi-agent systems. However, the optimality of the derived policies is usually…
Complex systems are often characterized by the interplay of multiple interconnected dynamical processes operating across a range of temporal scales. This phenomenon is widespread in both biological and artificial scenarios, making it…
The general picture of game theoretic modeling dealt with here is characterized by a set of big players, also referred to as principals or major agents, acting on the background of large pools of small players, the impact of the behavior of…
We study Bayesian coordination games where agents receive noisy private information over the game's payoff structure, and over each others' actions. If private information over actions is precise, we find that agents can coordinate on…
We analyze a class of dynamics of open quantum systems which is governed by the dynamical map mutually commuting at different times. Such evolution may be effectively described via spectral analysis of the corresponding time dependent…
Using the tools of the Markov Decision Processes, we justify the dynamic programming approach to the optimal impulse control of deterministic dynamical systems. We prove the equivalence of the integral and differential forms of the…
We investigate the interface dynamic in Laplacian growth model, using the conformal mapping technique. Starting from the governing equation for the conformal map, obtained by B.Shraiman and D.Bensimon, we derive different possible forms of…
Non-Markovian stochastic processes are ubiquitous in biology. Nevertheless, we lack a general framework for quantifying historical dependencies. In this Letter, we propose an information-theoretic approach to decompose history dependence in…
Understanding and predicting the dynamical properties of systems involving dry friction is a major concern in physics and engineering. It abounds in many mechanical processes, from the sound produced by a violin to the screeching of chalk…
We discuss several models of the dynamics of interacting populations. The models are constructed by nonlinear differential equations and have two sets of parameters: growth rates and coefficients of interaction between populations. We…
This paper deals with the question of how to most effectively conduct experiments in Partially Observed Markov Decision Processes so as to provide data that is most informative about a parameter of interest. Methods from Markov decision…
We consider a stationary process (with either discrete or continuous time) and find an adaptive approximating stationary process combining approximation quality and supplementary good properties that can be interpreted as additional…