Related papers: Synchronization via interacting reinforcement
Some nonlinear radiations such as superfluorescence can be understood as cooperative effects between atoms. We regard the cooperative radiation as a manifested effect secondary to the intrinsic synchronization among the atoms and propose a…
We review some facts, properties and applications of the urn of Hill, Lane and Sudderth, a paradigmatic model of stochastic process with memory where the urn evolution is as follows: consider an urn of given capacity, at each step a new…
The problem of synchronization of coupled Hamiltonian systems exhibits interesting features due to the non-uniform or mixed nature (regular and chaotic) of the phase space. We study these features by investigating the synchronization of…
We propose a way of finding a Stein type characterization of a given absolutely continuous distribution $\mu$ on $\R$ which is motivated by a regression property satisfied by an exchangeable pair $(W,W')$ where $\calL(W)$ is supposed or…
Sufficient conditions for synchronization of coupled Lienard-type oscillators are investigated via averaging technique. Coupling considered here is pairwise, unidirectional, and described by a nonlinear function (whose graph resides in the…
We consider an urn model, whose replacement matrix has all entries nonnegative and is balanced, that is, has constant row sums. We obtain the rates of the counts of balls corresponding to each color for the strong laws to hold. The analysis…
Two oscillators coupled to a two-level system which in turn is coupled to an infinite number of oscillators (reservoir) are considered, bringing to light the occurrence of synchronization. A detailed analysis clarifies the physical…
Generalized Polya urn models can describe the dynamics of finite populations of interacting genotypes. Three basic questions these models can address are: Under what conditions does a population exhibit growth? On the event of growth, at…
We introduce a new model for contagion spread using a network of interacting finite memory two-color P\'{o}lya urns, which we refer to as the finite memory interacting P\'{o}lya contagion network. The urns interact in the sense that the…
This paper investigates the stability and convergence properties of asynchronous stochastic approximation (SA) algorithms, with a focus on extensions relevant to average-reward reinforcement learning. We first extend a stability proof…
Synchronization in a group of linear time-invariant systems is studied where the coupling between each pair of systems is characterized by a different output matrix. Simple methods are proposed to generate a (separate) linear coupling gain…
A certain sampling process, concerning an urn with balls of two colors, proposed in 1965 by B.E. Oakley and R.L. Perry, and discussed by Peter Winkler and Martin Gardner, that has an extremely simple answer for the probability, namely the…
Consider an urn containing balls labeled with integer values. Define a discrete-time random process by drawing two balls, one at a time and with replacement, and noting the labels. Add a new ball labeled with the sum of the two drawn…
Shared upstream dynamical processes are frequently the source of common inputs in various physical and biological systems. However, due to finite signal transmission speeds and differences in the distance to the source, time shifts between…
This paper considers a two-color, single-draw urn model with two types of balls, denoted type $1$ and type $2$, with initial counts $Y^1_0\in N^+$ and $Y^2_0\in N^+$, respectively. At each discrete time step, a ball is drawn uniformly at…
An oscillatory system can have clockwise and anticlockwise senses of rotation. We propose a general rule how to obtain counter-rotating oscillators from the definition of a dynamical system and then investigate synchronization. A type of…
We analyze how an observer synchronizes to the internal state of a finite-state information source, using the epsilon-machine causal representation. Here, we treat the case of exact synchronization, when it is possible for the observer to…
This paper extends the link between stochastic approximation (SA) theory and randomized urn models developed in Laruelle, Pag{\`e}s (2013), and their applications to clinical trials introduced in Bai, HU (1999,2005) and Bai, Hu, Shen…
The symmetric random walk is known to be recurrent in one and two dimensions, and becomes transient in three or higher dimensions. We compare the symmetric random walk to walks driven by certain \polya\ urns. We show that, in contrast, if…
We characterize synchronization phenomenon in discrete-time, discrete-state random dynamical systems, with random and probabilistic Boolean networks as particular examples. In terms of multiplicative ergodic properties of the induced linear…