English

Learning without Recall by Random Walks on Directed Graphs

Systems and Control 2015-09-16 v1 Optimization and Control Machine Learning

Abstract

We consider a network of agents that aim to learn some unknown state of the world using private observations and exchange of beliefs. At each time, agents observe private signals generated based on the true unknown state. Each agent might not be able to distinguish the true state based only on her private observations. This occurs when some other states are observationally equivalent to the true state from the agent's perspective. To overcome this shortcoming, agents must communicate with each other to benefit from local observations. We propose a model where each agent selects one of her neighbors randomly at each time. Then, she refines her opinion using her private signal and the prior of that particular neighbor. The proposed rule can be thought of as a Bayesian agent who cannot recall the priors based on which other agents make inferences. This learning without recall approach preserves some aspects of the Bayesian inference while being computationally tractable. By establishing a correspondence with a random walk on the network graph, we prove that under the described protocol, agents learn the truth exponentially fast in the almost sure sense. The asymptotic rate is expressed as the sum of the relative entropies between the signal structures of every agent weighted by the stationary distribution of the random walk.

Keywords

Cite

@article{arxiv.1509.04332,
  title  = {Learning without Recall by Random Walks on Directed Graphs},
  author = {Mohammad Amin Rahimian and Shahin Shahrampour and Ali Jadbabaie},
  journal= {arXiv preprint arXiv:1509.04332},
  year   = {2015}
}

Comments

6 pages, To Appear in Conference on Decision and Control 2015

R2 v1 2026-06-22T10:56:38.979Z