English
Related papers

Related papers: Learning about a changing state

200 papers

This paper develops a Bayesian mechanics for adaptive systems. Firstly, we model the interface between a system and its environment with a Markov blanket. This affords conditions under which states internal to the blanket encode information…

Mathematical Physics · Physics 2021-12-22 Lancelot Da Costa , Karl Friston , Conor Heins , Grigorios A. Pavliotis

How does one test empirically the hypothesis that a decision maker (DM) is being influenced by information via Bayesian persuasion? In this paper, I consider a DM whose state-dependent preferences are known to an analyst, who sees the…

Theoretical Economics · Economics 2026-05-13 Jeffrey Mensch

An agent acquires information dynamically until her belief about a binary state reaches an upper or lower threshold. She can choose any signal process subject to a constraint on the rate of entropy reduction. Strategies are ordered by "time…

Theoretical Economics · Economics 2024-08-23 Daniel Chen , Weijie Zhong

With the rich dynamics studies of single-state processes, the two-state processes attract more and more interests of people, since they are widely observed in complex system and have effective applications in diverse fields, say, foraging…

Classical Physics · Physics 2019-07-31 Xudong Wang , Yao Chen , Weihua Deng

A common approach to learn robotic skills is to imitate a demonstrated policy. Due to the compounding of small errors and perturbations, this approach may let the robot leave the states in which the demonstrations were provided. This…

Robotics · Computer Science 2019-08-08 Emmanuel Pignat , Sylvain Calinon

We consider an infinite collection of agents who make decisions, sequentially, about an unknown underlying binary state of the world. Each agent, prior to making a decision, receives an independent private signal whose distribution depends…

Computer Science and Game Theory · Computer Science 2012-09-07 Kimon Drakopoulos , Asuman Ozdaglar , John Tsitsiklis

We consider a set of agents who are attempting to iteratively learn the 'state of the world' from their neighbors in a social network. Each agent initially receives a noisy observation of the true state of the world. The agents then…

Social and Information Networks · Computer Science 2011-02-08 Yashodhan Kanoria , Omer Tamuz

We consider social learning in a changing world. Society can remain responsive to state changes only if agents regularly act upon fresh information, which limits the value of social learning. When the state is close to persistent, a…

Theoretical Economics · Economics 2022-01-07 Raphaël Lévy , Marcin Pęski , Nicolas Vieille

We develop a Bayesian model for decision-making under time pressure with endogenous information acquisition. In our model, the decision maker decides when to observe (costly) information by sampling an underlying continuous-time stochastic…

Artificial Intelligence · Computer Science 2016-10-25 Ahmed M. Alaa , Mihaela van der Schaar

We consider a mean-field game model where the cost functions depend on a fixed parameter, called \textit{state}, which is unknown to players. Players learn about the state from a a stream of private signals they receive throughout the game.…

Optimization and Control · Mathematics 2024-02-01 Eran Shmaya , Bruno Ziliotto

We introduce a simple framework in which market participants update their prior about an efficient price with a model-based learning process. We show that exponential intensities for the arrival of aggressive orders arise naturally in this…

Trading and Market Microstructure · Quantitative Finance 2021-09-29 Joffrey Derchu

Finding the best strategy to minimize the time needed to find a given target is a crucial task both in nature and in reaching decisive technological advances. By considering learning agents able to switch their dynamics between standard and…

Bayesian persuasion, a central model in information design, studies how a sender, who privately observes a state drawn from a prior distribution, strategically sends a signal to influence a receiver's action. A key assumption is that both…

Computer Science and Game Theory · Computer Science 2025-05-23 Jingwu Tang , Jiahao Zhang , Fei Fang , Zhiwei Steven Wu

In nature, active inference agents must learn how observations of the world represent the state of the agent. In engineering, the physics behind sensors is often known reasonably accurately and measurement functions can be incorporated into…

Systems and Control · Electrical Eng. & Systems 2024-09-20 Wouter M. Kouw

We study principal-agent problems in which a principal commits to an outcome-dependent payment scheme (a.k.a. contract) so as to induce an agent to take a costly, unobservable action. We relax the assumption that the principal perfectly…

Computer Science and Game Theory · Computer Science 2021-06-02 Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

I derive the pointwise conditional means and variances of an arbitrary Gauss-Markov process, given noisy observations of points on a sample path. These moments depend on the process's mean and covariance functions, and on the conditional…

Statistics Theory · Mathematics 2024-04-02 Benjamin Davies

In this paper we present new theoretical results on optimal estimation of certain random quantities based on high frequency observations of a L\'evy process. More specifically, we investigate the asymptotic theory for the conditional mean…

Probability · Mathematics 2020-01-09 Jevgenijs Ivanovs , Mark Podolskij

We implement Bayesian model selection and parameter estimation for the case of fractional Brownian motion with measurement noise and a constant drift. The approach is tested on artificial trajectories and shown to make estimates that match…

Data Analysis, Statistics and Probability · Physics 2018-04-05 Jens Krog , Lars H. Jacobsen , Frederik W. Lund , Daniel Wüstner , Michael A. Lomholt

Bayesian networks are powerful statistical models to study the probabilistic relationships among set random variables with major applications in disease modeling and prediction. Here, we propose a continuous time Bayesian network with…

Machine Learning · Computer Science 2021-07-16 Syed Hasib Akhter Faruqui , Adel Alaeddini , Jing Wang , Carlos A. Jaramillo

This paper develops a data-driven approach to Bayesian persuasion. The receiver is privately informed about the prior distribution of the state of the world, the sender knows the receiver's preferences but does not know the distribution of…

Theoretical Economics · Economics 2025-08-06 Maxwell Rosenthal