English
Related papers

Related papers: Learning about a changing state

200 papers

We study a model of consensus decision making, in which a finite group of Bayesian agents has to choose between one of two courses of action. Each member of the group has a private and independent signal at his or her disposal, giving some…

Statistics Theory · Mathematics 2018-04-24 Elchanan Mossel , Omer Tamuz

This research considers Bayesian decision-analytic approaches toward the traversal of an uncertain graph. Namely, a traveler progresses over a graph in which rewards are gained upon a node's first visit and costs are incurred for every edge…

Artificial Intelligence · Computer Science 2025-03-11 William N. Caballero , Phillip R. Jenkins , David Banks , Matthew Robbins

We study learning by privately informed forward-looking agents in a simple repeated-action setting of social learning. Under a symmetric signal structure, forward-looking agents behave myopically for any degrees of patience. Myopic…

Theoretical Economics · Economics 2023-01-09 Dimitri Migrow

We construct a Bayesian sequential test of two simple hypotheses about the value of the unobservable drift coefficient of a Brownian motion, with a possibility to change the initial decision at subsequent moments of time for some penalty.…

Probability · Mathematics 2020-07-28 Mikhail Zhitlukhin

I study the optimal provision of information in a long-term relationship between a sender and a receiver. The sender observes a persistent, evolving state and commits to send signals over time to the receiver, who sequentially chooses…

Theoretical Economics · Economics 2023-03-20 Ian Ball

We consider an agent who represents uncertainty about the environment via a possibly misspecified model. Each period, the agent takes an action, observes a consequence, and uses Bayes' rule to update her belief about the environment. This…

Theoretical Economics · Economics 2019-10-24 Ignacio Esponda , Demian Pouzo , Yuichi Yamamoto

Bayesian decision theory outlines a rigorous framework for making optimal decisions based on maximizing expected utility over a model posterior. However, practitioners often do not have access to the full posterior and resort to approximate…

Machine Learning · Statistics 2019-10-29 Tomasz Kuśmierczyk , Joseph Sakaya , Arto Klami

Once upon a time, predictions for the accuracy of inference on gravitational-wave signals relied on computationally inexpensive but often inaccurate techniques. Recently, the approach has shifted to actual inference on noisy signals with…

Instrumentation and Methods for Astrophysics · Physics 2015-12-09 Carl-Johan Haster , Ilya Mandel , Will M. Farr

Online algorithms for detecting changepoints, or abrupt shifts in the behavior of a time series, are often deployed with limited resources, e.g., to edge computing settings such as mobile phones or industrial sensors. In these scenarios it…

Machine Learning · Statistics 2021-07-27 Gregory W. Gundersen , Diana Cai , Chuteng Zhou , Barbara E. Engelhardt , Ryan P. Adams

Aoristic data can be described by a marked point process in time in which the points cannot be observed directly but are known to lie in observable intervals, the marks. We consider Bayesian state estimation for the latent points when the…

Statistics Theory · Mathematics 2021-08-25 M. N. M. van Lieshout , R. L. Markwitz

We consider the problem of designing a sequential decision making agent to maximize an unknown time-varying function which switches with time. At each step, the agent receives an observation of the function's value at a point decided by the…

Optimization and Control · Mathematics 2023-11-07 Durgesh Kalwar , Vineeth B. S

We study Bayesian coordination games where agents receive noisy private information over the game's payoff structure, and over each others' actions. If private information over actions is precise, we find that agents can coordinate on…

General Economics · Economics 2019-04-25 Dominik Grafenhofer , Wolfgang Kuhle

We compare the relation between dispersion and dissipation for two random variables that can be used to characterize the precision of a Brownian clock. The first random variable is the current between states. In this case, a certain…

Statistical Mechanics · Physics 2017-08-03 Somrita Ray , Andre C. Barato

There is increasing interest in learning how human brain networks vary as a function of a continuous trait, but flexible and efficient procedures to accomplish this goal are limited. We develop a Bayesian semiparametric model, which…

Methodology · Statistics 2017-02-02 Lu Wang , Daniele Durante , Rex E. Jung , David B. Dunson

We consider a scenario where the aim of a group of agents is to perform the optimal coverage of a region according to a sensory function. In particular, centroidal Voronoi partitions have to be computed. The difficulty of the task is that…

Multiagent Systems · Computer Science 2014-07-23 Andrea Carron , Marco Todescato , Ruggero Carli , Luca Schenato , Gianluigi Pillonetto

Bayesian optimization is proposed for automatic learning of optimal controller parameters from experimental data. A probabilistic description (a Gaussian process) is used to model the unknown function from controller parameters to a…

Systems and Control · Computer Science 2019-01-24 Matthias Neumann-Brosig , Alonso Marco , Dieter Schwarzmann , Sebastian Trimpe

In many practical sequential decision-making problems, tracking the state of the environment incurs a sensing/communication/computation cost. In these settings, the agent's interaction with its environment includes the additional component…

Machine Learning · Computer Science 2026-04-16 Vansh Kapoor , Jayakrishnan Nair

We consider active Brownian particles that intermittently switch between active and inactive states. Such behavior is ubiquitous at all scales, from bacteria to animals and in artificial active systems. We derive exact expressions for key…

Statistical Mechanics · Physics 2025-09-24 Fernando Peruani , Debasish Chaudhuri

We study online Bayesian persuasion problems in which an informed sender repeatedly faces a receiver with the goal of influencing their behavior through the provision of payoff-relevant information. Previous works assume that the sender has…

Computer Science and Game Theory · Computer Science 2024-11-12 Francesco Bacchiocchi , Matteo Bollini , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

We consider an evolving system for which a sequence of observations is being made, with each observation revealing additional information about current and past states of the system. We suppose each observation is made without error, but…

Computation · Statistics 2021-03-10 Valentina Di Marco , Jonathan Keith