English
Related papers

Related papers: Online Bayesian Learning of Agent Behavior in Diff…

200 papers

Evolutionary game theory is a successful mathematical framework geared towards understanding the selective pressures that affect the evolution of the strategies of agents engaged in interactions with potential conflicts. While a…

Populations and Evolution · Quantitative Biology 2016-09-01 Christoph Adami , Jory Schossau , Arend Hintze

This manuscript presents an advanced framework for Bayesian learning by incorporating action and state-dependent signal variances into decision-making models. This framework is pivotal in understanding complex data-feedback loops and…

Methodology · Statistics 2023-11-29 Kaiwen Hou

We consider adaptive decision-making problems where an agent optimizes a cumulative performance objective by repeatedly choosing among a finite set of options. Compared to the classical prediction-with-expert-advice set-up, we consider…

Machine Learning · Computer Science 2023-04-10 Michael Muehlebach

We extend the recently introduced regularization/Bayesian System Identification procedures to the estimation of time-varying systems. Specifically, we consider an online setting, in which new data become available at given time steps. The…

Systems and Control · Computer Science 2016-09-26 Giulia Prando , Diego Romeres , Alessandro Chiuso

This paper proposes a formal approach to online learning and planning for agents operating in a priori unknown, time-varying environments. The proposed method computes the maximally likely model of the environment, given the observations…

Machine Learning · Computer Science 2021-02-09 Melkior Ornik , Ufuk Topcu

We consider distributed learning problem in games with an unknown cost-relevant parameter, and aim to find the Nash equilibrium while learning the true parameter. Inspired by the social learning literature, we propose a distributed…

Optimization and Control · Mathematics 2023-03-14 Shijie Huang , Jinlong Lei , Yiguang Hong

Memory-based meta-learning is a powerful technique to build agents that adapt fast to any task within a target distribution. A previous theoretical study has argued that this remarkable performance is because the meta-training protocol…

Artificial Intelligence · Computer Science 2020-10-23 Vladimir Mikulik , Grégoire Delétang , Tom McGrath , Tim Genewein , Miljan Martic , Shane Legg , Pedro A. Ortega

While advances in multi-agent learning have enabled the training of increasingly complex agents, most existing techniques produce a final policy that is not designed to adapt to a new partner's strategy. However, we would like our AI agents…

Machine Learning · Computer Science 2022-01-06 Andy Shih , Stefano Ermon , Dorsa Sadigh

Dynamic and evolving operational and economic environments present significant challenges for decision-making. We explore a simulation optimization problem characterized by non-stationary input distributions with regime-switching dynamics…

Optimization and Control · Mathematics 2025-08-19 Jianglin Xia , Haowei Wang , Songhao Wang , Szu Hui Ng

In this paper, we develop a neural network-based approach for time-series prediction in unknown Hamiltonian dynamical systems. Our approach leverages a surrogate model and learns the system dynamics using generalized coordinates (positions)…

Machine Learning · Computer Science 2025-02-03 Taehyeun Kim , Tae-Geun Kim , Anouck Girard , Ilya Kolmanovsky

In many predictive decision-making scenarios, such as credit scoring and academic testing, a decision-maker must construct a model that accounts for agents' propensity to "game" the decision rule by changing their features so as to receive…

Machine Learning · Computer Science 2022-08-26 Yonadav Shavit , Benjamin Edelman , Brian Axelrod

In this paper, we propose Q-learning algorithms for continuous-time deterministic optimal control problems with Lipschitz continuous controls. Our method is based on a new class of Hamilton-Jacobi-Bellman (HJB) equations derived from…

Machine Learning · Computer Science 2020-10-28 Jeongho Kim , Jaeuk Shin , Insoon Yang

We consider a network scenario in which agents can evaluate each other according to a score graph that models some interactions. The goal is to design a distributed protocol, run by the agents, that allows them to learn their unknown state…

Systems and Control · Computer Science 2018-06-05 Francesco Sasso , Angelo Coluccia , Giuseppe Notarstefano

We explore a class of stochastic multiplayer games where each player in the game aims to optimize its objective under uncertainty and adheres to some expectation constraints. The study employs an offline learning paradigm, leveraging a…

Optimization and Control · Mathematics 2025-09-09 Yuanhanqing Huang , Jianghai Hu

We analyze the dynamics of a forecasting game which exhibits the phenomenon of information cascades. Each agent aims at correctly predicting a binary variable and he/she can either look for independent information or herd on the choice of…

Trading and Market Microstructure · Quantitative Finance 2009-11-13 A. Veglio , M. Marsili

The behaviour of multi-agent learning in many player games has been shown to display complex dynamics outside of restrictive examples such as network zero-sum games. In addition, it has been shown that convergent behaviour is less likely to…

Computer Science and Game Theory · Computer Science 2023-07-27 Aamal Hussain , Dan Leonte , Francesco Belardinelli , Georgios Piliouras

Addressing uncertainty is critical for autonomous systems to robustly adapt to the real world. We formulate the problem of model uncertainty as a continuous Bayes-Adaptive Markov Decision Process (BAMDP), where an agent maintains a…

In multi-agent problems requiring a high degree of cooperation, success often depends on the ability of the agents to adapt to each other's behavior. A natural solution concept in such settings is the Stackelberg equilibrium, in which the…

Machine Learning · Computer Science 2024-06-14 Robert Loftin , Mustafa Mert Çelikok , Herke van Hoof , Samuel Kaski , Frans A. Oliehoek

In stochastic dynamic environments, team Markov games have emerged as a versatile paradigm for studying sequential decision-making problems of fully cooperative multi-agent systems. However, the optimality of the derived policies is usually…

Optimization and Control · Mathematics 2022-05-03 Feng Huang , Ming Cao , Long Wang

This paper studies two important signal processing aspects of equilibrium behavior in non-cooperative games arising in social networks, namely, reinforcement learning and detection of equilibrium play. The first part of the paper presents a…

Computer Science and Game Theory · Computer Science 2015-01-07 Omid Namvar Gharehshiran , William Hoiles , Vikram Krishnamurthy