English
Related papers

Related papers: Exploration noise for learning linear-quadratic me…

200 papers

Class-conditional noise commonly exists in machine learning tasks, where the class label is corrupted with a probability depending on its ground-truth. Many research efforts have been made to improve the model robustness against the…

Machine Learning · Computer Science 2021-05-18 Ming-Kun Xie , Sheng-Jun Huang

Concurrent multi-player mean-payoff games are important models for systems of agents with individual, non-dichotomous preferences. Whilst these games have been extensively studied in terms of their equilibria in non-cooperative settings,…

Computer Science and Game Theory · Computer Science 2023-11-28 Julian Gutierrez , Anthony W. Lin , Muhammad Najib , Thomas Steeples , Michael Wooldridge

To handle the sparsity of the extrinsic rewards in reinforcement learning, researchers have proposed intrinsic reward which enables the agent to learn the skills that might come in handy for pursuing the rewards in the future, such as…

Machine Learning · Computer Science 2022-05-31 Chao Chen , Zijian Gao , Kele Xu , Sen Yang , Yiying Li , Bo Ding , Dawei Feng , Huaimin Wang

We argue for the use of active learning methods for player modelling. In active learning, the learning algorithm chooses where to sample the search space so as to optimise learning progress. We hypothesise that player modelling based on…

Machine Learning · Computer Science 2013-12-11 Julian Togelius , Noor Shaker , Georgios N. Yannakakis

We study mean field games with scalar It{\^o}-type dynamics and costs that are submodular with respect to a suitable order relation on the state and measure space. The submodularity assumption has a number of interesting consequences.…

Optimization and Control · Mathematics 2019-07-26 Jodi Dianetti , Giorgio Ferrari , Markus Fischer , Max Nendel

We introduce a notion of expected utility for quantum tasks and discuss some general conditions under which this is increased by the presence of quantum noise in the underlying resource states. We apply the resulting formalism to the…

Quantum Physics · Physics 2023-08-23 Chuqiao Lin , Vir B. Bulchandani , Shivaji L. Sondhi

H\"older stability estimate and uniqueness are proven for a retrospective problem of Mean Field Games with a non-quadratic Hamiltonian. The previous result was only for the quadratic Hamiltonian. The main tool is the apparatus of Carleman…

Analysis of PDEs · Mathematics 2023-11-02 Michael V. Klibanov , Mikhail Y. Kokurin , Jingzhi Li

In this note we discuss a theory of combinatorial games that involve transmitting the moves through a noisy channel that can introduce errors during the transmission. Players are aware of this interference and incorporate this variable into…

Combinatorics · Mathematics 2020-12-15 Nicolas Capitelli , Melina Privitelli

We propose a game-based formulation for learning dimensionality-reducing representations of feature vectors, when only a prior knowledge on future prediction tasks is available. In this game, the first player chooses a representation, and…

Machine Learning · Computer Science 2024-03-12 Neria Uzan , Nir Weinberger

We explore the behaviour emerging from learning agents repeatedly interacting strategically for a wide range of learning dynamics, including $Q$-learning, projected gradient, replicator and log-barrier dynamics. Going beyond the better…

Computer Science and Game Theory · Computer Science 2026-03-04 Galit Askenazi-Golan , Domenico Mergoni Cecchelli , Edward Plumb , Clemens Possnig

In this paper we propose two new monotonicity conditions that could serve as sufficient conditions for uniqueness of Nash equilibria in mean field games. In this study we aim for $unconditional\ uniqueness$ that is independent of the length…

Analysis of PDEs · Mathematics 2023-07-24 P. Jameson Graber , Alpár R. Mészáros

The theory of mean field games aims at studying deterministic or stochastic differential games (Nash equilibria) as the number of agents tends to infinity. Since very few mean field games have explicit or semi-explicit solutions, numerical…

Optimization and Control · Mathematics 2020-03-11 Yves Achdou , Mathieu Laurière

We study stochastic effects on the lagging anchor dynamics, a reinforcement learning algorithm used to learn successful strategies in iterated games, which is known to converge to Nash points in the absence of noise. The dynamics is…

Adaptation and Self-Organizing Systems · Physics 2012-04-20 James B. T. Sanders , Tobias Galla , Jonathan Shapiro

Mean field theory provides an effective way of scaling multiagent reinforcement learning algorithms to environments with many agents that can be abstracted by a virtual mean agent. In this paper, we extend mean field multiagent algorithms…

Multiagent Systems · Computer Science 2022-06-22 Sriram Ganapathi Subramanian , Pascal Poupart , Matthew E. Taylor , Nidhi Hegde

This paper studies infinite horizon linear quadratic (LQ) mean field problems with common noise and regime switching, covering both control and game formulations. To establish a theoretical foundation for the LQ framework, we first analyze…

Optimization and Control · Mathematics 2025-11-24 Qingmeng Wei , Yaqi Xu

In this paper, we consider the mean field game with a common noise and allow the state coefficients to vary with the conditional distribution in a nonlinear way. We assume that the cost function satisfies a convexity and a weak monotonicity…

Optimization and Control · Mathematics 2021-05-26 Ziyu Huang , Shanjian Tang

This paper has two messages. First, we demonstrate that neural networks that process noisy data can learn to exploit, when available, access to auxiliary noise that is correlated with the noise on the data. In effect, the network learns to…

Quantum Physics · Physics 2020-09-17 Aida Ahmadzadegan , Petar Simidzija , Ming Li , Achim Kempf

In the literature on game-theoretic equilibrium finding, focus has mainly been on solving a single game in isolation. In practice, however, strategic interactions -- ranging from routing problems to online advertising auctions -- evolve…

Computer Science and Game Theory · Computer Science 2023-03-02 Keegan Harris , Ioannis Anagnostides , Gabriele Farina , Mikhail Khodak , Zhiwei Steven Wu , Tuomas Sandholm

In this paper we consider extended stationary mean field games, that is mean-field games which depend on the velocity field of the players. We prove various a-priori estimates which generalize the results for quasi-variational mean field…

Analysis of PDEs · Mathematics 2013-05-14 Diogo A. Gomes , Stefania Patrizi , Vardan Voskanyan

We study an ergodic mean field game problem with state constraints. In our model the agents are affected by idiosyncratic noise and use a (singular) feedback control to prevent the Brownian motion from exiting the domain. We characterize…

Analysis of PDEs · Mathematics 2023-10-05 Alessio Porretta , Michele Ricciardi