English
Related papers

Related papers: Convergence of Learning Dynamics in Information Re…

200 papers

Learning in games discusses the processes where multiple players learn their optimal strategies through the repetition of game plays. The dynamics of learning between two players in zero-sum games, such as Matching Pennies, where their…

Computer Science and Game Theory · Computer Science 2025-03-06 Yuma Fujimoto , Kaito Ariu , Kenshi Abe

We study the quality of outcomes in repeated games when the population of players is dynamically changing and participants use learning algorithms to adapt to the changing environment. Game theory classically considers Nash equilibria of…

Computer Science and Game Theory · Computer Science 2020-05-25 Thodoris Lykouris , Vasilis Syrgkanis , Eva Tardos

We study the repeated congestion game, in which multiple populations of players share resources, and make, at each iteration, a decentralized decision on which resources to utilize. We investigate the following question: given a model of…

Machine Learning · Computer Science 2014-08-04 Walid Krichene , Benjamin Drighès , Alexandre M. Bayen

Search and recommendation ecosystems exhibit competition among content creators. This competition has been tackled in a variety of game-theoretic frameworks. Content creators generate documents with the aim of being recommended by a content…

Computer Science and Game Theory · Computer Science 2024-12-23 Haya Nachimovsky , Moshe Tennenholtz

We investigate a class of reinforcement learning dynamics where players adjust their strategies based on their actions' cumulative payoffs over time - specifically, by playing mixed strategies that maximize their expected cumulative payoff…

Optimization and Control · Mathematics 2016-02-10 Panayotis Mertikopoulos , William H. Sandholm

In game-theoretic learning, several agents are simultaneously following their individual interests, so the environment is non-stationary from each player's perspective. In this context, the performance of a learning algorithm is often…

Computer Science and Game Theory · Computer Science 2021-10-19 Yu-Guan Hsieh , Kimon Antonakopoulos , Panayotis Mertikopoulos

A recent body of experimental literature has studied empirical game-theoretical analysis, in which we have partial knowledge of a game, consisting of observations of a subset of the pure-strategy profiles and their associated payoffs to…

Computer Science and Game Theory · Computer Science 2014-02-13 John Fearnley , Martin Gairing , Paul Goldberg , Rahul Savani

We study convergence rates of random-order best-response dynamics in games on networks with linear best responses and strategic substitutes. Combining formal analysis with numerical simulations we identify phenomena that lead to slow…

Computer Science and Game Theory · Computer Science 2026-02-19 Wojciech Misiak , Marcin Dziubiński

When learning in strategic environments, a key question is whether agents can overcome uncertainty about their preferences to achieve outcomes they could have achieved absent any uncertainty. Can they do this solely through interactions…

Computer Science and Game Theory · Computer Science 2024-11-21 Nivasini Ananthakrishnan , Nika Haghtalab , Chara Podimata , Kunhe Yang

Text retrieval plays a crucial role in incorporating factual knowledge for decision making into language processing pipelines, ranging from chat-based web search to question answering systems. Current state-of-the-art text retrieval models…

Computation and Language · Computer Science 2024-11-26 Ge Gao , Jonathan D. Chang , Claire Cardie , Kianté Brantley , Thorsten Joachim

Motivated by the scarcity of accurate payoff feedback in practical applications of game theory, we examine a class of learning dynamics where players adjust their choices based on past payoff observations that are subject to noise and…

Optimization and Control · Mathematics 2016-06-03 Mario Bravo , Panayotis Mertikopoulos

We analyze the performance of the best-response dynamic across all normal-form games using a random games approach. The playing sequence -- the order in which players update their actions -- is essentially irrelevant in determining whether…

Theoretical Economics · Economics 2022-11-18 Torsten Heinrich , Yoojin Jang , Luca Mungo , Marco Pangallo , Alex Scott , Bassel Tarbush , Samuel Wiese

For ambiguous queries, conventional retrieval systems are bound by two conflicting goals. On the one hand, they should diversify and strive to present results for as many query intents as possible. On the other hand, they should provide…

Information Retrieval · Computer Science 2015-03-19 Karthik Raman , Thorsten Joachims , Pannaga Shivaswamy

The convergence properties of learning dynamics in repeated auctions is a timely and important question, with numerous applications in, e.g., online advertising markets. This work focuses on repeated first-price auctions where bidders with…

Computer Science and Game Theory · Computer Science 2025-08-21 Xiaotie Deng , Xinyan Hu , Tao Lin , Weiqiang Zheng

Game theory is widely used as a behavioral model for strategic interactions in biology and social science. It is common practice to assume that players quickly converge to an equilibrium, e.g. a Nash equilibrium. This can be studied in…

Physics and Society · Physics 2018-09-20 Marco Pangallo , Torsten Heinrich , J Doyne Farmer

This work focuses on the entropy-regularized independent natural policy gradient (NPG) algorithm in multi-agent reinforcement learning. In this work, agents are assumed to have access to an oracle with exact policy evaluation and seek to…

Machine Learning · Computer Science 2024-05-07 Youbang Sun , Tao Liu , P. R. Kumar , Shahin Shahrampour

Real-world games, which concern imperfect information, multiple players, and simultaneous moves, are less frequently discussed in the existing literature of game theory. While reinforcement learning (RL) provides a general framework to…

Computer Science and Game Theory · Computer Science 2023-06-02 Runyu Lu , Yuanheng Zhu , Dongbin Zhao

Reinforcement learning from self-play has recently reported many successes. Self-play, where the agents compete with themselves, is often used to generate training data for iterative policy improvement. In previous work, heuristic rules are…

Machine Learning · Computer Science 2020-09-15 Yuanyi Zhong , Yuan Zhou , Jian Peng

In this work, we study the interaction of strategic agents in continuous action Cournot games with limited information feedback. Cournot game is the essential market model for many socio-economic systems where agents learn and compete…

Optimization and Control · Mathematics 2020-09-15 Yuanyuan Shi , Baosen Zhang

In this paper, we study jointly query reformulation and document relevance estimation, the two essential aspects of information retrieval (IR). Their interactions are modelled as a two-player strategic game: one player, a query formulator,…

Information Retrieval · Computer Science 2018-07-23 Shihao Zou , Guanyu Tao , Jun Wang , Weinan Zhang , Dell Zhang