English
Related papers

Related papers: Multi-Head Attention Is a Multi-Player Game

200 papers

We consider model-based multi-agent reinforcement learning, where the environment transition model is unknown and can only be learned via expensive interactions with the environment. We propose H-MARL (Hallucinated Multi-Agent Reinforcement…

Machine Learning · Computer Science 2022-07-12 Pier Giuseppe Sessa , Maryam Kamgarpour , Andreas Krause

Self-play methods have demonstrated remarkable success in enhancing model capabilities across various domains. In the context of Reinforcement Learning from Human Feedback (RLHF), self-play not only boosts Large Language Model (LLM)…

Computation and Language · Computer Science 2025-04-22 Mingzhi Wang , Chengdong Ma , Qizhi Chen , Linjian Meng , Yang Han , Jiancong Xiao , Zhaowei Zhang , Jing Huo , Weijie J. Su , Yaodong Yang

Coordination is one of the essential problems in multi-agent systems. Typically multi-agent reinforcement learning (MARL) methods treat agents equally and the goal is to solve the Markov game to an arbitrary Nash equilibrium (NE) when…

Multiagent Systems · Computer Science 2020-04-07 Haifeng Zhang , Weizhe Chen , Zeren Huang , Minne Li , Yaodong Yang , Weinan Zhang , Jun Wang

We present a novel algorithm for game-theoretic trajectory planning, tailored for settings in which agents can only observe one another in specific regions of the state space. Such problems arise naturally in the context of multi-robot…

Multiagent Systems · Computer Science 2024-06-18 Kushagra Gupta , David Fridovich-Keil

The generation of factually incorrect objects, commonly known as object hallucination, remains a persistent challenge in Large Vision-Language Models (LVLMs). Current approaches to address this issue - ranging from expensive data-driven…

Artificial Intelligence · Computer Science 2026-05-26 Yuanzhi Xu , Qian Gao , Jun Fan , Guohui Ding , Zhenyu Yang , Sixue Lin , Yuteng Xiao

Large language models (LLMs) often generate plausible yet incorrect answers, posing risks in safety-critical settings such as medicine. Human evaluation is expensive, and LLM-as-judge approaches risk introducing hidden errors. Recent…

The overall aim of our research is to develop techniques to reason about the equilibrium properties of multi-agent systems. We model multi-agent systems as concurrent games, in which each player is a process that is assumed to act…

Logic in Computer Science · Computer Science 2020-08-14 Julian Gutierrez , Aniello Murano , Giuseppe Perelli , Sasha Rubin , Thomas Steeples , Michael Wooldridge

We develop a macro-model of information retrieval process using Game Theory as a mathematical theory of conflicts. We represent the participants of the Information Retrieval process as a game of two abstract players. The first player is the…

Information Retrieval · Computer Science 2009-05-21 George Parfionov , Romàn Zapatrin

The effect of population heterogeneity in multi-agent learning is practically relevant but remains far from being well-understood. Motivated by this, we introduce a model of multi-population learning that allows for heterogeneous beliefs…

Multiagent Systems · Computer Science 2023-01-13 Shuyue Hu , Harold Soh , Georgios Piliouras

A central question in algorithmic game theory is to measure the inefficiency (ratio of costs) of Nash equilibria (NE) with respect to socially optimal solutions. The two established metrics used for this purpose are price of anarchy (POA)…

Data Structures and Algorithms · Computer Science 2016-11-24 Shuchi Chawla , Joseph , Naor , Debmalya Panigrahi , Mohit Singh , Seeun William Umboh

We consider multi-player graph games with partial-observation and parity objective. While the decision problem for three-player games with a coalition of the first and second players against the third player is undecidable, we present a…

Logic in Computer Science · Computer Science 2014-04-23 Krishnendu Chatterjee , Laurent Doyen

We present a general framework for evolutionary learning to emergent unbiased state representation without any supervision. Evolutionary frameworks such as self-play converge to bad local optima in case of multi-agent reinforcement learning…

Machine Learning · Statistics 2023-02-03 Shohei Ohsawa

A wide variety of goals could cause an AI to disable its off switch because "you can't fetch the coffee if you're dead" (Russell 2019). Prior theoretical work on this shutdown problem assumes that humans know everything that AIs do. In…

Computer Science and Game Theory · Computer Science 2024-12-10 Andrew Garber , Rohan Subramani , Linus Luu , Mark Bedaywi , Stuart Russell , Scott Emmons

Artificial intelligence has advanced significantly through the development of intelligent game-playing systems, providing rigorous testbeds for decision-making, strategic planning, and adaptive learning. However, resource-constrained…

Artificial Intelligence · Computer Science 2026-04-09 Tianhao Qian , Zhuoxuan Li , Jinde Cao , Xinli Shi , Leszek Rutkowski

A basic lesson from game theory is that strategic behavior often renders the equilibrium outcome inefficient. The recent literature of information design -- a.k.a. signaling or persuasion -- looks to improve equilibria by providing…

Computer Science and Game Theory · Computer Science 2020-09-29 James Nachbar , Haifeng Xu

Min-max optimization problems (i.e., min-max games) have attracted a great deal of attention recently as their applicability to a wide range of machine learning problems has become evident. In this paper, we study min-max games with…

Computer Science and Game Theory · Computer Science 2022-08-23 Denizalp Goktas , Amy Greenwald

Trust region methods are widely applied in single-agent reinforcement learning problems due to their monotonic performance-improvement guarantee at every iteration. Nonetheless, when applied in multi-agent settings, the guarantee of trust…

Multiagent Systems · Computer Science 2021-06-15 Ying Wen , Hui Chen , Yaodong Yang , Zheng Tian , Minne Li , Xu Chen , Jun Wang

Large Language Models (LLMs) often generate incorrect or unsupported content, known as hallucinations. Existing detection methods rely on heuristics or simple models over isolated computational traces such as activations, or attention maps.…

Machine Learning · Computer Science 2025-09-30 Fabrizio Frasca , Guy Bar-Shalom , Yftah Ziser , Haggai Maron

LLM agents are known to deviate from Nash equilibria in strategic interactions, but nobody has looked inside the model to understand why, or asked whether the deviation can be reversed. We do both. Working with four open-source models…

Computer Science and Game Theory · Computer Science 2026-05-05 Paraskevas V. Lekeas , Giorgos Stamatopoulos

We study a game between liquidity provider and liquidity taker agents interacting in an over-the-counter market, for which the typical example is foreign exchange. We show how a suitable design of parameterized families of reward functions…

Multiagent Systems · Computer Science 2023-08-02 Nelson Vadori , Leo Ardon , Sumitra Ganesh , Thomas Spooner , Selim Amrouni , Jared Vann , Mengda Xu , Zeyu Zheng , Tucker Balch , Manuela Veloso