English
Related papers

Related papers: Beyond Rewards: a Hierarchical Perspective on Offl…

200 papers

We study the problem of designing autonomous agents that can learn to cooperate effectively with a potentially suboptimal partner while having no access to the joint reward function. This problem is modeled as a cooperative episodic…

Machine Learning · Computer Science 2022-06-14 Thomas Kleine Buening , Anne-Marie George , Christos Dimitrakakis

Game-theoretic solution concepts, such as the Nash equilibrium, have been key to finding stable joint actions in multi-player games. However, it has been shown that the dynamics of agents' interactions, even in simple two-player games with…

Multiagent Systems · Computer Science 2025-05-20 Natalia Koliou , George Vouros

Generating competitive strategies and performing continuous motion planning simultaneously in an adversarial setting is a challenging problem. In addition, understanding the intent of other agents is crucial to deploying autonomous systems…

Robotics · Computer Science 2023-10-12 Hongrui Zheng , Zhijun Zhuang , Johannes Betz , Rahul Mangharam

Economic ensembles can be modeled as networks of interacting agents whose be-haviors are described in terms of game theory. The evolutionary paradigm has been applied to two-person games to discover strategies in this context.…

Condensed Matter · Physics 2007-05-23 Wan Ahmad Tajuddin Wan Abdullah

Real Time Strategy (RTS) games require macro strategies as well as micro strategies to obtain satisfactory performance since it has large state space, action space, and hidden information. This paper presents a novel hierarchical…

Machine Learning · Computer Science 2019-06-24 Zhijian Zhang , Haozheng Li , Luo Zhang , Tianyin Zheng , Ting Zhang , Xiong Hao , Xiaoxin Chen , Min Chen , Fangxu Xiao , Wei Zhou

It is common to make a distinction between "strategic" behavior and other forms of intentional but "nonstrategic" behavior: typically, that strategic agents model other agents while nonstrategic agents do not. However, a crisp boundary…

Computer Science and Game Theory · Computer Science 2025-02-12 James R. Wright , Kevin Leyton-Brown

To promote cooperation in Multi-Agent Reinforcement Learning, the reward signals of all agents can be aggregated together, forming global rewards that are commonly known as the fully cooperative setting. However, global rewards are usually…

Machine Learning · Computer Science 2026-01-30 Bang Giang Le , Viet Cuong Ta

When should we encourage specialization in multi-agent systems versus train generalists that perform the entire task independently? We propose that specialization largely depends on task parallelizability: the potential for multiple agents…

Consider the following instance of the Offline Meta Reinforcement Learning (OMRL) problem: given the complete training logs of $N$ conventional RL agents, trained on $N$ different tasks, design a meta-agent that can quickly maximize reward…

Machine Learning · Computer Science 2021-02-15 Ron Dorfman , Idan Shenfeld , Aviv Tamar

Recent developments in deep reinforcement learning are concerned with creating decision-making agents which can perform well in various complex domains. A particular approach which has received increasing attention is multi-agent…

Machine Learning · Computer Science 2019-06-13 Georgios Papoudakis , Filippos Christianos , Arrasy Rahman , Stefano V. Albrecht

One of the key challenges for multi-agent learning is scalability. In this paper, we introduce a technique for speeding up multi-agent learning by exploiting concurrent and incremental experience sharing. This solution adaptively identifies…

Multiagent Systems · Computer Science 2017-03-07 Dan Garant , Bruno da Silva , Victor Lesser , Chongjie Zhang

This work presents a Hierarchical Multi-Agent Reinforcement Learning framework for analyzing simulated air combat scenarios involving heterogeneous agents. The objective is to identify effective Courses of Action that lead to mission…

Artificial Intelligence · Computer Science 2025-05-15 Ardian Selmonaj , Oleg Szehr , Giacomo Del Rio , Alessandro Antonucci , Adrian Schneider , Michael Rüegsegger

Multiagent learning settings are inherently more difficult than single-agent learning because each agent interacts with other simultaneously learning agents in a shared environment. An effective approach in multiagent reinforcement learning…

Computer Science and Game Theory · Computer Science 2022-10-31 Dong-Ki Kim , Matthew Riemer , Miao Liu , Jakob N. Foerster , Gerald Tesauro , Jonathan P. How

In this work we create agents that can perform well beyond a single, individual task, that exhibit much wider generalisation of behaviour to a massive, rich space of challenges. We define a universe of tasks within an environment domain and…

Modern AI systems increasingly operate inside markets and institutions where data, behavior, and incentives are endogenous. This paper develops an economic foundation for multi-agent learning by studying a principal-agent interaction in a…

Machine Learning · Statistics 2026-01-08 Nassim Helou

Deep reinforcement learning for multi-agent cooperation and competition has been a hot topic recently. This paper focuses on cooperative multi-agent problem based on actor-critic methods under local observations settings. Multi agent deep…

Artificial Intelligence · Computer Science 2017-10-04 Xiangxiang Chu , Hangjun Ye

We propose a technology-agnostic, collaboration-ready stance for Human-AI Agents Collaboration Systems (HAACS) that closes long-standing gaps in prior stages (automation; flexible autonomy; agentic multi-agent collectives). Reading…

Artificial Intelligence · Computer Science 2025-10-10 Ju Wu , Calvin K. L. Or

Motivated by the control theoretic distinction between controllable and uncontrollable events, we distinguish between two types of agents within a multi-agent system: controllable agents, which are directly controlled by the system's…

Artificial Intelligence · Computer Science 2014-11-17 R. I. Brafman , M. Tennenholtz

We review existing approaches to mathematical modeling and analysis of multi-agent systems in which complex collective behavior arises out of local interactions between many simple agents. Though the behavior of an individual agent can be…

Robotics · Computer Science 2007-05-23 Kristina Lerman , Aram Galstyan , Tad Hogg

Many real-world multi-agent interactions consider multiple distinct criteria, i.e. the payoffs are multi-objective in nature. However, the same multi-objective payoff vector may lead to different utilities for each participant. Therefore,…

Multiagent Systems · Computer Science 2020-11-17 Roxana Rădulescu , Timothy Verstraeten , Yijie Zhang , Patrick Mannion , Diederik M. Roijers , Ann Nowé