English
Related papers

Related papers: Equivariant Networks for Zero-Shot Coordination

200 papers

This paper presents an algorithm for the synchronization of blind agents (agents are unable to observe other agents, i.e. no communication) evolving on a connected Lie group $G$. We employ the method of extremum seeking control for…

Optimization and Control · Mathematics 2015-12-16 Farzin Taringoo

This work develops novel strategies for optimal planning with semantic observations using continuous state partially observable markov decision processes (CPOMDPs). Two major innovations are presented in relation to Gaussian mixture (GM)…

Artificial Intelligence · Computer Science 2019-08-09 Luke Burks , Ian Loefgren , Nisar Ahmed

Equivariant neural networks have shown great success in reinforcement learning, improving sample efficiency and generalization when there is symmetry in the task. However, in many problems, only approximate symmetry is present, which makes…

Machine Learning · Computer Science 2025-04-24 Jung Yeon Park , Sujay Bhatt , Sihan Zeng , Lawson L. S. Wong , Alec Koppel , Sumitra Ganesh , Robin Walters

Synchronization and desynchronization in networks is a highly studied topic in many electrical systems, but there is a distinct lack of research on this topic with respect to robotics. Creating an effective decentralized synchronization…

Systems and Control · Electrical Eng. & Systems 2024-07-09 Martyn Lemon , Yongqiang Wang

Zero-shot coordination (ZSC) remains a major challenge in the cooperative AI field, which aims to learn an agent to cooperate with an unseen partner in training environments or even novel environments. In recent years, a popular ZSC…

Artificial Intelligence · Computer Science 2024-08-09 Yin Gu , Qi Liu , Zhi Li , Kai Zhang

Equivariant neural networks (ENNs) have been shown to be extremely effective in applications involving underlying symmetries. By construction ENNs cannot produce lower symmetry outputs given a higher symmetry input. However, symmetry…

Machine Learning · Computer Science 2024-11-15 YuQing Xie , Tess Smidt

We study decentralized equilibrium selection in stochastic games under severe information and communication constraints. In such settings, convergence to equilibrium alone is insufficient, as stochastic games typically admit many equilibria…

Computer Science and Game Theory · Computer Science 2026-02-16 Seref Taha Kiremitci , Ahmed Said Donmez , Muhammed O. Sayin

This paper aims at coordinating interconnected agents where the control input of each agent is limited by the control input of others. In that sense, the systems have to share a limited resource over a network. Such problems can arise in…

Systems and Control · Electrical Eng. & Systems 2023-08-07 Felix Agner , Pauline Kergus , Anders Rantzer , Sophie Tarbouriech , Luca Zaccarian

Decentralized planning in uncertain environments is a complex task generally dealt with by using a decision-theoretic approach, mainly through the framework of Decentralized Partially Observable Markov Decision Processes (DEC-POMDPs).…

Artificial Intelligence · Computer Science 2014-01-17 Raghav Aras , Alain Dutech

Partial observability is a common challenge in many reinforcement learning applications, which requires an agent to maintain memory, infer latent states, and integrate this past information into exploration. This challenge leads to a number…

Machine Learning · Computer Science 2020-10-27 Chi Jin , Sham M. Kakade , Akshay Krishnamurthy , Qinghua Liu

We study the problem of managing handoffs (HOs) in user-centric cell-free massive MIMO (UC-mMIMO) networks. Motivated by the importance of controlling the number of HOs and by the correlation between efficient HO decisions and the temporal…

Information Theory · Computer Science 2024-03-15 Hussein A. Ammar , Raviraj Adve , Shahram Shahbazpanahi , Gary Boudreau , Kothapalli Venkata Srinivas

In collaborative tasks, autonomous agents fall short of humans in their capability to quickly adapt to new and unfamiliar teammates. We posit that a limiting factor for zero-shot coordination is the lack of shared task abstractions, a…

Multiagent Systems · Computer Science 2025-05-08 Stéphane Aroca-Ouellette , Miguel Aroca-Ouellette , Katharina von der Wense , Alessandro Roncone

Many current large-scale multiagent team implementations can be characterized as following the belief-desire-intention (BDI) paradigm, with explicit representation of team plans. Despite their promise, current BDI team approaches lack tools…

Multiagent Systems · Computer Science 2011-09-13 R. Nair , M. Tambe

This paper is concerned with the leader-following output consensus problem in the framework of distributed nonlinear observers. In stead of certain hypotheses on the leader system, a group of geometric conditions is put forward to develop a…

Optimization and Control · Mathematics 2020-07-09 Haotian Xu , Jingcheng Wang , Bohui Wang , Hongyuan Wang , Ibrahim Brahmia

In dynamic collaborative settings, for artificial intelligence (AI) agents to better align with humans, they must adapt to novel teammates who utilise unforeseen strategies. While adaptation is often simple for humans, it can be challenging…

Machine Learning · Computer Science 2025-04-22 Ravi Hammond , Dustin Craggs , Mingyu Guo , Jakob Foerster , Ian Reid

We present an online planning framework and a new benchmark dataset for solving multi-object rearrangement problems in partially observable, multi-room environments. Current object rearrangement solutions, primarily based on Reinforcement…

Machine Learning · Computer Science 2025-08-27 Rajesh Mangannavar , Alan Fern , Prasad Tadepalli

Partially-Observable Markov Decision Processes (POMDPs) are typically solved by finding an approximate global solution to a corresponding belief-MDP. In this paper, we offer a new planning algorithm for POMDPs with continuous state, action…

Artificial Intelligence · Computer Science 2012-03-19 Tom Erez , William D. Smart

This paper introduces an end-to-end fine-tuning method to improve hand-eye coordination in modular deep visuo-motor policies (modular networks) where each module is trained independently. Benefiting from weighted losses, the fine-tuning…

Robotics · Computer Science 2017-05-16 Fangyi Zhang , Jürgen Leitner , Michael Milford , Peter I. Corke

This article presents the state-of-the-art in optimal solution methods for decentralized partially observable Markov decision processes (Dec-POMDPs), which are general models for collaborative multiagent planning under uncertainty. Building…

Artificial Intelligence · Computer Science 2014-02-05 Frans Adriaan Oliehoek , Matthijs T. J. Spaan , Christopher Amato , Shimon Whiteson

We present an A*-based algorithm to compute policies for finite-horizon Dec-POMDPs. Our goal is to sacrifice optimality in favor of scalability for larger horizons. The main ingredients of our approach are (1) using clustered sliding window…

Artificial Intelligence · Computer Science 2024-05-10 Wietze Koops , Sebastian Junges , Nils Jansen