English

Spatiotemporal Attention-Augmented Inverse Reinforcement Learning for Multi-Agent Task Allocation

Machine Learning 2026-02-10 v4 Multiagent Systems

Abstract

Adversarial inverse reinforcement learning (IRL) for multi-agent task allocation (MATA) is challenged by non-stationary interactions and high-dimensional coordination. Unconstrained reward inference in these settings often leads to high variance and poor generalization. We propose an attention-structured adversarial IRL framework that constrains reward inference via spatiotemporal representation learning. Our method employs multi-head self-attention (MHSA) for long-range temporal dependencies and graph attention networks (GAT) for agent-task relational structures. We formulate reward inference as a low-capacity, adaptive linear transformation of the environment reward, ensuring stable and interpretable guidance. This framework decouples reward inference from policy learning and optimizes the reward model adversarially. Experiments on benchmark MATA scenarios show that our approach outperforms representative MARL baselines in convergence speed, cumulative rewards, and spatial efficiency. Results demonstrate that attention-guided, capacity-constrained reward inference is a scalable and effective mechanism for stabilizing adversarial IRL in complex multi-agent systems.

Keywords

Cite

@article{arxiv.2504.05045,
  title  = {Spatiotemporal Attention-Augmented Inverse Reinforcement Learning for Multi-Agent Task Allocation},
  author = {Huilin Yin and Zhikun Yang and Linchuan Zhang and Daniel Watzenig},
  journal= {arXiv preprint arXiv:2504.05045},
  year   = {2026}
}

Comments

Revised version with substantial new experimental results, improved analysis, and a restructured layout for better clarity

R2 v1 2026-06-28T22:49:23.602Z