English

Multi-Task Optimization over Networks of Tasks

Machine Learning 2026-04-27 v1 Artificial Intelligence Neural and Evolutionary Computing

Abstract

Multi-task optimization is a powerful approach for solving a large number of tasks in parallel. However, existing algorithms face distinct limitations: Population-based methods scale poorly and remain underexplored for large task sets. Approaches that do scale beyond a thousand tasks are mostly MAP-Elites variants and rely on a fixed, discretized archive that disregards the topology of the task space. We introduce MONET (Multi-Task Optimization over Networks of Tasks), a multi-task optimization algorithm that models the task space as a graph: tasks are nodes, and edges connect tasks in the task parameter space. This representation enables knowledge transfer between tasks and remains tractable for high-dimensional problems while exploiting the topology of the task space. MONET combines social learning, which generates candidates from neighboring nodes via crossover, with individual learning, which refines a node's own solution independently via mutation. We evaluate MONET on four domains (archery, arm, and cartpole with 5,000 tasks each; hexapod with 2,000 tasks) and show that it matches or exceeds the performance of existing MAP-Elites-based baselines across all four domains.

Keywords

Cite

@article{arxiv.2604.21991,
  title  = {Multi-Task Optimization over Networks of Tasks},
  author = {Julian Hatzky and Thomas Bartz-Beielstein and A. E. Eiben and Anil Yaman},
  journal= {arXiv preprint arXiv:2604.21991},
  year   = {2026}
}

Comments

14 pages, 5 figures

R2 v1 2026-07-01T12:32:59.055Z