Compositionality of Linearly Solvable Optimal Control in Networked Multi-Agent Systems
Abstract
In this paper, we discuss the methodology of generalizing the optimal control law from learned component tasks to unlearned composite tasks on Multi-Agent Systems (MASs), by using the linearity composition principle of linearly solvable optimal control (LSOC) problems. The proposed approach achieves both the compositionality and optimality of control actions simultaneously within the cooperative MAS framework in both discrete- and continuous-time in a sample-efficient manner, which reduces the burden of re-computation of the optimal control solutions for the new task on the MASs. We investigate the application of the proposed approach on the MAS with coordination between agents. The experiments show feasible results in investigated scenarios, including both discrete and continuous dynamical systems for task generalization without resampling.
Cite
@article{arxiv.2009.13609,
title = {Compositionality of Linearly Solvable Optimal Control in Networked Multi-Agent Systems},
author = {Lin Song and Neng Wan and Aditya Gahlawat and Naira Hovakimyan and Evangelos A. Theodorou},
journal= {arXiv preprint arXiv:2009.13609},
year = {2021}
}
Comments
Accepted to the 2021 American Control Conference (ACC)