English
Related papers

Related papers: Learning Hierarchical Control For Multi-Agent Capa…

200 papers

What is a useful skill hierarchy for an autonomous agent? We propose an answer based on a graphical representation of how the interaction between an agent and its environment may unfold. Our approach uses modularity maximisation as a…

Machine Learning · Computer Science 2024-01-18 Joshua B. Evans , Özgür Şimşek

We propose a decentralized reinforcement learning solution for multi-agent shepherding of non-cohesive targets using policy-gradient methods. Our architecture integrates target-selection with target-driving through Proximal Policy…

Machine Learning · Computer Science 2025-04-04 Stefano Covone , Italo Napolitano , Francesco De Lellis , Mario di Bernardo

We present a hierarchical control approach for maneuvering an autonomous vehicle (AV) in tightly-constrained environments where other moving AVs and/or human driven vehicles are present. A two-level hierarchy is proposed: a high-level…

Robotics · Computer Science 2021-03-19 Xu Shen , Edward L. Zhu , Yvonne R. Stürz , Francesco Borrelli

Multi-connectivity involves dynamic cluster formation among distributed access points (APs) and coordinated resource allocation from these APs, highlighting the need for efficient mobility management strategies for users with…

Networking and Internet Architecture · Computer Science 2026-01-29 Irshad A. Meer , Karl-Ludwig Besser , Mustafa Ozger , Dominic Schupke , H. Vincent Poor , Cicek Cavdar

This paper presents a cloud-based learning model predictive controller that integrates three interacting components: a set of agents, which must learn to perform a finite set of tasks with the minimum possible local cost; a coordinator,…

Systems and Control · Electrical Eng. & Systems 2022-12-01 Paula Chanfreut , José María Maestre , Eduardo F. Camacho , Francesco Borrelli

A Learning Model Predictive Controller (LMPC) for iterative tasks is presented. The controller is reference-free and is able to improve its performance by learning from previous iterations. A safe set and a terminal cost function are used…

Systems and Control · Computer Science 2017-12-15 Ugo Rosolia , Francesco Borrelli

This paper presents a hierarchical reinforcement learning (RL) approach to address the agent grouping or pairing problem in cooperative multi-agent systems. The goal is to simultaneously learn the optimal grouping and agent policy. By…

Machine Learning · Computer Science 2025-01-14 Liyuan Hu

This paper develops a control-theoretic framework for analyzing agentic systems embedded within feedback control loops, where an AI agent may adapt controller parameters, select among control strategies, invoke external tools, reconfigure…

Systems and Control · Electrical Eng. & Systems 2026-03-26 Ali Eslami , Jiangbo Yu

Hierarchical Reinforcement Learning (HRL) is well-suitedd for solving complex tasks by breaking them down into structured policies. However, HRL agents often struggle with efficient exploration and quick adaptation. To overcome these…

Machine Learning · Computer Science 2025-03-18 Arash Khajooeinejad , Fatemeh Sadat Masoumi , Masoumeh Chapariniya

This paper proposes an MPC-based controller to efficiently execute multiple hierarchical tasks for underactuated and constrained robotic systems. Existing task-space controllers or whole-body controllers solve instantaneous optimization…

Robotics · Computer Science 2020-09-15 Jaemin Lee , Seung Hyeon Bang , Efstathios Bakolas , Luis Sentis

In control system networks, reconfiguration of the controller when agents are leaving or joining the network is still an open challenge, in particular when operation constraints that depend on each agent's behavior must be met. Drawing our…

Systems and Control · Electrical Eng. & Systems 2023-04-05 Danilo Saccani , Lorenzo Fagiano , Melanie N. Zeilinger , Andrea Carron

In this paper, we propose a navigation algorithm oriented to multi-agent environment. This algorithm is expressed as a hierarchical framework that contains a Hidden Markov Model (HMM) and a Deep Reinforcement Learning (DRL) structure. For…

Robotics · Computer Science 2018-07-18 Wenhao Ding , Shuaijun Li , Huihuan Qian

We propose a new reinforcement learning based approach to designing hierarchical linear quadratic regulator (LQR) controllers for heterogeneous linear multi-agent systems with unknown state-space models and separated control objectives. The…

Systems and Control · Electrical Eng. & Systems 2020-07-29 He Bai , Jemin George , Aranya Chakrabortty

A Learning Model Predictive Controller (LMPC) is presented and tailored to platooning and Connected Autonomous Vehicles (CAVs) applications. The proposed controller builds on previous work on nonlinear LMPC, adapting its architecture and…

Optimization and Control · Mathematics 2019-08-09 Hassan Jafarzadeh , Cody Fleming

For the application of MPC design in on-line regulation or tracking control problems, several studies have attempted to develop an accurate model, and realize adequate uncertainty description of linear or non-linear plants of the processes.…

Optimization and Control · Mathematics 2019-04-03 Yuanqiang Zhou , Dewei Li , Yugeng Xi , Zhongxue Gan

In most existing studies on large-scale multi-agent coordination, the control methods aim to learn discrete policies for agents with finite choices. They rarely consider selecting actions directly from continuous action spaces to provide…

Multiagent Systems · Computer Science 2022-08-24 Yining Chen , Ke Wang , Guanghua Song , Xiaohong Jiang

This paper describes a hierarchical control scheme for interconnected systems. The higher layer of the control structure is designed with robust Model Predictive Control (MPC) based on a reduced order dynamic model of the overall system and…

Systems and Control · Computer Science 2017-03-09 Marcello Farina , Xinglong Zhang , Riccardo Scattolini

For robots operating in the real world, it is desirable to learn reusable behaviours that can effectively be transferred and adapted to numerous tasks and scenarios. We propose an approach to learn abstract motor skills from data using a…

A data-based policy for iterative control task is presented. The proposed strategy is model-free and can be applied whenever safe input and state trajectories of a system performing an iterative task are available. These trajectories,…

Systems and Control · Computer Science 2019-03-22 Ugo Rosolia , Xiaojing Zhang , Francesco Borrelli

In this work, we aim to achieve efficient end-to-end learning of driving policies in dynamic multi-agent environments. Predicting and anticipating future events at the object level are critical for making informed driving decisions. We…

Robotics · Computer Science 2021-01-18 Jinkun Cao , Xin Wang , Trevor Darrell , Fisher Yu