English
Related papers

Related papers: A Digital Twin-based Multi-Agent Reinforcement Lea…

200 papers

This work introduces a novel value decomposition algorithm, termed \textit{Dynamic Deep Factor Graphs} (DDFG). Unlike traditional coordination graphs, DDFG leverages factor graphs to articulate the decomposition of value functions, offering…

Robotics · Computer Science 2024-06-10 Yuchen Shi , Shihong Duan , Cheng Xu , Ran Wang , Fangwen Ye , Chau Yuen

We present Distributed Deep Deterministic Policy Gradient (3DPG), a multi-agent actor-critic (MAAC) algorithm for Markov games. Unlike previous MAAC algorithms, 3DPG is fully distributed during both training and deployment. 3DPG agents…

Machine Learning · Computer Science 2022-11-03 Adrian Redder , Arunselvan Ramaswamy , Holger Karl

The strong dynamic coupling between the manipulator and the base poses a significant challenge to maintaining spacecraft attitude stability, potentially compromising mission safety. In this paper, we propose a Dual-Agent Coordinated…

Robotics · Computer Science 2026-05-26 Yuhui Hu , Dong Zhou , Kaihong Ouyang , Zhongliang Yu , Jianfeng Lv , Xiangyu Shao

The electrification of transportation and the increased adoption of decentralized renewable energy generation have added complexity to managing Renewable Energy Communities (RECs). Integrating Electric Vehicle (EV) charging with building…

Systems and Control · Electrical Eng. & Systems 2025-05-26 Tiago Fonseca , Clarisse Sousa , Ricardo Venâncio , Pedro Pires , Ricardo Severino , Paulo Rodrigues , Pedro Paiva , Luis Lino Ferreira

Deep Reinforcement Learning (DRL) is regarded as a potential method for car-following control and has been mostly studied to support a single following vehicle. However, it is more challenging to learn a stable and efficient car-following…

Systems and Control · Electrical Eng. & Systems 2022-11-21 Tong Liu , Lei Lei , Kan Zheng , Kuan Zhang

Although robotic applications increasingly demand versatile and dynamic object handling, most existing techniques are predominantly focused on grasp-based manipulation, limiting their applicability in non-prehensile tasks. To address this…

Robotics · Computer Science 2025-02-25 Hamidreza Raei , Elena De Momi , Arash Ajoudani

Automated control of personalized multiple anesthetics in clinical Total Intravenous Anesthesia (TIVA) is crucial yet challenging. Current systems, including target-controlled infusion (TCI) and closed-loop systems, either rely on…

Systems and Control · Electrical Eng. & Systems 2025-08-15 Huijie Li , Yide Yu , Si Shi , Anmin Hu , Jian Huo , Wei Lin , Chaoran Wu , Wuman Luo

This paper studies the leader-following consensuses of uncertain and nonlinear multi-agent systems against composite attacks (CAs), including Denial of Service (DoS) attacks and actuation attacks (AAs). A double-layer control framework is…

Systems and Control · Electrical Eng. & Systems 2023-03-24 Xin Gong , Jintao Peng , Dong Yang , Zhan Shu , Tingwen Huang , Yukang Cui

Current approaches to multi-agent cooperation rely heavily on centralized mechanisms or explicit communication protocols to ensure convergence. This paper studies the problem of distributed multi-agent learning without resorting to…

Multiagent Systems · Computer Science 2025-08-19 Caroline Wang , Ishan Durugkar , Elad Liebman , Peter Stone

This paper explores the method of achieving autonomous navigation of unmanned vehicles through Deep Reinforcement Learning (DRL). The focus is on using the Deep Deterministic Policy Gradient (DDPG) algorithm to address issues in…

Robotics · Computer Science 2024-07-30 Letian Xu , Jiabei Liu , Haopeng Zhao , Tianyao Zheng , Tongzhou Jiang , Lipeng Liu

Multiagent reinforcement learning, as a prominent intelligent paradigm, enables collaborative decision-making within complex systems. However, existing approaches often rely on explicit action exchange between agents to evaluate action…

Robotics · Computer Science 2026-01-09 Zhenglong Luo , Zhiyong Chen , Aoxiang Liu

In the era of Internet of Things (IoT), Digital Twin (DT) is envisioned to empower various areas as a bridge between physical objects and the digital world. Through virtualization and simulation techniques, multiple functions can be…

Machine Learning · Computer Science 2023-07-14 Ziru Zhang , Xuling Zhang , Guangzhi Zhu , Yuyang Wang , Pan Hui

This paper addresses the cooperative Multi-Vehicle Dynamic Pickup and Delivery Problem with Stochastic Requests (MVDPDPSR) and proposes an end-to-end centralized decision-making framework based on sequence-to-sequence, named Multi-Agent…

Machine Learning · Computer Science 2025-12-18 Zengyu Zou , Jingyuan Wang , Yixuan Huang , Junjie Wu

In this paper, to deal with the heterogeneity in federated learning (FL) systems, a knowledge distillation (KD) driven training framework for FL is proposed, where each user can select its neural network model on demand and distill…

Machine Learning · Computer Science 2023-03-14 Xiucheng Wang , Nan Cheng , Longfei Ma , Ruijin Sun , Rong Chai , Ning Lu

This paper aims to mitigate straggler effects in synchronous distributed learning for multi-agent reinforcement learning (MARL) problems. Stragglers arise frequently in a distributed learning system, due to the existence of various system…

Machine Learning · Computer Science 2021-01-08 Baoqian Wang , Junfei Xie , Nikolay Atanasov

In hybrid traffic environments where human-driven vehicles (HDVs) and autonomous vehicles (AVs) coexist, achieving safe and robust decision-making for AV platooning remains a complex challenge. Existing platooning systems often struggle…

Robotics · Computer Science 2026-04-07 Chengkai Xu , Zihao Deng , Jiaqi Liu , Aijing Kong , Yu Tang , Chao Huang , Peng Hang

This paper introduces a sensor steering methodology based on deep reinforcement learning to enhance the predictive accuracy and decision support capabilities of digital twins by optimising the data acquisition process. Traditional sensor…

Machine Learning · Statistics 2025-05-27 Collins O. Ogbodo , Timothy J. Rogers , Mattia Dal Borgo , David J. Wagg

Deep learning has enabled traditional reinforcement learning methods to deal with high-dimensional problems. However, one of the disadvantages of deep reinforcement learning methods is the limited exploration capacity of learning agents. In…

Machine Learning · Computer Science 2019-07-30 Thanh Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Maze navigation is a fundamental challenge in robotics, requiring agents to traverse complex environments efficiently. While the Deep Deterministic Policy Gradient (DDPG) algorithm excels in control tasks, its performance in maze navigation…

Robotics · Computer Science 2025-08-08 Wenjie Hu , Ye Zhou , Hann Woei Ho

In order to collaborate efficiently with unknown partners in cooperative control settings, adaptation of the partners based on online experience is required. The rather general and widely applicable control setting, where each cooperation…

Multiagent Systems · Computer Science 2019-10-30 Florian Köpf , Samuel Tesfazgi , Michael Flad , Sören Hohmann