English
Related papers

Related papers: Message-Dropout: An Efficient Training Method for …

200 papers

Dropout is known as an effective way to reduce overfitting via preventing co-adaptations of units. In this paper, we theoretically prove that the co-adaptation problem still exists after using dropout due to the correlations among the…

Computation and Language · Computer Science 2019-08-07 Shen Li , Chenhao Su , Renfen Hu , Zhengdong Lu

We study a multi-agent reinforcement learning dynamics, and analyze its asymptotic behavior in infinite-horizon discounted Markov potential games. We focus on the independent and decentralized setting, where players do not know the game…

Machine Learning · Computer Science 2025-04-02 Chinmay Maheshwari , Manxi Wu , Druv Pai , Shankar Sastry

Deep reinforcement learning (RL) has recently shown great promise in robotic continuous control tasks. Nevertheless, prior research in this vein center around the centralized learning setting that largely relies on the communication…

Artificial Intelligence · Computer Science 2021-12-30 Dongge Han , Chris Xiaoxuan Lu , Tomasz Michalak , Michael Wooldridge

Cooperative multi-robot teams need to be able to explore cluttered and unstructured environments while dealing with communication dropouts that prevent them from exchanging local information to maintain team coordination. Therefore, robots…

Robotics · Computer Science 2024-02-27 Aaron Hao Tan , Federico Pizarro Bejarano , Yuhan Zhu , Richard Ren , Goldie Nejat

This paper targets at the problem of radio resource management for expected long-term delay-power tradeoff in vehicular communications. At each decision epoch, the road side unit observes the global network state, allocates channels and…

Signal Processing · Electrical Eng. & Systems 2019-06-04 Xianfu Chen , Celimuge Wu , Honggang Zhang , Yan Zhang , Mehdi Bennis , Heli Vuojala

Dialogue policy learning for task-oriented dialogue systems has enjoyed great progress recently mostly through employing reinforcement learning methods. However, these approaches have become very sophisticated. It is time to re-evaluate it.…

Computation and Language · Computer Science 2020-09-22 Ziming Li , Julia Kiseleva , Maarten de Rijke

Most prior works on communication in multi-agent reinforcement learning have focused on emergent communication, which often results in inefficient and non-interpretable systems. Inspired by the role of language in natural intelligence, we…

Multiagent Systems · Computer Science 2025-08-08 Maxime Toquebiau , Jae-Yun Jun , Faïz Benamar , Nicolas Bredeche

Recent studies in multi-agent communicative reinforcement learning (MACRL) have demonstrated that multi-agent coordination can be greatly improved by allowing communication between agents. Meanwhile, adversarial machine learning (ML) has…

Machine Learning · Computer Science 2022-01-27 Wanqi Xue , Wei Qiu , Bo An , Zinovi Rabinovich , Svetlana Obraztsova , Chai Kiat Yeo

Many strategic decision-making problems, such as environment design for warehouse robots, can be naturally formulated as bi-level reinforcement learning (RL), where a leader agent optimizes its objective while a follower solves a Markov…

Machine Learning · Computer Science 2026-04-01 Mikoto Kudo , Takumi Tanabe , Akifumi Wachi , Youhei Akimoto

Distributed learning and adaptation have received significant interest and found wide-ranging applications in machine learning and signal processing. While various approaches, such as shared-memory optimization, multi-task learning, and…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Pourya Behmandpoor , Marc Moonen , Panagiotis Patrinos

Adversarial training has been proven to be a powerful regularization method to improve the generalization of models. However, current adversarial training methods only attack the original input sample or the embedding vectors, and their…

Machine Learning · Computer Science 2021-08-31 Shiwen Ni , Jiawen Li , Hung-Yu Kao

Transmission switching is a well-established approach primarily applied to minimize operational costs through strategic network reconfiguration. However, exclusive focus on cost reduction can compromise system reliability. While…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Ding Lin , Jianhui Wang , Tianqiao Zhao , Meng Yue

Dropout is a powerful and widely used technique to regularize the training of deep neural networks. In this paper, we introduce a simple regularization strategy upon dropout in model training, namely R-Drop, which forces the output…

Machine Learning · Computer Science 2021-11-01 Xiaobo Liang , Lijun Wu , Juntao Li , Yue Wang , Qi Meng , Tao Qin , Wei Chen , Min Zhang , Tie-Yan Liu

Dropout, a simple and effective way to train deep neural networks, has led to a number of impressive empirical successes and spawned many recent theoretical investigations. However, the gap between dropout's training and inference phases,…

Machine Learning · Computer Science 2017-02-17 Xuezhe Ma , Yingkai Gao , Zhiting Hu , Yaoliang Yu , Yuntian Deng , Eduard Hovy

This paper addresses the load restoration problem after power outage events. Our primary proposed methodology is using multi-agent deep reinforcement learning to optimize the load restoration process in distribution systems, modeled as…

Systems and Control · Electrical Eng. & Systems 2024-01-25 Linh Vu , Tuyen Vu , Thanh-Long Vu , Anurag Srivastava

As machine learning models become more capable, they have exhibited increased potential in solving complex tasks. One of the most promising directions uses deep reinforcement learning to train autonomous agents in computer network defense…

Machine Learning · Computer Science 2023-10-23 Elizabeth Bates , Vasilios Mavroudis , Chris Hicks

Communication is an important factor for the big multi-agent world to stay organized and productive. Recently, the AI community has applied the Deep Reinforcement Learning (DRL) to learn the communication strategy and the control policy for…

Multiagent Systems · Computer Science 2019-03-14 Hangyu Mao , Zhibo Gong , Zhengchao Zhang , Zhen Xiao , Yan Ni

Cooperative problems under continuous control have always been the focus of multi-agent reinforcement learning. Existing algorithms suffer from the problem of uneven learning degree with the increase of the number of agents. In this paper,…

Multiagent Systems · Computer Science 2021-07-05 Kai Liu , Yuyang Zhao , Gang Wang , Bei Peng

The objective of meta-learning is to exploit the knowledge obtained from observed tasks to improve adaptation to unseen tasks. As such, meta-learners are able to generalize better when they are trained with a larger number of observed tasks…

Machine Learning · Computer Science 2022-10-11 Mert Kayaalp , Stefan Vlaski , Ali H. Sayed

In this paper we take the first steps in studying a new approach to synthesis of efficient communication schemes in multi-agent systems, trained via reinforcement learning. We combine symbolic methods with machine learning, in what is…

Artificial Intelligence · Computer Science 2022-12-29 Erik Jergéus , Leo Karlsson Oinonen , Emil Carlsson , Moa Johansson