English
Related papers

Related papers: Unsynchronized Decentralized Q-Learning: Two Times…

200 papers

In many real-world multi-agent cooperative tasks, due to high cost and risk, agents cannot continuously interact with the environment and collect experiences during learning, but have to learn from offline datasets. However, the transition…

Machine Learning · Computer Science 2023-08-01 Jiechuan Jiang , Zongqing Lu

We consider model-based multi-agent reinforcement learning, where the environment transition model is unknown and can only be learned via expensive interactions with the environment. We propose H-MARL (Hallucinated Multi-Agent Reinforcement…

Machine Learning · Computer Science 2022-07-12 Pier Giuseppe Sessa , Maryam Kamgarpour , Andreas Krause

Large transformer models, trained on diverse datasets, have demonstrated impressive few-shot performance on previously unseen tasks without requiring parameter updates. This capability has also been explored in Reinforcement Learning (RL),…

Multiagent Systems · Computer Science 2026-04-02 Tao Jiang , Zichuan Lin , Lihe Li , Yi-Chen Li , Cong Guan , Lei Yuan , Zongzhang Zhang , Yang Yu , Deheng Ye

This paper considers the policy evaluation problem in a multi-agent reinforcement learning (MARL) environment over decentralized and directed networks. The focus is on decentralized temporal difference (TD) learning with linear function…

Optimization and Control · Mathematics 2021-09-01 Zhaoxian Wu , Han Shen , Tianyi Chen , Qing Ling

Reconfigurable manufacturing systems (RMS) are critical for future market adjustment given their rapid adaptation to fluctuations in consumer demands, the introduction of new technological advances, and disruptions in linked supply chain…

Multiagent Systems · Computer Science 2025-11-12 Manonmani Sekar , Nasim Nezamoddini

Multi-Agent Reinforcement Learning (MARL) is an increasingly important research field that can model and control multiple large-scale autonomous systems. Despite its achievements, existing multi-agent learning methods typically involve…

Multiagent Systems · Computer Science 2023-05-25 Kailash Gogineni , Peng Wei , Tian Lan , Guru Venkataramani

The state-of-the-art multi-agent reinforcement learning (MARL) methods have provided promising solutions to a variety of complex problems. Yet, these methods all assume that agents perform synchronized primitive-action executions so that…

Artificial Intelligence · Computer Science 2022-10-12 Yuchen Xiao

Real-time dynamic scheduling is a crucial but notoriously challenging task in modern manufacturing processes due to its high decision complexity. Recently, reinforcement learning (RL) has been gaining attention as an impactful technique to…

Multiagent Systems · Computer Science 2024-09-23 Jaeyeon Jang , Diego Klabjan , Han Liu , Nital S. Patel , Xiuqi Li , Balakrishnan Ananthanarayanan , Husam Dauod , Tzung-Han Juang

Multi-agent reinforcement learning (MARL) is a widely used Artificial Intelligence (AI) technique. However, current studies and applications need to address its scalability, non-stationarity, and trustworthiness. This paper aims to review…

Artificial Intelligence · Computer Science 2024-06-07 Ziyuan Zhou , Guanjun Liu , Ying Tang

Q-learning played a foundational role in the field reinforcement learning (RL). However, TD algorithms with off-policy data, such as Q-learning, or nonlinear function approximation like deep neural networks require several additional tricks…

Machine Learning · Computer Science 2025-04-23 Matteo Gallici , Mattie Fellows , Benjamin Ellis , Bartomeu Pou , Ivan Masmitja , Jakob Nicolaus Foerster , Mario Martin

Centralized Training for Decentralized Execution where agents are trained offline in a centralized fashion and execute online in a decentralized manner, has become a popular approach in Multi-Agent Reinforcement Learning (MARL). In…

Artificial Intelligence · Computer Science 2024-08-28 Xueguang Lyu , Andrea Baisero , Yuchen Xiao , Brett Daley , Christopher Amato

Multiagent Reinforcement Learning (MARL) poses significant challenges due to the exponential growth of state and action spaces and the non-stationary nature of multiagent environments. This results in notable sample inefficiency and hinders…

Multiagent Systems · Computer Science 2025-02-27 Nikhilesh Prabhakar , Ranveer Singh , Harsha Kokel , Sriraam Natarajan , Prasad Tadepalli

Collaboration is a key challenge in distributed multi-agent reinforcement learning (MARL) environments. Learning frameworks for these decentralized systems must weigh the benefits of explicit player coordination against the communication…

Quantum Physics · Physics 2025-02-21 Alexander DeRieux , Walid Saad

Deep reinforcement learning for high dimensional, hierarchical control tasks usually requires the use of complex neural networks as functional approximators, which can lead to inefficiency, instability and even divergence in the training…

Machine Learning · Computer Science 2019-11-26 Yuguang Yang

In cooperative multi-agent reinforcement learning (MARL), combining value decomposition with actor-critic enables agents to learn stochastic policies, which are more suitable for the partially observable environment. Given the goal of…

Machine Learning · Computer Science 2023-02-13 Jiangxing Wang , Deheng Ye , Zongqing Lu

We extend trust region policy optimization (TRPO) to multi-agent reinforcement learning (MARL) problems. We show that the policy update of TRPO can be transformed into a distributed consensus optimization problem for multi-agent cases. By…

Artificial Intelligence · Computer Science 2023-08-08 Hepeng Li , Haibo He

Many real-world tasks involve multiple agents with partial observability and limited communication. Learning is challenging in these settings due to local viewpoints of agents, which perceive the world as non-stationary due to…

Machine Learning · Computer Science 2018-05-23 Shayegan Omidshafiei , Jason Pazis , Christopher Amato , Jonathan P. How , John Vian

Individual agents in a multi-agent system (MAS) may have decoupled open-loop dynamics, but a cooperative control objective usually results in coupled closed-loop dynamics thereby making the control design computationally expensive. The…

Systems and Control · Electrical Eng. & Systems 2021-03-09 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty

Multiagent reinforcement learning algorithms (MARL) have been demonstrated on complex tasks that require the coordination of a team of multiple agents to complete. Existing works have focused on sharing information between agents via…

Machine Learning · Computer Science 2019-03-18 Samir Wadhwania , Dong-Ki Kim , Shayegan Omidshafiei , Jonathan P. How

In actor-critic framework for fully decentralized multi-agent reinforcement learning (MARL), one of the key components is the MARL policy evaluation (PE) problem, where a set of $N$ agents work cooperatively to evaluate the value function…

Machine Learning · Computer Science 2024-03-26 Fnu Hairi , Zifan Zhang , Jia Liu