English
Related papers

Related papers: A finite time analysis of distributed Q-learning

200 papers

The recent success of single-agent reinforcement learning (RL) in Internet of things (IoT) systems motivates the study of multi-agent reinforcement learning (MARL), which is more challenging but more useful in large-scale IoT. In this…

Machine Learning · Computer Science 2020-09-01 Yue Xu , Zengde Deng , Mengdi Wang , Wenjun Xu , Anthony Man-Cho So , Shuguang Cui

Real-time dynamic scheduling is a crucial but notoriously challenging task in modern manufacturing processes due to its high decision complexity. Recently, reinforcement learning (RL) has been gaining attention as an impactful technique to…

Multiagent Systems · Computer Science 2024-09-23 Jaeyeon Jang , Diego Klabjan , Han Liu , Nital S. Patel , Xiuqi Li , Balakrishnan Ananthanarayanan , Husam Dauod , Tzung-Han Juang

Multi-agent reinforcement learning (MARL) algorithms often suffer from an exponential sample complexity dependence on the number of agents, a phenomenon known as \emph{the curse of multiagents}. In this paper, we address this challenge by…

Machine Learning · Computer Science 2022-02-01 Weichao Mao , Lin F. Yang , Kaiqing Zhang , Tamer Başar

Distributed optimal control is known to be challenging and can become intractable even for linear-quadratic regulator problems. In this work, we study a special class of such problems where distributed state feedback controllers can give…

Systems and Control · Electrical Eng. & Systems 2024-03-14 Johan Olsson , Runyu Zhang , Emma Tegling , Na Li

Multi-Agent Reinforcement Learning (MARL) has gained significant traction for solving complex real-world tasks, but the inherent stochasticity and uncertainty in these environments pose substantial challenges to efficient and robust policy…

Machine Learning · Computer Science 2025-01-22 Somnath Hazra , Pallab Dasgupta , Soumyajit Dey

Achieving convergence of multiple learning agents in general $N$-player games is imperative for the development of safe and reliable machine learning (ML) algorithms and their application to autonomous systems. Yet it is known that, outside…

Computer Science and Game Theory · Computer Science 2023-01-24 Aamal Abbas Hussain , Francesco Belardinelli , Georgios Piliouras

Reinforcement learning (RL) algorithms can find an optimal policy for a single agent to accomplish a particular task. However, many real-world problems require multiple agents to collaborate in order to achieve a common goal. For example, a…

Machine Learning · Computer Science 2025-10-20 Jan Corazza , Hadi Partovi Aria , Hyohun Kim , Daniel Neider , Zhe Xu

We study the policy evaluation problem in multi-agent reinforcement learning. In this problem, a group of agents works cooperatively to evaluate the value function for the global discounted accumulative reward problem, which is composed of…

Optimization and Control · Mathematics 2019-06-04 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

Active reinforcement learning (ARL) is a variant on reinforcement learning where the agent does not observe the reward unless it chooses to pay a query cost c > 0. The central question of ARL is how to quantify the long-term value of reward…

Machine Learning · Computer Science 2020-11-26 David Krueger , Jan Leike , Owain Evans , John Salvatier

Multi-Agent Reinforcement Learning (MARL) is a promising area of research that can model and control multiple, autonomous decision-making agents. During online training, MARL algorithms involve performance-intensive computations such as…

Multiagent Systems · Computer Science 2023-02-13 Kailash Gogineni , Peng Wei , Tian Lan , Guru Venkataramani

This paper proposes a novel scalable type of multi-agent reinforcement learning-based coordination for distributed residential energy. Cooperating agents learn to control the flexibility offered by electric vehicles, space heating and…

Systems and Control · Electrical Eng. & Systems 2022-03-29 Flora Charbonnier , Thomas Morstyn , Malcolm D. McCulloch

In cooperative multi-agent reinforcement learning, a collection of agents learns to interact in a shared environment to achieve a common goal. We propose the use of reward machines (RM) -- Mealy machines used as structured representations…

Multiagent Systems · Computer Science 2021-06-16 Cyrus Neary , Zhe Xu , Bo Wu , Ufuk Topcu

Reinforcement learning has been successful both empirically and theoretically in single-agent settings, but extending these results to multi-agent reinforcement learning in general-sum Markov games remains challenging. This paper studies…

Machine Learning · Computer Science 2026-04-07 Narim Jeong , Donghwan Lee

In human society, the conflict between self-interest and collective well-being often obstructs efforts to achieve shared welfare. Related concepts like the Tragedy of the Commons and Social Dilemmas frequently manifest in our daily lives.…

Multiagent Systems · Computer Science 2025-06-17 Yue Jin , Shuangqing Wei , Giovanni Montana

Deep Reinforcement Learning (RL) algorithms can solve complex sequential decision tasks successfully. However, they have a major drawback of having poor sample efficiency which can often be tackled by knowledge reuse. In Multi-Agent…

Multiagent Systems · Computer Science 2019-05-30 Ercüment İlhan , Jeremy Gow , Diego Perez-Liebana

In cooperative multi-agent reinforcement learning (MARL), how to design a suitable reward signal to accelerate learning and stabilize convergence is a critical problem. The global reward signal assigns the same global reward to all agents…

Artificial Intelligence · Computer Science 2020-03-10 Hangyu Mao , Zhibo Gong , Zhen Xiao

Learning in multi-agent scenarios is a fruitful research direction, but current approaches still show scalability problems in multiple games with general reward settings and different opponent types. The Multi-Agent Reinforcement Learning…

Artificial Intelligence · Computer Science 2025-04-14 Diego Perez-Liebana , Katja Hofmann , Sharada Prasanna Mohanty , Noboru Kuno , Andre Kramer , Sam Devlin , Raluca D. Gaina , Daniel Ionita

Motivated by the emerging use of multi-agent reinforcement learning (MARL) in engineering applications such as networked robotics, swarming drones, and sensor networks, we investigate the policy evaluation problem in a fully decentralized…

Machine Learning · Computer Science 2020-01-31 Jun Sun , Gang Wang , Georgios B. Giannakis , Qinmin Yang , Zaiyue Yang

In real-world environments, autonomous agents rely on their egocentric observations. They must learn adaptive strategies to interact with others who possess mixed motivations, discernible only through visible cues. Several Multi-Agent…

Multiagent Systems · Computer Science 2023-12-15 Violet Xiang , Logan Cross , Jan-Philipp Fränken , Nick Haber

Cooperative multi-agent reinforcement learning (MARL) has been an increasingly important research topic in the last half-decade because of its great potential for real-world applications. Because of the curse of dimensionality, the popular…

Multiagent Systems · Computer Science 2024-04-05 Weizhe Chen , Sven Koenig , Bistra Dilkina