English
Related papers

Related papers: Best Possible Q-Learning

200 papers

We introduce the lookahead-bounded Q-learning (LBQL) algorithm, a new, provably convergent variant of Q-learning that seeks to improve the performance of standard Q-learning in stochastic environments through the use of ``lookahead'' upper…

Machine Learning · Computer Science 2020-06-30 Ibrahim El Shar , Daniel R. Jiang

This article introduces a generalized framework for Decentralized Learning formulated as a Multi-Objective Optimization problem, in which both distributed agents and a central coordinator contribute independent, potentially conflicting…

Optimization and Control · Mathematics 2025-07-21 Roberto Morales , Umberto Biccari

A crucial challenge in decentralized systems is state estimation in the presence of unknown inputs, particularly within heterogeneous sensor networks with dynamic topologies. While numerous consensus algorithms have been introduced, they…

Systems and Control · Electrical Eng. & Systems 2024-12-13 Zida Wu , Ankur Mehta

Most solutions to the inventory management problem assume a centralization of information that is incompatible with organisational constraints in real supply chain networks. The inventory management problem is a well-known planning problem…

Machine Learning · Computer Science 2023-07-24 Marwan Mousa , Damien van de Berg , Niki Kotecha , Ehecatl Antonio del Rio-Chanona , Max Mowbray

There are only a few learning algorithms applicable to stochastic dynamic teams and games which generalize Markov decision processes to decentralized stochastic control problems involving possibly self-interested decision makers. Learning…

Optimization and Control · Mathematics 2016-05-03 Gürdal Arslan , Serdar Yüksel

Deep Q-learning has achieved significant success in single-agent decision making tasks. However, it is challenging to extend Q-learning to large-scale multi-agent scenarios, due to the explosion of action space resulting from the complex…

Multiagent Systems · Computer Science 2019-10-14 Ming Zhou , Yong Chen , Ying Wen , Yaodong Yang , Yufeng Su , Weinan Zhang , Dell Zhang , Jun Wang

Reinforcement learning is a popular method of finding optimal solutions to complex problems. Algorithms like Q-learning excel at learning to solve stochastic problems without a model of their environment. However, they take longer to solve…

Artificial Intelligence · Computer Science 2024-04-25 Jan Diekhoff , Jörn Fischer

Stochastic games are a popular framework for studying multi-agent reinforcement learning (MARL). Recent advances in MARL have focused primarily on games with finitely many states. In this work, we study multi-agent learning in stochastic…

Machine Learning · Computer Science 2024-03-28 Awni Altabaa , Bora Yongacoglu , Serdar Yüksel

With artificial intelligence systems becoming ubiquitous in our society, its designers will soon have to start to consider its social dimension, as many of these systems will have to interact among them to work efficiently. With this in…

Artificial Intelligence · Computer Science 2020-06-23 Santiago Cuervo , Marco Alzate

We study multi-agent reinforcement learning (MARL) in infinite-horizon discounted zero-sum Markov games. We focus on the practical but challenging setting of decentralized MARL, where agents make decisions without coordination by a…

Computer Science and Game Theory · Computer Science 2021-12-14 Muhammed O. Sayin , Kaiqing Zhang , David S. Leslie , Tamer Basar , Asuman Ozdaglar

Lane-changing decisions, which are crucial for autonomous vehicle path planning, face practical challenges due to rule-based constraints and limited data. Deep reinforcement learning has become a major research focus due to its advantages…

Artificial Intelligence · Computer Science 2025-10-27 Xiaojun Bi , Mingjie He , Yiwen Sun

Learning in games has been widely used to solve many cooperative multi-agent problems such as coverage control, consensus, self-reconfiguration or vehicle-target assignment. One standard approach in this domain is to formulate the problem…

Systems and Control · Electrical Eng. & Systems 2022-09-07 Abbasali Koochakzadeh , Yasin Yazıcıoğlu

Offline reinforcement learning (RL), which seeks to learn an optimal policy using offline data, has garnered significant interest due to its potential in critical applications where online data collection is infeasible or expensive. This…

Machine Learning · Computer Science 2024-02-09 Jiin Woo , Laixi Shi , Gauri Joshi , Yuejie Chi

Reinforcement Learning is gaining attention by the wireless networking community due to its potential to learn good-performing configurations only from the observed results. In this work we propose a stateless variation of Q-learning, which…

Networking and Internet Architecture · Computer Science 2017-08-30 Francesc Wilhelmi , Boris Bellalta , Cristina Cano , Anders Jonsson

Multi-Agent Reinforcement Learning (MARL) has gained significant interest in recent years, enabling sequential decision-making across multiple agents in various domains. However, most existing explanation methods focus on centralized MARL,…

Artificial Intelligence · Computer Science 2025-11-14 Kayla Boggess , Sarit Kraus , Lu Feng

Many machine learning problems can be formulated as consensus optimization problems which can be solved efficiently via a cooperative multi-agent system. However, the agents in the system can be unreliable due to a variety of reasons:…

Machine Learning · Computer Science 2018-05-23 Qunwei Li , Bhavya Kailkhura , Ryan Goldhahn , Priyadip Ray , Pramod K. Varshney

The study of decentralized learning or independent learning in cooperative multi-agent reinforcement learning has a history of decades. Recently empirical studies show that independent PPO (IPPO) can obtain good performance, close to or…

Machine Learning · Computer Science 2022-11-08 Kefan Su , Zongqing Lu

We study Byzantine-resilient distributed multi-agent reinforcement learning (MARL), where agents must collaboratively learn optimal value functions over a compromised communication network. Existing resilient MARL approaches typically…

Multiagent Systems · Computer Science 2026-04-06 Haejoon Lee , Dimitra Panagou

This paper presents a novel deep reinforcement learning-based resource allocation technique for the multi-agent environment presented by a cognitive radio network where the interactions of the agents during learning may lead to a…

Machine Learning · Computer Science 2022-05-30 Ankita Tondwalkar , Andres Kwasinski

In many real world applications, reinforcement learning agents have to optimize multiple objectives while following certain rules or satisfying a list of constraints. Classical methods based on reward shaping, i.e. a weighted combination of…

Machine Learning · Computer Science 2020-09-15 Gabriel Kalweit , Maria Huegle , Moritz Werling , Joschka Boedecker