English
Related papers

Related papers: Strategizing against Q-learners: A Control-theoret…

200 papers

We employ the Deep Q-Learning algorithm with Experience Replay to train an agent capable of achieving a high-level of play in the L-Game while self-learning from low-dimensional states. We also employ variable batch size for training in…

Machine Learning · Computer Science 2018-02-20 Petros Giannakopoulos , Yannis Cotronis

Intuitively, experience playing against one mixture of opponents in a given domain should be relevant for a different mixture in the same domain. We propose a transfer learning method, Q-Mixing, that starts by learning Q-values against each…

Multiagent Systems · Computer Science 2021-06-04 Max Olan Smith , Thomas Anthony , Yongzhao Wang , Michael P. Wellman

Despite the considerable success enjoyed by machine learning techniques in practice, numerous studies demonstrated that many approaches are vulnerable to attacks. An important class of such attacks involves adversaries changing features at…

Machine Learning · Computer Science 2018-06-07 Liang Tong , Sixie Yu , Scott Alfeld , Yevgeniy Vorobeychik

This paper introduces a multi-agent approach to adjust traffic lights based on traffic situation in order to reduce average delay time. In the traffic model, lights of each intersection are controlled by an autonomous agent. Since decision…

Multiagent Systems · Computer Science 2019-05-07 Abolghasem Daeichian , Amir Haghani

The use of mobile robots is being popular over the world mainly for autonomous explorations in hazardous/ toxic or unknown environments. This exploration will be more effective and efficient if the explorations in unknown environment can be…

Robotics · Computer Science 2011-10-11 Dip Narayan Ray , Somajyoti Majumder , Sumit Mukhopadhyay

In this paper, we place deep Q-learning into a control-oriented perspective and study its learning dynamics with well-established techniques from robust control. We formulate an uncertain linear time-invariant model by means of the neural…

Machine Learning · Computer Science 2022-11-08 Balazs Varga , Balazs Kulcsar , Morteza Haghir Chehreghani

Quantum computing has a superior advantage in tackling specific problems, such as integer factorization and Simon's problem. For more general tasks in machine learning, by applying variational quantum circuits, more and more quantum…

Quantum Physics · Physics 2021-12-23 Qingfeng Lan

We formulate an efficient approximation for multi-agent batch reinforcement learning, the approximated multi-agent fitted Q iteration (AMAFQI). We present a detailed derivation of our approach. We propose an iterative policy search and show…

Machine Learning · Computer Science 2023-04-06 Antoine Lesage-Landry , Duncan S. Callaway

Recent advances in deep learning have allowed artificial agents to rival human-level performance on a wide range of complex tasks; however, the ability of these networks to learn generalizable strategies remains a pressing challenge. This…

Artificial Intelligence · Computer Science 2018-01-23 Necati Alp Muyesser , Kyle Dunovan , Timothy Verstynen

Inspired by a graph-based technique for predicting molecular properties in quantum chemistry -- atoms' position within molecules in three-dimensional space -- we present Q-MARL, a completely decentralised learning architecture that supports…

Machine Learning · Computer Science 2025-03-11 Kha Vo , Chin-Teng Lin

Value factorization is a popular and promising approach to scaling up multi-agent reinforcement learning in cooperative settings, which balances the learning scalability and the representational capacity of value functions. However, the…

Machine Learning · Computer Science 2021-11-02 Jianhao Wang , Zhizhou Ren , Beining Han , Jianing Ye , Chongjie Zhang

Reinforcement learning agents in complex game environments often suffer from sparse rewards, training instability, and poor sample efficiency. This paper presents a hybrid training approach that combines offline imitation learning with…

Machine Learning · Computer Science 2025-09-19 Thomas Ackermann , Moritz Spang , Hamza A. A. Gardi

Cybersecurity defense involves interactions between adversarial parties (namely defenders and hackers), making multi-agent reinforcement learning (MARL) an ideal approach for modeling and learning strategies for these scenarios. This paper…

Multiagent Systems · Computer Science 2025-09-03 Qintong Xie , Edward Koh , Xavier Cadet , Peter Chin

This paper studies reinforcement learning (RL) under malicious falsification on cost signals and introduces a quantitative framework of attack models to understand the vulnerabilities of RL. Focusing on $Q$-learning, we show that…

Machine Learning · Computer Science 2019-08-20 Yunhan Huang , Quanyan Zhu

We study multi-agent reinforcement learning (MARL) in infinite-horizon discounted zero-sum Markov games. We focus on the practical but challenging setting of decentralized MARL, where agents make decisions without coordination by a…

Computer Science and Game Theory · Computer Science 2021-12-14 Muhammed O. Sayin , Kaiqing Zhang , David S. Leslie , Tamer Basar , Asuman Ozdaglar

We present an algorithm for learning an approximate action-value soft Q-function in the relative entropy regularised reinforcement learning setting, for which an optimal improved policy can be recovered in closed form. We use recent…

Machine Learning · Computer Science 2019-11-06 Jonas Degrave , Abbas Abdolmaleki , Jost Tobias Springenberg , Nicolas Heess , Martin Riedmiller

Understanding the evolutionary dynamics of reinforcement learning under multi-agent settings has long remained an open problem. While previous works primarily focus on 2-player games, we consider population games, which model the strategic…

Multiagent Systems · Computer Science 2020-06-30 Shuyue Hu , Chin-Wing Leung , Ho-fung Leung , Harold Soh

Solution concepts of traditional game theory assume entirely rational players; therefore, their ability to exploit subrational opponents is limited. One type of subrationality that describes human behavior well is the quantal response.…

Artificial Intelligence · Computer Science 2021-07-08 David Milec , Jakub Černý , Viliam Lisý , Bo An

The goal of this paper is to propose a new Q-learning algorithm with a dummy adversarial player, which is called dummy adversarial Q-learning (DAQ), that can effectively regulate the overestimation bias in standard Q-learning. With the…

Machine Learning · Computer Science 2024-10-01 HyeAnn Lee , Donghwan Lee

Adversarial machine learning is an emerging field that focuses on studying vulnerabilities of machine learning approaches in adversarial settings and developing techniques accordingly to make learning robust to adversarial manipulations. It…

Quantum Physics · Physics 2020-08-11 Sirui Lu , Lu-Ming Duan , Dong-Ling Deng