English
Related papers

Related papers: Learning to Hand Off: Provably Convergent Workflow…

200 papers

In this paper, we address the problem of distributed interference management of cognitive femtocells that share the same frequency range with macrocells (primary user) using distributed multi-agent Q-learning. We formulate and solve three…

Multiagent Systems · Computer Science 2013-03-13 Hussein Saad , Amr Mohamed , Tamer ElBatt

These days automation is being applied everywhere. In every environment, planning for the actions to be taken by the agents is an important aspect. In this paper, we plan to implement planning for multi-agents with a centralized controller.…

Artificial Intelligence · Computer Science 2023-02-09 Alakh Aggarwal , Rishita Bansal , Parth Padalkar , Sriraam Natarajan

We consider multiple parallel Markov decision processes (MDPs) coupled by global constraints, where the time varying objective and constraint functions can only be observed after the decision is made. Special attention is given to how well…

Optimization and Control · Mathematics 2017-09-12 Xiaohan Wei , Hao Yu , Michael J. Neely

In this paper, we study the problem of reinforcement learning in multi-agent systems where communication among agents is limited. We develop a decentralized actor-critic learning framework in which each agent performs several local updates…

Machine Learning · Computer Science 2025-10-23 Xiaoxing Ren , Nicola Bastianello , Thomas Parisini , Andreas A. Malikopoulos

In this paper we design hybrid control policies for hybrid systems whose mathematical models are unknown. Our contributions are threefold. First, we propose a framework for modelling the hybrid control design problem as a single Markov…

Systems and Control · Electrical Eng. & Systems 2020-09-03 Meet Gandhi , Atreyee Kundu , Shalabh Bhatnagar

Co-optimizing safety and performance in large-scale multi-agent systems remains a fundamental challenge. Existing approaches based on multi-agent reinforcement learning (MARL), safety filtering, or Model Predictive Control (MPC) either lack…

Robotics · Computer Science 2025-09-30 Manan Tayal , Aditya Singh , Shishir Kolathaya , Somil Bansal

We consider a reinforcement learning (RL) setting in which the agent interacts with a sequence of episodic MDPs. At the start of each episode the agent has access to some side-information or context that determines the dynamics of the MDP…

Machine Learning · Statistics 2019-10-24 Aditya Modi , Nan Jiang , Satinder Singh , Ambuj Tewari

We introduce hybrid execution in multi-agent reinforcement learning (MARL), a new paradigm in which agents aim to successfully complete cooperative tasks with arbitrary communication levels at execution time by taking advantage of…

Machine Learning · Computer Science 2023-06-06 Pedro P. Santos , Diogo S. Carvalho , Miguel Vasco , Alberto Sardinha , Pedro A. Santos , Ana Paiva , Francisco S. Melo

As a primary contribution, we present a convergence theorem for stochastic iterations, and in particular, Q-learning iterates, under a general, possibly non-Markovian, stochastic environment. Our conditions for convergence involve an…

Optimization and Control · Mathematics 2024-03-05 Ali Devran Kara , Serdar Yuksel

Large Language Models (LLMs) are evolving into autonomous agents capable of executing complex workflows via standardized protocols (e.g., MCP). However, this paradigm shifts control from deterministic code to probabilistic inference,…

Cryptography and Security · Computer Science 2026-02-10 Guanquan Shi , Haohua Du , Zhiqiang Wang , Xiaoyu Liang , Weiwenpei Liu , Song Bian , Zhenyu Guan

The state-of-the-art multi-agent reinforcement learning (MARL) methods have provided promising solutions to a variety of complex problems. Yet, these methods all assume that agents perform synchronized primitive-action executions so that…

Artificial Intelligence · Computer Science 2022-10-12 Yuchen Xiao

Large Language Models (LLMs) have revolutionized the field of artificial intelligence (AI) through their advanced reasoning capabilities, but their extensive parameter sets introduce significant inference latency, posing a challenge to…

Information Theory · Computer Science 2025-04-11 Shuying Gan , Xijun Wang , Chenyuan Feng , Chao Xu , Howard H. Yang , Xiang Chen , Tony Q. S. Quek

Memory systems are critical for LLMs, mitigating context window limitations and supporting long-horizon user-LLM interactions. Such systems typically comprise multiple agents responsible for memory construction and retrieval. Existing…

Multiagent Systems · Computer Science 2026-04-28 Wenyu Mao , Haoyang Liu , Haosong Tan , Yaorui Shi , Jiancan Wu , An Zhang , Xiang Wang

Offline reinforcement learning (RL) aims to learn policies from pre-existing datasets without further interactions, making it a challenging task. Q-learning algorithms struggle with extrapolation errors in offline settings, while supervised…

Artificial Intelligence · Computer Science 2025-01-03 Zhengbang Zhu , Minghuan Liu , Liyuan Mao , Bingyi Kang , Minkai Xu , Yong Yu , Stefano Ermon , Weinan Zhang

We study cooperative online learning in stochastic and adversarial Markov decision process (MDP). That is, in each episode, $m$ agents interact with an MDP simultaneously and share information in order to minimize their individual regret.…

Machine Learning · Computer Science 2022-09-02 Tal Lancewicki , Aviv Rosenberg , Yishay Mansour

We study infinite-horizon Constrained Markov Decision Processes (CMDPs) with general policy parameterizations and multi-layer neural network critics. Existing theoretical analyses for constrained reinforcement learning largely rely on…

Machine Learning · Computer Science 2026-03-10 Anirudh Satheesh , Pankaj Kumar Barman , Washim Uddin Mondal , Vaneet Aggarwal

Information exchange in multi-agent systems improves the cooperation among agents, especially in partially observable settings. In the real world, communication is often carried out over imperfect channels. This requires agents to handle…

Multiagent Systems · Computer Science 2023-11-28 Jannis Weil , Gizem Ekinci , Heinz Koeppl , Tobias Meuser

Stochastic dynamic teams and games are rich models for decentralized systems and challenging testing grounds for multi-agent learning. Previous work that guaranteed team optimality assumed stateless dynamics, or an explicit coordination…

Optimization and Control · Mathematics 2024-03-28 Bora Yongacoglu , Gürdal Arslan , Serdar Yüksel

Traditionally, resource management and capacity allocation has been controlled network-side in cellular deployment. As autonomicity has been added to network design, machine learning technologies have largely followed this paradigm,…

Networking and Internet Architecture · Computer Science 2022-02-02 Steven Platt , Berkay Demirel , Miquel Oliver

This paper puts forward the concept that learning to take safe actions in unknown environments, even with probability one guarantees, can be achieved without the need for an unbounded number of exploratory trials. This is indeed possible,…

Systems and Control · Electrical Eng. & Systems 2023-02-14 Agustin Castellano , Hancheng Min , Juan Bazerque , Enrique Mallada