中文
相关论文

相关论文: Coding for Distributed Multi-Agent Reinforcement L…

200 篇论文

The emerging large-scale and data-hungry algorithms require the computations to be delegated from a central server to several worker nodes. One major challenge in the distributed computations is to tackle delays and failures caused by the…

信息论 · 计算机科学 2021-03-03 Alejandro Cohen , Guillaume Thiran , Homa Esfahanizadeh , Muriel Médard

One of the challenges for multi-agent reinforcement learning (MARL) is designing efficient learning algorithms for a large system in which each agent has only limited or partial information of the entire system. While exciting progress has…

机器学习 · 计算机科学 2022-02-22 Haotian Gu , Xin Guo , Xiaoli Wei , Renyuan Xu

Tasks for multi-robot systems often require the robots to collaborate and complete a team goal while maintaining safety. This problem is usually formalized as a constrained Markov decision process (CMDP), which targets minimizing a global…

机器人学 · 计算机科学 2025-04-23 Songyuan Zhang , Oswin So , Mitchell Black , Zachary Serlin , Chuchu Fan

A significant challenge facing researchers in the area of multi-agent reinforcement learning (MARL) pertains to the identification of a library that can offer fast and compatible development for multi-agent tasks and algorithm combinations,…

机器学习 · 计算机科学 2023-11-07 Siyi Hu , Yifan Zhong , Minquan Gao , Weixun Wang , Hao Dong , Xiaodan Liang , Zhihui Li , Xiaojun Chang , Yaodong Yang

Multi-agent reinforcement learning (MARL) has been gaining extensive attention from academia and industries in the past few decades. One of the fundamental problems in MARL is how to evaluate different approaches comprehensively. Most…

多智能体系统 · 计算机科学 2022-06-22 Zhiuxan Liang , Jiannong Cao , Shan Jiang , Divya Saxena , Jinlin Chen , Huafeng Xu

Coded computing is a method for mitigating straggling workers in a centralized computing network, by using erasure-coding techniques. Federated learning is a decentralized model for training data distributed across client devices. In this…

信息论 · 计算机科学 2023-09-06 Neophytos Charalambides , Mert Pilanci , Alfred Hero

Many cooperative multiagent reinforcement learning environments provide agents with a sparse team-based reward, as well as a dense agent-specific reward that incentivizes learning basic skills. Training policies solely on the team-based…

机器学习 · 计算机科学 2020-10-13 Shauharda Khadka , Somdeb Majumdar , Santiago Miret , Stephen McAleer , Kagan Tumer

Multi-agent deep reinforcement learning (MARL) suffers from a lack of commonly-used evaluation tasks and criteria, making comparisons between approaches difficult. In this work, we provide a systematic evaluation and comparison of three…

机器学习 · 计算机科学 2021-11-10 Georgios Papoudakis , Filippos Christianos , Lukas Schäfer , Stefano V. Albrecht

Computationally intensive distributed and parallel computing is often bottlenecked by a small set of slow workers known as stragglers. In this paper, we utilize the emerging idea of "coded computation" to design a novel…

信息论 · 计算机科学 2017-06-06 Yaoqing Yang , Pulkit Grover , Soummya Kar

In this article, we address the problem of federated learning in the presence of stragglers. For this problem, a coded federated learning framework has been proposed, where the central server aggregates gradients received from the…

信号处理 · 电气工程与系统科学 2025-08-07 Chengxi Li , Ming Xiao , Mikael Skoglund

We propose a unified coded framework for distributed computing with straggling servers, by introducing a tradeoff between "latency of computation" and "load of communication" for some linear computation tasks. We show that the coded scheme…

信息论 · 计算机科学 2016-10-26 Songze Li , Mohammad Ali Maddah-Ali , A. Salman Avestimehr

We consider the problem of \emph{fully decentralized} multi-agent reinforcement learning (MARL), where the agents are located at the nodes of a time-varying communication network. Specifically, we assume that the reward functions of the…

机器学习 · 计算机科学 2018-02-28 Kaiqing Zhang , Zhuoran Yang , Han Liu , Tong Zhang , Tamer Başar

Finding the optimal signal timing strategy is a difficult task for the problem of large-scale traffic signal control (TSC). Multi-Agent Reinforcement Learning (MARL) is a promising method to solve this problem. However, there is still room…

机器学习 · 计算机科学 2021-09-14 Xiaoqiang Wang , Liangjun Ke , Zhimin Qiao , Xinghua Chai

The recent success of single-agent reinforcement learning (RL) in Internet of things (IoT) systems motivates the study of multi-agent reinforcement learning (MARL), which is more challenging but more useful in large-scale IoT. In this…

机器学习 · 计算机科学 2020-09-01 Yue Xu , Zengde Deng , Mengdi Wang , Wenjun Xu , Anthony Man-Cho So , Shuguang Cui

This paper presents deep meta coordination graphs (DMCG) for learning cooperative policies in multi-agent reinforcement learning (MARL). Coordination graph formulations encode local interactions and accordingly factorize the joint value…

机器学习 · 计算机科学 2026-02-11 Nikunj Gupta , James Zachary Hare , Jesse Milzman , Rajgopal Kannan , Viktor Prasanna

Stochastic games are a popular framework for studying multi-agent reinforcement learning (MARL). Recent advances in MARL have focused primarily on games with finitely many states. In this work, we study multi-agent learning in stochastic…

机器学习 · 计算机科学 2024-03-28 Awni Altabaa , Bora Yongacoglu , Serdar Yüksel

A major hurdle in machine learning is scalability to massive datasets. Approaches to overcome this hurdle include compression of the data matrix and distributing the computations. \textit{Leverage score sampling} provides a compressed…

信息论 · 计算机科学 2020-09-16 Neophytos Charalambides , Mert Pilanci , Alfred O. Hero

Gradient descent (GD) methods are commonly employed in machine learning problems to optimize the parameters of the model in an iterative fashion. For problems with massive datasets, computations are distributed to many parallel computing…

信息论 · 计算机科学 2019-03-06 Emre Ozfatura , Deniz Gunduz , Sennur Ulukus

Deep Reinforcement Learning (RL) algorithms can solve complex sequential decision tasks successfully. However, they have a major drawback of having poor sample efficiency which can often be tackled by knowledge reuse. In Multi-Agent…

多智能体系统 · 计算机科学 2019-05-30 Ercüment İlhan , Jeremy Gow , Diego Perez-Liebana

Tensors are a fundamental operation in distributed computing, \emph{e.g.,} machine learning, that are commonly distributed into multiple parallel tasks for large datasets. Stragglers and other failures can severely impact the overall…

信息论 · 计算机科学 2024-10-30 Pedro Soto