English
Related papers

Related papers: Fully Asynchronous Policy Evaluation in Distribute…

200 papers

Dynamic distribution network reconfiguration (DNR) algorithms perform hourly status changes of remotely controllable switches to improve distribution system performance. The problem is typically solved by physical model-based control…

Systems and Control · Electrical Eng. & Systems 2020-06-24 Yuanqi Gao , Wei Wang , Jie Shi , Nanpeng Yu

This paper studies the distributed model predictive control (DMPC) problem for distributed discrete-time linear systems with both local and global constraints over directed communication networks. We establish an optimization problem to…

Optimization and Control · Mathematics 2025-11-06 Pengbiao Wang , Xuemei Ren , Dongdong Zheng

This work proposes and studies the distributed resource allocation problem in asynchronous and stochastic settings. We consider a distributed system with multiple workers and a coordinating server with heterogeneous computation and…

Optimization and Control · Mathematics 2025-09-03 Qiang Li , Michal Yemini , Hoi-To Wai

In software-defined networking (SDN), the implementation of distributed SDN controllers, with each controller responsible for managing a specific sub-network or domain, plays a critical role in achieving a balance between centralized…

Networking and Internet Architecture · Computer Science 2024-03-15 Ioannis Panitsas , Akrit Mudvari , Leandros Tassiulas

We propose a new belief update rule for Distributed Non-Bayesian learning in time-varying directed graphs, where a group of agents tries to collectively identify a hypothesis that best describes a sequence of observed data. We show that the…

Optimization and Control · Mathematics 2015-09-30 Angelia Nedić , Alex Olshevsky , César A. Uribe

Distributional reinforcement learning (DRL) enhances the understanding of the effects of the randomness in the environment by letting agents learn the distribution of a random return, rather than its expected value as in standard…

Optimization and Control · Mathematics 2024-03-26 Zifan Wang , Yulong Gao , Siyi Wang , Michael M. Zavlanos , Alessandro Abate , Karl H. Johansson

Recently introduced distributed zeroth-order optimization (ZOO) algorithms have shown their utility in distributed reinforcement learning (RL). Unfortunately, in the gradient estimation process, almost all of them require random samples…

Systems and Control · Electrical Eng. & Systems 2024-05-06 Gangshan Jing , He Bai , Jemin George , Aranya Chakrabortty , Piyush K. Sharma

In this work, we examine a network of agents operating asynchronously, aiming to discover an ideal global model that suits individual local datasets. Our assumption is that each agent independently chooses when to participate throughout the…

Machine Learning · Computer Science 2024-02-09 Elsa Rizk , Kun Yuan , Ali H. Sayed

Transfer Learning (TL) has shown great potential to accelerate Reinforcement Learning (RL) by leveraging prior knowledge from past learned policies of relevant tasks. Existing transfer approaches either explicitly computes the similarity…

We consider a decentralized wireless network with several source-destination pairs sharing a limited number of orthogonal frequency bands. Sources learn to adapt their transmissions (specifically, their band selection strategy) over time,…

Networking and Internet Architecture · Computer Science 2025-04-01 Yubo Zhang , Pedro Botelho , Trevor Gordon , Gil Zussman , Igor Kadota

We study the policy evaluation problem in multi-agent reinforcement learning. In this problem, a group of agents works cooperatively to evaluate the value function for the global discounted accumulative reward problem, which is composed of…

Optimization and Control · Mathematics 2019-06-04 Thinh T. Doan , Siva Theja Maguluri , Justin Romberg

Deep Reinforcement Learning (DRL) has recently been proposed as a methodology to discover complex Active Flow Control (AFC) strategies [Rabault, J., Kuchta, M., Jensen, A., Reglade, U., & Cerardi, N. (2019): "Artificial neural networks…

Computational Physics · Physics 2019-10-23 Jean Rabault , Alexander Kuhnle

Risk-sensitive reinforcement learning (RL) is crucial for maintaining reliable performance in high-stakes applications. While traditional RL methods aim to learn a point estimate of the random cumulative cost, distributional RL (DRL) seeks…

Machine Learning · Computer Science 2025-02-03 Minheng Xiao , Xian Yu , Lei Ying

Reinforcement learning (RL) is currently one of the most prominent methods for optimizing dynamical systems, with breakthrough results across various fields. The framework is based on the concept of a Markov decision process (MDP), leading…

Optimization and Control · Mathematics 2025-11-17 Rene Carmona , Mathieu Lauriere

This paper introduces a resource allocation framework specifically tailored for addressing the problem of dynamic placement (or pinning) of parallelized applications to processing units. Under the proposed setup each thread of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-06-28 Georgios C. Chasparis , Michael Rossbory

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

We address real-time sampling and estimation of autoregressive Markovian sources in dynamic yet structurally similar multi-hop wireless networks. Each node caches samples from others and communicates over wireless collision channels, aiming…

Machine Learning · Computer Science 2026-01-27 Xingran Chen , Navid NaderiAlizadeh , Alejandro Ribeiro , Shirin Saeedi Bidokhti

We address the problem of designing an LQR controller in a distributed setting, where M similar but not identical systems share their locally computed policy gradient (PG) estimates with a server that aggregates the estimates and computes a…

Optimization and Control · Mathematics 2024-04-16 Leonardo F. Toso , Han Wang , James Anderson

Distributional reinforcement learning (DRL) is a recent reinforcement learning framework whose success has been supported by various empirical studies. It relies on the key idea of replacing the expected return with the return distribution,…

Machine Learning · Computer Science 2020-01-09 Rahul Singh , Keuntaek Lee , Yongxin Chen

This paper presents a novel deep reinforcement learning-based resource allocation technique for the multi-agent environment presented by a cognitive radio network where the interactions of the agents during learning may lead to a…

Machine Learning · Computer Science 2022-05-30 Ankita Tondwalkar , Andres Kwasinski